2021-03-10T19:57:20.520 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T19:57:20.522 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953933 --description rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} --owner scheduled_sage@teuthology --name sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba --verbose -- /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953933/orig.config.yaml 2021-03-10T19:57:20.556 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-10T19:57:20.612 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953933 branch: wip-sage-testing-2021-03-09-1434 description: rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} email: null first_in_suite: false job_id: '5953933' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-03-09-1434 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b26fc080937a021ce826cdc94d1adb52c064381a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b26fc080937a021ce826cdc94d1adb52c064381a workunit: branch: cephadm-rgw-simplification sha1: d44b8689de3933d84fb4c950485b7316ce1737e8 owner: scheduled_sage@teuthology priority: 71 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: b26fc080937a021ce826cdc94d1adb52c064381a sleep_before_teardown: 0 suite: rados:cephadm:upgrade suite_branch: cephadm-rgw-simplification suite_path: /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: d44b8689de3933d84fb4c950485b7316ce1737e8 targets: gibba004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvQLnGBWXjBM5N4rI+hS/HykuC/cln6cs4xfbRxT70YKr4OkLKZyOXZyQGoV6E1EckKCb68THnrc62cTVCCreTLmnUu+F97W1INqqS4OEShmDbRjhsFA+WQxUxVqiEAhE0Z89OQUHIPJI5IqDXmpw8p1TvJO2eOanafcbwUPw6XI1mfcVSbFSPlGDn42GCZ143S4fCIh4moaJq/OhL7Afd5JWpH0L3wMfCL5S8ksOxQ329lVjXq9qcA6c5PuaLeiFFGOB7/i6CRyA3bti1DDEXyY4nbMRMz7kIpmQT62uaz3EfdVlSti17Ety7DF18yuvrv2SyrstTN51d/k/IH7zcNzhLDs7REnTwU05zLN1HhdhqZZJ3YZ18b3emvZ54HAIF2gYUED5pC8psGcD/ZK2VYVuUSop/F1pBayeTgneURB306FIFzkQQXgAbuTQmbRyOTaBAWbQB7S+Mqv9WG4p7T6Fn+rDq7kNpevkfvn2tSuLxoUmef+FlsmCu/3n+gNk= gibba009.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzwMIk9PgmgIt9I69KH8yhduZEH9LWwU6Ipe2I/AA5frnhpa9UZDSIz95jJNiSmufPdt/58TlrQ5WQ2c5RQJAB6QQ9m3A0RRH4Uv2Lf1AVZvOoD+DnBxme7gKQZBnvxGzLgXPXaJgY2YPz8aydQVYQp+LWOG/pgsxtsXgcU6JfTWpYsguDbHq+rN6oWehxLasbxUusKzeMtBnxf70/PChlYrRejrV7aAtQ1UbcmobnirNGTNql9pcx1Xpskfq3Zo/l5GiuvNa0UBn12aDwqqtN8tCNZ+2c6W+5rwBX9MT9je6HI1cqKpJMpaCzMnYHGhn0jDVFIwnbM9a4BqHI9UhhASYdp7UqJngHEqdQUcivJBMVtPaDdj6ZLSEUP8jqTrc2k+2i5dm+kCfS6oCSENlVetXEXI/r2xb/4fWT7ac1exEcvxyW+Pb94qx9QIaOJQMfy3Zc2SHOvQUg7/RxIpNfkvENfhUL6D9rJw9wTkyfnjdJD/ssNi21FDY0fOeRt3M= tasks: - cephadm: allow_ptrace: false cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 - sleep 120 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master teuthology_sha1: b6eecfe89a4363750d696160843a096384b357a8 timestamp: 2021-03-10_17:49:17 tube: gibba user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.26181 2021-03-10T19:57:20.613 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa; will attempt to use it 2021-03-10T19:57:20.614 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa/tasks 2021-03-10T19:57:20.615 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-10T19:57:20.617 INFO:teuthology.task.internal:Checking packages... 2021-03-10T19:57:20.647 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b26fc080937a021ce826cdc94d1adb52c064381a' 2021-03-10T19:57:20.647 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-10T19:57:20.648 INFO:teuthology.packaging:ref: None 2021-03-10T19:57:20.648 INFO:teuthology.packaging:tag: None 2021-03-10T19:57:20.648 INFO:teuthology.packaging:branch: wip-sage-testing-2021-03-09-1434 2021-03-10T19:57:20.649 INFO:teuthology.packaging:sha1: b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T19:57:20.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-03-09-1434 2021-03-10T19:57:20.791 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1749-gb26fc080-1focal 2021-03-10T19:57:20.792 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-10T19:57:20.804 INFO:teuthology.task.internal:no buildpackages task found 2021-03-10T19:57:20.804 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-10T19:57:20.831 INFO:teuthology.task.internal:Saving configuration 2021-03-10T19:57:20.844 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-10T19:57:20.854 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-10T19:57:20.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 19:52:16.840090', 'description': '/home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953933', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIebv2tcP24g7EzD29SuMQTvxwl5i2pZJ7ut15Lob6sJ', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba004.front.sepia.ceph.com'} 2021-03-10T19:57:20.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 19:52:16.840066', 'description': '/home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953933', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILzFTMuINXc9qPX6HyMvyUVXh6oPANvB70RgIQlYBuW0', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba009.front.sepia.ceph.com'} 2021-03-10T19:57:20.891 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-10T19:57:20.901 INFO:teuthology.task.internal:roles: ubuntu@gibba004.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-03-10T19:57:20.902 INFO:teuthology.task.internal:roles: ubuntu@gibba009.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-03-10T19:57:20.902 INFO:teuthology.run_tasks:Running task console_log... 2021-03-10T19:57:20.976 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a823bb598>, signals=[15]) 2021-03-10T19:57:20.978 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-10T19:57:20.988 INFO:teuthology.task.internal:Opening connections... 2021-03-10T19:57:20.989 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba004.front.sepia.ceph.com 2021-03-10T19:57:20.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:57:21.032 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba009.front.sepia.ceph.com 2021-03-10T19:57:21.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:57:21.069 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-10T19:57:21.080 DEBUG:teuthology.orchestra.run.gibba004:> uname -m 2021-03-10T19:57:21.085 INFO:teuthology.orchestra.run.gibba004.stdout:x86_64 2021-03-10T19:57:21.085 DEBUG:teuthology.orchestra.run.gibba004:> cat /etc/os-release 2021-03-10T19:57:21.130 INFO:teuthology.orchestra.run.gibba004.stdout:NAME="Ubuntu" 2021-03-10T19:57:21.130 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T19:57:21.131 INFO:teuthology.orchestra.run.gibba004.stdout:ID=ubuntu 2021-03-10T19:57:21.131 INFO:teuthology.orchestra.run.gibba004.stdout:ID_LIKE=debian 2021-03-10T19:57:21.131 INFO:teuthology.orchestra.run.gibba004.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T19:57:21.131 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION_ID="20.04" 2021-03-10T19:57:21.131 INFO:teuthology.orchestra.run.gibba004.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T19:57:21.132 INFO:teuthology.orchestra.run.gibba004.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T19:57:21.132 INFO:teuthology.orchestra.run.gibba004.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T19:57:21.133 INFO:teuthology.orchestra.run.gibba004.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T19:57:21.133 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION_CODENAME=focal 2021-03-10T19:57:21.133 INFO:teuthology.orchestra.run.gibba004.stdout:UBUNTU_CODENAME=focal 2021-03-10T19:57:21.134 INFO:teuthology.lock.ops:Updating gibba004.front.sepia.ceph.com on lock server 2021-03-10T19:57:21.152 DEBUG:teuthology.orchestra.run.gibba009:> uname -m 2021-03-10T19:57:21.157 INFO:teuthology.orchestra.run.gibba009.stdout:x86_64 2021-03-10T19:57:21.158 DEBUG:teuthology.orchestra.run.gibba009:> cat /etc/os-release 2021-03-10T19:57:21.206 INFO:teuthology.orchestra.run.gibba009.stdout:NAME="Ubuntu" 2021-03-10T19:57:21.206 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T19:57:21.206 INFO:teuthology.orchestra.run.gibba009.stdout:ID=ubuntu 2021-03-10T19:57:21.207 INFO:teuthology.orchestra.run.gibba009.stdout:ID_LIKE=debian 2021-03-10T19:57:21.207 INFO:teuthology.orchestra.run.gibba009.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T19:57:21.207 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_ID="20.04" 2021-03-10T19:57:21.207 INFO:teuthology.orchestra.run.gibba009.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T19:57:21.207 INFO:teuthology.orchestra.run.gibba009.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T19:57:21.208 INFO:teuthology.orchestra.run.gibba009.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T19:57:21.208 INFO:teuthology.orchestra.run.gibba009.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T19:57:21.208 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_CODENAME=focal 2021-03-10T19:57:21.208 INFO:teuthology.orchestra.run.gibba009.stdout:UBUNTU_CODENAME=focal 2021-03-10T19:57:21.209 INFO:teuthology.lock.ops:Updating gibba009.front.sepia.ceph.com on lock server 2021-03-10T19:57:21.225 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-10T19:57:21.245 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-10T19:57:21.283 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-10T19:57:21.284 DEBUG:teuthology.orchestra.run.gibba004:> test '!' -e /home/ubuntu/cephtest 2021-03-10T19:57:21.288 DEBUG:teuthology.orchestra.run.gibba009:> test '!' -e /home/ubuntu/cephtest 2021-03-10T19:57:21.295 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-10T19:57:21.305 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-10T19:57:21.306 DEBUG:teuthology.orchestra.run.gibba004:> test -z $(ls -A /var/lib/ceph) 2021-03-10T19:57:21.336 DEBUG:teuthology.orchestra.run.gibba009:> test -z $(ls -A /var/lib/ceph) 2021-03-10T19:57:21.352 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-10T19:57:21.404 INFO:teuthology.run_tasks:Running task kernel... 2021-03-10T19:57:21.422 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-10T19:57:21.422 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-10T19:57:21.423 DEBUG:teuthology.orchestra.run.gibba004:> uname -r 2021-03-10T19:57:21.432 INFO:teuthology.orchestra.run.gibba004.stdout:5.4.0-66-generic 2021-03-10T19:57:21.432 INFO:teuthology.task.kernel:Running kernel on gibba004: 5.4.0-66-generic 2021-03-10T19:57:21.433 DEBUG:teuthology.orchestra.run.gibba004:> sudo apt-get clean 2021-03-10T19:57:21.570 DEBUG:teuthology.orchestra.run.gibba004:> sudo apt-get update 2021-03-10T19:57:21.831 INFO:teuthology.orchestra.run.gibba004.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T19:57:21.831 INFO:teuthology.orchestra.run.gibba004.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T19:57:21.882 INFO:teuthology.orchestra.run.gibba004.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T19:57:22.194 INFO:teuthology.orchestra.run.gibba004.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [528 kB] 2021-03-10T19:57:22.224 INFO:teuthology.orchestra.run.gibba004.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T19:57:22.343 INFO:teuthology.orchestra.run.gibba004.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T19:57:22.481 INFO:teuthology.orchestra.run.gibba004.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T19:57:22.508 INFO:teuthology.orchestra.run.gibba004.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [200 kB] 2021-03-10T19:57:22.525 INFO:teuthology.orchestra.run.gibba004.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [114 kB] 2021-03-10T19:57:22.538 INFO:teuthology.orchestra.run.gibba004.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,264 B] 2021-03-10T19:57:22.539 INFO:teuthology.orchestra.run.gibba004.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T19:57:22.552 INFO:teuthology.orchestra.run.gibba004.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T19:57:22.554 INFO:teuthology.orchestra.run.gibba004.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [546 kB] 2021-03-10T19:57:22.597 INFO:teuthology.orchestra.run.gibba004.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T19:57:22.610 INFO:teuthology.orchestra.run.gibba004.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T19:57:22.611 INFO:teuthology.orchestra.run.gibba004.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T19:57:22.620 INFO:teuthology.orchestra.run.gibba004.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T19:57:22.621 INFO:teuthology.orchestra.run.gibba004.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T19:57:22.621 INFO:teuthology.orchestra.run.gibba004.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T19:57:22.655 INFO:teuthology.orchestra.run.gibba004.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.8 kB] 2021-03-10T19:57:22.657 INFO:teuthology.orchestra.run.gibba004.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T19:57:22.660 INFO:teuthology.orchestra.run.gibba004.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T19:57:22.689 INFO:teuthology.orchestra.run.gibba004.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T19:57:22.693 INFO:teuthology.orchestra.run.gibba004.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T19:57:24.538 INFO:teuthology.orchestra.run.gibba004.stdout:Fetched 5,546 kB in 1s (4,264 kB/s) 2021-03-10T19:57:25.475 INFO:teuthology.orchestra.run.gibba004.stdout:Reading package lists... 2021-03-10T19:57:25.486 DEBUG:teuthology.orchestra.run.gibba004:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T19:57:25.521 INFO:teuthology.orchestra.run.gibba004.stdout:Reading package lists... 2021-03-10T19:57:25.613 INFO:teuthology.orchestra.run.gibba004.stdout:Building dependency tree... 2021-03-10T19:57:25.614 INFO:teuthology.orchestra.run.gibba004.stdout:Reading state information... 2021-03-10T19:57:25.657 INFO:teuthology.orchestra.run.gibba004.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T19:57:25.658 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T19:57:25.659 DEBUG:teuthology.orchestra.run.gibba004:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T19:57:25.695 INFO:teuthology.orchestra.run.gibba004.stdout:Reading package lists... 2021-03-10T19:57:25.787 INFO:teuthology.orchestra.run.gibba004.stdout:Building dependency tree... 2021-03-10T19:57:25.787 INFO:teuthology.orchestra.run.gibba004.stdout:Reading state information... 2021-03-10T19:57:25.870 INFO:teuthology.orchestra.run.gibba004.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T19:57:25.871 INFO:teuthology.orchestra.run.gibba004.stdout:linux-image-generic set to manually installed. 2021-03-10T19:57:25.871 INFO:teuthology.orchestra.run.gibba004.stdout:0 upgraded, 0 newly installed, 0 to remove and 12 not upgraded. 2021-03-10T19:57:25.872 DEBUG:teuthology.orchestra.run.gibba004:> dpkg -s linux-image-generic 2021-03-10T19:57:25.924 INFO:teuthology.orchestra.run.gibba004.stdout:Package: linux-image-generic 2021-03-10T19:57:25.924 INFO:teuthology.orchestra.run.gibba004.stdout:Status: install ok installed 2021-03-10T19:57:25.924 INFO:teuthology.orchestra.run.gibba004.stdout:Priority: optional 2021-03-10T19:57:25.925 INFO:teuthology.orchestra.run.gibba004.stdout:Section: kernel 2021-03-10T19:57:25.925 INFO:teuthology.orchestra.run.gibba004.stdout:Installed-Size: 18 2021-03-10T19:57:25.925 INFO:teuthology.orchestra.run.gibba004.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T19:57:25.925 INFO:teuthology.orchestra.run.gibba004.stdout:Architecture: amd64 2021-03-10T19:57:25.925 INFO:teuthology.orchestra.run.gibba004.stdout:Source: linux-meta 2021-03-10T19:57:25.926 INFO:teuthology.orchestra.run.gibba004.stdout:Version: 5.4.0.66.69 2021-03-10T19:57:25.926 INFO:teuthology.orchestra.run.gibba004.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T19:57:25.926 INFO:teuthology.orchestra.run.gibba004.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T19:57:25.926 INFO:teuthology.orchestra.run.gibba004.stdout:Recommends: thermald 2021-03-10T19:57:25.927 INFO:teuthology.orchestra.run.gibba004.stdout:Description: Generic Linux kernel image 2021-03-10T19:57:25.927 INFO:teuthology.orchestra.run.gibba004.stdout: This package will always depend on the latest generic kernel image 2021-03-10T19:57:25.927 INFO:teuthology.orchestra.run.gibba004.stdout: available. 2021-03-10T19:57:25.927 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T19:57:25.928 DEBUG:teuthology.orchestra.run.gibba009:> uname -r 2021-03-10T19:57:25.937 INFO:teuthology.orchestra.run.gibba009.stdout:5.4.0-66-generic 2021-03-10T19:57:25.937 INFO:teuthology.task.kernel:Running kernel on gibba009: 5.4.0-66-generic 2021-03-10T19:57:25.938 DEBUG:teuthology.orchestra.run.gibba009:> sudo apt-get clean 2021-03-10T19:57:26.025 DEBUG:teuthology.orchestra.run.gibba009:> sudo apt-get update 2021-03-10T19:57:26.137 INFO:teuthology.orchestra.run.gibba009.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T19:57:26.243 INFO:teuthology.orchestra.run.gibba009.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T19:57:26.322 INFO:teuthology.orchestra.run.gibba009.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T19:57:26.332 INFO:teuthology.orchestra.run.gibba009.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [200 kB] 2021-03-10T19:57:26.403 INFO:teuthology.orchestra.run.gibba009.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [528 kB] 2021-03-10T19:57:26.433 INFO:teuthology.orchestra.run.gibba009.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [114 kB] 2021-03-10T19:57:26.433 INFO:teuthology.orchestra.run.gibba009.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,264 B] 2021-03-10T19:57:26.433 INFO:teuthology.orchestra.run.gibba009.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T19:57:26.435 INFO:teuthology.orchestra.run.gibba009.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T19:57:26.436 INFO:teuthology.orchestra.run.gibba009.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [546 kB] 2021-03-10T19:57:26.446 INFO:teuthology.orchestra.run.gibba009.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T19:57:26.453 INFO:teuthology.orchestra.run.gibba009.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.8 kB] 2021-03-10T19:57:26.454 INFO:teuthology.orchestra.run.gibba009.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T19:57:26.636 INFO:teuthology.orchestra.run.gibba009.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T19:57:26.759 INFO:teuthology.orchestra.run.gibba009.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T19:57:26.888 INFO:teuthology.orchestra.run.gibba009.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T19:57:27.011 INFO:teuthology.orchestra.run.gibba009.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T19:57:27.028 INFO:teuthology.orchestra.run.gibba009.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T19:57:27.028 INFO:teuthology.orchestra.run.gibba009.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T19:57:27.038 INFO:teuthology.orchestra.run.gibba009.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T19:57:27.039 INFO:teuthology.orchestra.run.gibba009.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T19:57:27.081 INFO:teuthology.orchestra.run.gibba009.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T19:57:27.102 INFO:teuthology.orchestra.run.gibba009.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T19:57:27.107 INFO:teuthology.orchestra.run.gibba009.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T19:57:28.870 INFO:teuthology.orchestra.run.gibba009.stdout:Fetched 5,546 kB in 1s (4,745 kB/s) 2021-03-10T19:57:29.747 INFO:teuthology.orchestra.run.gibba009.stdout:Reading package lists... 2021-03-10T19:57:29.757 DEBUG:teuthology.orchestra.run.gibba009:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T19:57:29.793 INFO:teuthology.orchestra.run.gibba009.stdout:Reading package lists... 2021-03-10T19:57:29.888 INFO:teuthology.orchestra.run.gibba009.stdout:Building dependency tree... 2021-03-10T19:57:29.889 INFO:teuthology.orchestra.run.gibba009.stdout:Reading state information... 2021-03-10T19:57:29.933 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T19:57:29.934 INFO:teuthology.orchestra.run.gibba009.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T19:57:29.934 DEBUG:teuthology.orchestra.run.gibba009:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T19:57:29.970 INFO:teuthology.orchestra.run.gibba009.stdout:Reading package lists... 2021-03-10T19:57:30.061 INFO:teuthology.orchestra.run.gibba009.stdout:Building dependency tree... 2021-03-10T19:57:30.062 INFO:teuthology.orchestra.run.gibba009.stdout:Reading state information... 2021-03-10T19:57:30.147 INFO:teuthology.orchestra.run.gibba009.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T19:57:30.147 INFO:teuthology.orchestra.run.gibba009.stdout:linux-image-generic set to manually installed. 2021-03-10T19:57:30.148 INFO:teuthology.orchestra.run.gibba009.stdout:0 upgraded, 0 newly installed, 0 to remove and 12 not upgraded. 2021-03-10T19:57:30.149 DEBUG:teuthology.orchestra.run.gibba009:> dpkg -s linux-image-generic 2021-03-10T19:57:30.159 INFO:teuthology.orchestra.run.gibba009.stdout:Package: linux-image-generic 2021-03-10T19:57:30.159 INFO:teuthology.orchestra.run.gibba009.stdout:Status: install ok installed 2021-03-10T19:57:30.159 INFO:teuthology.orchestra.run.gibba009.stdout:Priority: optional 2021-03-10T19:57:30.160 INFO:teuthology.orchestra.run.gibba009.stdout:Section: kernel 2021-03-10T19:57:30.160 INFO:teuthology.orchestra.run.gibba009.stdout:Installed-Size: 18 2021-03-10T19:57:30.160 INFO:teuthology.orchestra.run.gibba009.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T19:57:30.160 INFO:teuthology.orchestra.run.gibba009.stdout:Architecture: amd64 2021-03-10T19:57:30.161 INFO:teuthology.orchestra.run.gibba009.stdout:Source: linux-meta 2021-03-10T19:57:30.161 INFO:teuthology.orchestra.run.gibba009.stdout:Version: 5.4.0.66.69 2021-03-10T19:57:30.161 INFO:teuthology.orchestra.run.gibba009.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T19:57:30.161 INFO:teuthology.orchestra.run.gibba009.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T19:57:30.161 INFO:teuthology.orchestra.run.gibba009.stdout:Recommends: thermald 2021-03-10T19:57:30.162 INFO:teuthology.orchestra.run.gibba009.stdout:Description: Generic Linux kernel image 2021-03-10T19:57:30.162 INFO:teuthology.orchestra.run.gibba009.stdout: This package will always depend on the latest generic kernel image 2021-03-10T19:57:30.162 INFO:teuthology.orchestra.run.gibba009.stdout: available. 2021-03-10T19:57:30.162 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T19:57:30.163 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-10T19:57:30.163 DEBUG:teuthology.orchestra.run.gibba004:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T19:57:30.183 INFO:teuthology.orchestra.run.gibba004.stdout:ttyS1 2021-03-10T19:57:30.203 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-10T19:57:30.204 DEBUG:teuthology.orchestra.run.gibba009:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T19:57:30.213 INFO:teuthology.orchestra.run.gibba009.stdout:ttyS1 2021-03-10T19:57:30.257 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-10T19:57:30.265 INFO:teuthology.task.internal:Creating test directory... 2021-03-10T19:57:30.265 DEBUG:teuthology.orchestra.run.gibba004:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T19:57:30.268 DEBUG:teuthology.orchestra.run.gibba009:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T19:57:30.278 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-10T19:57:30.290 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-10T19:57:30.302 INFO:teuthology.task.internal:Creating archive directory... 2021-03-10T19:57:30.303 DEBUG:teuthology.orchestra.run.gibba004:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T19:57:30.316 DEBUG:teuthology.orchestra.run.gibba009:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T19:57:30.330 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-10T19:57:30.339 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-10T19:57:30.340 DEBUG:teuthology.orchestra.run.gibba004:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T19:57:30.346 DEBUG:teuthology.orchestra.run.gibba009:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T19:57:30.356 INFO:teuthology.orchestra.run.gibba004.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:57:30.360 INFO:teuthology.orchestra.run.gibba004.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:57:30.364 INFO:teuthology.orchestra.run.gibba009.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:57:30.367 INFO:teuthology.orchestra.run.gibba009.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:57:30.368 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-10T19:57:30.421 INFO:teuthology.task.internal:Configuring sudo... 2021-03-10T19:57:30.422 DEBUG:teuthology.orchestra.run.gibba004:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T19:57:30.425 DEBUG:teuthology.orchestra.run.gibba009:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T19:57:30.446 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-10T19:57:30.460 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-10T19:57:30.461 DEBUG:teuthology.orchestra.run.gibba004:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T19:57:30.466 DEBUG:teuthology.orchestra.run.gibba009:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T19:57:30.488 DEBUG:teuthology.orchestra.run.gibba004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T19:57:30.523 DEBUG:teuthology.orchestra.run.gibba004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T19:57:30.532 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T19:57:30.532 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T19:57:30.584 DEBUG:teuthology.orchestra.run.gibba009:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T19:57:30.594 DEBUG:teuthology.orchestra.run.gibba009:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T19:57:30.605 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T19:57:30.606 DEBUG:teuthology.orchestra.run.gibba009:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T19:57:30.674 DEBUG:teuthology.orchestra.run.gibba004:> sudo service rsyslog restart 2021-03-10T19:57:30.678 DEBUG:teuthology.orchestra.run.gibba009:> sudo service rsyslog restart 2021-03-10T19:57:30.742 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-10T19:57:30.772 INFO:teuthology.task.internal:Starting timer... 2021-03-10T19:57:30.773 INFO:teuthology.run_tasks:Running task pcp... 2021-03-10T19:57:30.785 INFO:teuthology.run_tasks:Running task selinux... 2021-03-10T19:57:30.802 DEBUG:teuthology.task.selinux:Excluding gibba004: OS 'ubuntu' does not support SELinux 2021-03-10T19:57:30.802 DEBUG:teuthology.task.selinux:Excluding gibba009: OS 'ubuntu' does not support SELinux 2021-03-10T19:57:30.803 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-10T19:57:30.803 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-10T19:57:30.803 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-10T19:57:30.804 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-10T19:57:30.816 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-10T19:57:30.818 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-10T19:57:30.835 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-10T19:57:30.837 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba004.front.sepia.ceph.com,gibba009.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-10T19:57:31.247 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-10T19:57:32.069 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- 2021-03-10T19:57:32.071 INFO:teuthology.task.ansible.out: ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-10T19:57:34.310 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-10T19:57:34.347 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:34 +0000 (0:00:00.059) 0:00:00.059 ******* 2021-03-10T19:57:34.360 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:34 +0000 (0:00:00.013) 0:00:00.072 ******* 2021-03-10T19:57:36.335 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T19:57:36.337 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba004.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba004.front.sepia.ceph.com] 2021-03-10T19:57:36.353 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba009.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba009.front.sepia.ceph.com] 2021-03-10T19:57:36.420 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:36 +0000 (0:00:02.059) 0:00:02.132 ******* 2021-03-10T19:57:36.448 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:36 +0000 (0:00:00.027) 0:00:02.160 ******* 2021-03-10T19:57:36.709 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-10T19:57:36.711 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:57:36.733 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:36 +0000 (0:00:00.285) 0:00:02.445 ******* 2021-03-10T19:57:36.743 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:57:36.788 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:36 +0000 (0:00:00.055) 0:00:02.500 ******* 2021-03-10T19:57:37.497 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-10T19:57:37.499 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T19:57:37.523 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:37 +0000 (0:00:00.734) 0:00:03.234 ******* 2021-03-10T19:57:37.541 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T19:57:37.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:37 +0000 (0:00:00.046) 0:00:03.281 ******* 2021-03-10T19:57:37.893 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-10T19:57:37.895 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.046277", "end": "2021-03-10 19:57:37.939015", "rc": 0, "start": "2021-03-10 19:57:37.892738", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T19:57:37.922 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:37 +0000 (0:00:00.352) 0:00:03.634 ******* 2021-03-10T19:57:37.934 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.045401", "end": "2021-03-10 19:57:38.126258", "rc": 0, "start": "2021-03-10 19:57:38.080857", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T19:57:37.960 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:37 +0000 (0:00:00.038) 0:00:03.672 ******* 2021-03-10T19:57:38.175 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-10T19:57:38.177 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:57:38.200 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:38 +0000 (0:00:00.239) 0:00:03.912 ******* 2021-03-10T19:57:38.223 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:38 +0000 (0:00:00.022) 0:00:03.934 ******* 2021-03-10T19:57:39.019 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-10T19:57:39.020 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406258.2636254-19049-4422412611029/source", "state": "file", "uid": 0} 2021-03-10T19:57:39.044 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:39 +0000 (0:00:00.820) 0:00:04.755 ******* 2021-03-10T19:57:39.052 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406258.233677-19041-182309829809410/source", "state": "file", "uid": 0} 2021-03-10T19:57:39.079 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:39 +0000 (0:00:00.036) 0:00:04.791 ******* 2021-03-10T19:57:39.539 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-10T19:57:39.541 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T19:57:39.542 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T19:57:39.564 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T19:57:39.565 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T19:57:39.655 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-10T19:57:39.659 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-10T19:57:39.838 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:39 +0000 (0:00:00.758) 0:00:05.549 ******* 2021-03-10T19:57:39.865 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:39 +0000 (0:00:00.026) 0:00:05.576 ******* 2021-03-10T19:57:40.546 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba009.front.sepia.ceph.com] 2021-03-10T19:57:40.612 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Wednesday 10 March 2021 19:57:40 +0000 (0:00:00.746) 0:00:06.323 ******* 2021-03-10T19:57:40.625 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] 2021-03-10T19:57:40.687 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:40 +0000 (0:00:00.075) 0:00:06.399 ******* 2021-03-10T19:57:41.051 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T19:57:41.053 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.168804", "end": "2021-03-10 19:57:41.027150", "rc": 0, "start": "2021-03-10 19:57:40.858346", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T19:57:41.076 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.388) 0:00:06.787 ******* 2021-03-10T19:57:41.135 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.152441", "end": "2021-03-10 19:57:41.108331", "rc": 0, "start": "2021-03-10 19:57:40.955890", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T19:57:41.165 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.089) 0:00:06.877 ******* 2021-03-10T19:57:41.194 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T19:57:41.196 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006065", "end": "2021-03-10 19:57:41.237759", "failed_when_result": false, "rc": 0, "start": "2021-03-10 19:57:41.231694", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T19:57:41.223 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.058) 0:00:06.935 ******* 2021-03-10T19:57:41.274 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008981", "end": "2021-03-10 19:57:41.522716", "failed_when_result": false, "rc": 0, "start": "2021-03-10 19:57:41.513735", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T19:57:41.300 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.077) 0:00:07.012 ******* 2021-03-10T19:57:41.309 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T19:57:41.310 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.343 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.042) 0:00:07.055 ******* 2021-03-10T19:57:41.373 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.401 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.058) 0:00:07.113 ******* 2021-03-10T19:57:41.421 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T19:57:41.422 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.448 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.047) 0:00:07.160 ******* 2021-03-10T19:57:41.479 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.505 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.056) 0:00:07.216 ******* 2021-03-10T19:57:41.522 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T19:57:41.524 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.055) 0:00:07.272 ******* 2021-03-10T19:57:41.579 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.047) 0:00:07.320 ******* 2021-03-10T19:57:41.646 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T19:57:41.650 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.671 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.062) 0:00:07.383 ******* 2021-03-10T19:57:41.688 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.719 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.047) 0:00:07.430 ******* 2021-03-10T19:57:41.759 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.065) 0:00:07.496 ******* 2021-03-10T19:57:41.802 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:41.804 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:41.835 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.050) 0:00:07.546 ******* 2021-03-10T19:57:41.958 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:57:41.986 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:41 +0000 (0:00:00.151) 0:00:07.698 ******* 2021-03-10T19:57:42.005 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:57:42.033 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:42 +0000 (0:00:00.046) 0:00:07.745 ******* 2021-03-10T19:57:42.187 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T19:57:42.188 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T19:57:42.219 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T19:57:42.284 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T19:57:42.327 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T19:57:42.422 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T19:57:42.423 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T19:57:42.528 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T19:57:42.540 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T19:57:42.658 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T19:57:42.691 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T19:57:42.756 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T19:57:42.789 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T19:57:42.859 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T19:57:42.893 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T19:57:42.958 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T19:57:42.959 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:42.992 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T19:57:42.994 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:43.069 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T19:57:43.081 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T19:57:43.082 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:43.168 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T19:57:43.179 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T19:57:43.265 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T19:57:43.276 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T19:57:43.372 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T19:57:43.373 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T19:57:43.469 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T19:57:43.470 INFO:teuthology.task.ansible.out: ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T19:57:43.567 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T19:57:43.579 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T19:57:43.676 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T19:57:43.687 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T19:57:43.773 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T19:57:43.797 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T19:57:43.882 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T19:57:43.893 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T19:57:43.979 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T19:57:43.991 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T19:57:44.088 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T19:57:44.101 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T19:57:44.187 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T19:57:44.189 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T19:57:44.284 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T19:57:44.285 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T19:57:44.381 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T19:57:44.382 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T19:57:44.477 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T19:57:44.479 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T19:57:44.575 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T19:57:44.576 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T19:57:44.674 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T19:57:44.685 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T19:57:44.781 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T19:57:44.782 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T19:57:44.887 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T19:57:44.888 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T19:57:44.973 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T19:57:44.985 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T19:57:45.070 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T19:57:45.082 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T19:57:45.167 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T19:57:45.178 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T19:57:45.264 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T19:57:45.286 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T19:57:45.361 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T19:57:45.384 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T19:57:45.461 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T19:57:45.483 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T19:57:45.551 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T19:57:45.574 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T19:57:45.659 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T19:57:45.671 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T19:57:45.757 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T19:57:45.768 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T19:57:45.853 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T19:57:45.865 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T19:57:45.960 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T19:57:45.972 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T19:57:46.057 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:57:46.058 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:57:46.164 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T19:57:46.165 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T19:57:46.253 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T19:57:46.255 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T19:57:46.350 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T19:57:46.362 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T19:57:46.459 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T19:57:46.471 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T19:57:46.545 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T19:57:46.568 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T19:57:46.656 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T19:57:46.689 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T19:57:46.691 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:46.754 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T19:57:46.786 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T19:57:46.860 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:57:46.883 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:57:46.958 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T19:57:46.990 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T19:57:47.055 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T19:57:47.077 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T19:57:47.150 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T19:57:47.173 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T19:57:47.259 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T19:57:47.271 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T19:57:47.367 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T19:57:47.369 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T19:57:47.463 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T19:57:47.475 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T19:57:47.560 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T19:57:47.572 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T19:57:47.656 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T19:57:47.670 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T19:57:47.755 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T19:57:47.767 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T19:57:47.842 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T19:57:47.865 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T19:57:47.950 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T19:57:47.962 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T19:57:48.046 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T19:57:48.058 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T19:57:48.143 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T19:57:48.165 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T19:57:48.250 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T19:57:48.261 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T19:57:48.346 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T19:57:48.369 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T19:57:48.443 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T19:57:48.466 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T19:57:48.551 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:57:48.563 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:57:48.658 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T19:57:48.681 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T19:57:48.755 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T19:57:48.811 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T19:57:48.857 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T19:57:48.953 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T19:57:48.977 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T19:57:49.052 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T19:57:49.084 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T19:57:49.179 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T19:57:49.191 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T19:57:49.276 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T19:57:49.277 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:49.288 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T19:57:49.373 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T19:57:49.385 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T19:57:49.470 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T19:57:49.471 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T19:57:49.581 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T19:57:49.582 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T19:57:49.682 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T19:57:49.694 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T19:57:49.789 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T19:57:49.790 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T19:57:49.887 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T19:57:49.898 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T19:57:49.994 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T19:57:49.996 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T19:57:50.092 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T19:57:50.094 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T19:57:50.179 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T19:57:50.191 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T19:57:50.288 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T19:57:50.293 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T19:57:50.406 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T19:57:50.407 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T19:57:50.493 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T19:57:50.526 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T19:57:50.600 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T19:57:50.602 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:50.644 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T19:57:50.722 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T19:57:50.745 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T19:57:50.829 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T19:57:50.851 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T19:57:50.947 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T19:57:50.948 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T19:57:51.044 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T19:57:51.076 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T19:57:51.154 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T19:57:51.177 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T19:57:51.253 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T19:57:51.285 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T19:57:51.350 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T19:57:51.384 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T19:57:51.448 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T19:57:51.482 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T19:57:51.556 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T19:57:51.568 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T19:57:51.653 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T19:57:51.666 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T19:57:51.763 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T19:57:51.764 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T19:57:51.859 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T19:57:51.860 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T19:57:51.966 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T19:57:51.967 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T19:57:52.072 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T19:57:52.074 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T19:57:52.171 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T19:57:52.172 INFO:teuthology.task.ansible.out: ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T19:57:52.268 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T19:57:52.269 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T19:57:52.364 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T19:57:52.366 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T19:57:52.453 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T19:57:52.455 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:52.465 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:57:52.564 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:57:52.565 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T19:57:52.665 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T19:57:52.665 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T19:57:52.763 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T19:57:52.775 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T19:57:52.864 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T19:57:52.877 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T19:57:52.969 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T19:57:52.975 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T19:57:53.072 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T19:57:53.074 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:53.097 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T19:57:53.183 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T19:57:53.226 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T19:57:53.312 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T19:57:53.334 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T19:57:53.399 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T19:57:53.423 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T19:57:53.514 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T19:57:53.525 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T19:57:53.600 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T19:57:53.622 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T19:57:53.700 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T19:57:53.726 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T19:57:53.826 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T19:57:53.827 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T19:57:53.925 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T19:57:53.936 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T19:57:53.938 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:54.032 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T19:57:54.044 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T19:57:54.140 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T19:57:54.152 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T19:57:54.237 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T19:57:54.291 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T19:57:54.334 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T19:57:54.421 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T19:57:54.422 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T19:57:54.521 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T19:57:54.530 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T19:57:54.625 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T19:57:54.637 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T19:57:54.728 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T19:57:54.762 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T19:57:54.826 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T19:57:54.859 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T19:57:54.924 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T19:57:54.967 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T19:57:55.063 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T19:57:55.159 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T19:57:55.171 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T19:57:55.268 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T19:57:55.280 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T19:57:55.378 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T19:57:55.390 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T19:57:55.485 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T19:57:55.497 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T19:57:55.645 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T19:57:55.751 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T19:57:55.763 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T19:57:55.848 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T19:57:55.849 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T19:57:55.944 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T19:57:55.957 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T19:57:56.041 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T19:57:56.074 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T19:57:56.141 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T19:57:56.163 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T19:57:56.248 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T19:57:56.271 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T19:57:56.345 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T19:57:56.378 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T19:57:56.454 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T19:57:56.563 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T19:57:56.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:56 +0000 (0:00:14.554) 0:00:22.299 ******* 2021-03-10T19:57:56.639 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T19:57:56.651 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T19:57:56.679 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:56 +0000 (0:00:00.087) 0:00:22.386 ******* 2021-03-10T19:57:56.729 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T19:57:56.731 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T19:57:56.991 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T19:57:56.993 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T19:57:56.994 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T19:57:56.996 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T19:57:56.998 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T19:57:56.999 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T19:57:57.001 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T19:57:57.003 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4 2021-03-10T19:57:57.003 INFO:teuthology.task.ansible.out:fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T19:57:57.005 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T19:57:57.006 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T19:57:57.008 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T19:57:57.010 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@ 2021-03-10T19:57:57.010 INFO:teuthology.task.ansible.out:minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T19:57:57.013 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T19:57:57.015 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T19:57:57.037 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:57 +0000 (0:00:00.363) 0:00:22.749 ******* 2021-03-10T19:57:57.058 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:57 +0000 (0:00:00.020) 0:00:22.770 ******* 2021-03-10T19:57:57.143 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T19:57:57.183 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:57 +0000 (0:00:00.123) 0:00:22.894 ******* 2021-03-10T19:57:57.267 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T19:57:57.268 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T19:57:57.270 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T19:57:57.272 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T19:57:57.274 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T19:57:57.275 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T19:57:57.277 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T19:57:57.278 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4 2021-03-10T19:57:57.279 INFO:teuthology.task.ansible.out:fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T19:57:57.280 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T19:57:57.282 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T19:57:57.284 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T19:57:57.285 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T19:57:57.287 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T19:57:57.289 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe 2021-03-10T19:57:57.289 INFO:teuthology.task.ansible.out:16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T19:57:57.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:57 +0000 (0:00:00.136) 0:00:23.030 ******* 2021-03-10T19:57:57.870 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:57.872 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* ok: [gibba004.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T19:57:57.900 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:57 +0000 (0:00:00.582) 0:00:23.612 ******* 2021-03-10T19:57:58.038 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T19:57:58.065 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:58 +0000 (0:00:00.161) 0:00:23.774 ******* 2021-03-10T19:57:58.170 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:57:58.172 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T19:57:58.259 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T19:57:58.282 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T19:57:58.366 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T19:57:58.388 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T19:57:58.464 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T19:57:58.466 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T19:57:58.517 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T19:57:58.570 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T19:57:58.634 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T19:57:58.636 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T19:57:58.677 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T19:57:58.679 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T19:57:58.762 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T19:57:58.784 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T19:57:58.887 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T19:57:58.891 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T19:57:58.892 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T19:57:58.974 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T19:57:58.985 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:58.996 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T19:57:59.092 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T19:57:59.093 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T19:57:59.125 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T19:57:59.209 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T19:57:59.211 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:59.221 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:59.243 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T19:57:59.254 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:59.317 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T19:57:59.381 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T19:57:59.383 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T19:57:59.414 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T19:57:59.416 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T19:57:59.500 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T19:57:59.502 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-03-10T19:57:59.511 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:59.513 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:59.523 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T19:57:59.608 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T19:57:59.610 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T19:57:59.640 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T19:57:59.704 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T19:57:59.768 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T19:57:59.770 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T19:57:59.811 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T19:57:59.896 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T19:57:59.898 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:59.918 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T19:57:59.993 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T19:57:59.994 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T19:58:00.025 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T19:58:00.027 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T19:58:00.089 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T19:58:00.091 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T19:58:00.122 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T19:58:00.196 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T19:58:00.219 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T19:58:00.303 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T19:58:00.304 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:00.315 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T19:58:00.434 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T19:58:00.436 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T19:58:00.445 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T19:58:00.447 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T19:58:00.561 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T19:58:00.626 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T19:58:00.628 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T19:58:00.657 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T19:58:00.756 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T19:58:00.854 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T19:58:00.856 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T19:58:00.963 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T19:58:01.058 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T19:58:01.069 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T19:58:01.071 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T19:58:01.164 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T19:58:01.166 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJ 2021-03-10T19:58:01.167 INFO:teuthology.task.ansible.out:nu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T19:58:01.261 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T19:58:01.273 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T19:58:01.368 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T19:58:01.400 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T19:58:01.464 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T19:58:01.496 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T19:58:01.562 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T19:58:01.595 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T19:58:01.648 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T19:58:01.691 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T19:58:01.744 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:58:01.787 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T19:58:01.789 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T19:58:01.852 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T19:58:01.884 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T19:58:01.947 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T19:58:01.991 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T19:58:02.044 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T19:58:02.046 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T19:58:02.088 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T19:58:02.141 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T19:58:02.143 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T19:58:02.204 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T19:58:02.247 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T19:58:02.301 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T19:58:02.344 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T19:58:02.408 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T19:58:02.461 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T19:58:02.557 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:58:02.559 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T19:58:02.560 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:58:02.659 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T19:58:02.670 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T19:58:02.672 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T19:58:02.674 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T19:58:02.760 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T19:58:02.771 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T19:58:02.858 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T19:58:02.859 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T19:58:02.869 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T19:58:02.965 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T19:58:02.966 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T19:58:02.976 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T19:58:03.063 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T19:58:03.106 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T19:58:03.173 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T19:58:03.218 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T19:58:03.287 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T19:58:03.342 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T19:58:03.344 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T19:58:03.396 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T19:58:03.398 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:58:03.461 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T19:58:03.505 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T19:58:03.507 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T19:58:03.509 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T19:58:03.581 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T19:58:03.623 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T19:58:03.708 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T19:58:03.710 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T19:58:03.765 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T19:58:03.845 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T19:58:03.902 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T19:58:04.001 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T19:58:04.023 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T19:58:04.105 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T19:58:04.109 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T19:58:04.137 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T19:58:04.243 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T19:58:04.245 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T19:58:04.265 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T19:58:04.329 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T19:58:04.373 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T19:58:04.426 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T19:58:04.489 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T19:58:04.532 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T19:58:04.533 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T19:58:04.585 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:58:04.627 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T19:58:04.683 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T19:58:04.735 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T19:58:04.789 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T19:58:04.832 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T19:58:04.834 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T19:58:04.896 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T19:58:04.939 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T19:58:05.003 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T19:58:05.046 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T19:58:05.121 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T19:58:05.153 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T19:58:05.239 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T19:58:05.262 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:58:05.337 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T19:58:05.382 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T19:58:05.510 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T19:58:05.532 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T19:58:05.621 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T19:58:05.654 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T19:58:05.761 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T19:58:05.806 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T19:58:05.907 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T19:58:05.934 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T19:58:06.068 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T19:58:06.090 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T19:58:06.196 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T19:58:06.208 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T19:58:06.325 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T19:58:06.369 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T19:58:06.502 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T19:58:06.535 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T19:58:06.633 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T19:58:06.657 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T19:58:06.733 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T19:58:06.735 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T19:58:06.756 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T19:58:06.855 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T19:58:06.898 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T19:58:06.951 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T19:58:07.015 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T19:58:07.100 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T19:58:07.143 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T19:58:07.218 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T19:58:07.271 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T19:58:07.315 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T19:58:07.317 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T19:58:07.390 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T19:58:07.443 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T19:58:07.445 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T19:58:07.503 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T19:58:07.505 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T19:58:07.562 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T19:58:07.627 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T19:58:07.680 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T19:58:07.734 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T19:58:07.787 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T19:58:07.830 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T19:58:07.894 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T19:58:07.939 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T19:58:07.993 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T19:58:08.047 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T19:58:08.049 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T19:58:08.132 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T19:58:08.158 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T19:58:08.160 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T19:58:08.232 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T19:58:08.276 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T19:58:08.352 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T19:58:08.354 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T19:58:08.385 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T19:58:08.470 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T19:58:08.493 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T19:58:08.599 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T19:58:08.621 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T19:58:08.706 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T19:58:08.718 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T19:58:08.825 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T19:58:08.839 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T19:58:08.956 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T19:58:09.051 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T19:58:09.095 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T19:58:09.097 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T19:58:09.142 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T19:58:09.207 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T19:58:09.249 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T19:58:09.251 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:58:09.313 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T19:58:09.418 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T19:58:09.420 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T19:58:09.567 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T19:58:09.568 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T19:58:09.694 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T19:58:09.696 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T19:58:09.816 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T19:58:09.849 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T19:58:09.935 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T19:58:09.937 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:58:09.978 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T19:58:10.031 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T19:58:10.097 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T19:58:10.152 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T19:58:10.205 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T19:58:10.259 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T19:58:10.312 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T19:58:10.355 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T19:58:10.431 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T19:58:10.474 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T19:58:10.528 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T19:58:10.582 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T19:58:10.635 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T19:58:10.709 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T19:58:10.731 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T19:58:10.838 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T19:58:10.849 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T19:58:10.945 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T19:58:10.947 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:10.957 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T19:58:11.056 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T19:58:11.067 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T19:58:11.174 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T19:58:11.196 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T19:58:11.270 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T19:58:11.302 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T19:58:11.366 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T19:58:11.430 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T19:58:11.483 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T19:58:11.485 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T19:58:11.589 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T19:58:11.601 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T19:58:11.686 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T19:58:11.708 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T19:58:11.803 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T19:58:11.814 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T19:58:11.889 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T19:58:11.901 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T19:58:12.007 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T19:58:12.018 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T19:58:12.103 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T19:58:12.135 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T19:58:12.137 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T19:58:12.210 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T19:58:12.232 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T19:58:12.317 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T19:58:12.340 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T19:58:12.424 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T19:58:12.457 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T19:58:12.542 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T19:58:12.563 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T19:58:12.659 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T19:58:12.670 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T19:58:12.771 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T19:58:12.772 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T19:58:12.881 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T19:58:12.892 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T19:58:12.988 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T19:58:12.999 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T19:58:13.105 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T19:58:13.138 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T19:58:13.215 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T19:58:13.279 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T19:58:13.311 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "k 2021-03-10T19:58:13.313 INFO:teuthology.task.ansible.out:ey_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T19:58:13.377 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T19:58:13.412 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T19:58:13.488 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T19:58:13.515 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:13 +0000 (0:00:15.449) 0:00:39.224 ******* 2021-03-10T19:58:13.586 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T19:58:13.597 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:58:13.599 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.609 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.610 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.620 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.631 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.642 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.645 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.654 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.665 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.677 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T19:58:13.772 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:58:13.774 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T19:58:13.784 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.786 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:13.893 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T19:58:13.905 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:58:13.907 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T19:58:14.016 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T19:58:14.029 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.042 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:58:14.044 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "k 2021-03-10T19:58:14.046 INFO:teuthology.task.ansible.out:ey_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.060 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.072 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.083 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.095 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.106 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.122 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.145 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.146 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.158 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:58:14.159 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:58:14.160 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.160 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD 2021-03-10T19:58:14.163 INFO:teuthology.task.ansible.out:2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.189 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:58:14.229 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:58:14.231 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4 2021-03-10T19:58:14.232 INFO:teuthology.task.ansible.out:b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.233 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.233 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_l 2021-03-10T19:58:14.235 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:14 +0000 (0:00:00.745) 0:00:39.969 ******* 2021-03-10T19:58:14.265 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.267 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.268 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.283 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.285 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.295 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.296 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.307 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.318 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.330 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.341 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.343 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.363 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.365 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.375 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.377 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7Oo 2021-03-10T19:58:14.379 INFO:teuthology.task.ansible.out:AdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.389 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.390 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.401 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.403 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.403 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.404 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.406 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:14.408 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.418 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.420 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.430 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.432 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.441 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.453 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.464 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.466 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.475 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.477 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.487 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.498 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.500 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.509 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.511 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.521 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.532 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.534 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T19:58:14.544 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.546 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.556 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.558 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.569 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.580 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.591 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.593 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.602 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.604 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.615 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.626 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.627 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.637 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.639 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.649 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.650 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.663 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T19:58:14.665 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.678 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.687 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.690 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.700 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.701 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.712 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.727 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.730 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.739 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.744 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.751 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.762 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T19:58:14.764 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.775 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.777 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansi 2021-03-10T19:58:14.780 INFO:teuthology.task.ansible.out:ble_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.789 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.800 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.802 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.812 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.814 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.824 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.825 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.836 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.838 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.849 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.851 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.861 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.863 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.873 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.875 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.885 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.887 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.897 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.899 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.911 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.911 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.912 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.913 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.925 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.927 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.933 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.942 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.944 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.987 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.989 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:14.990 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vas 2021-03-10T19:58:14.991 INFO:teuthology.task.ansible.out:u@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:15 +0000 (0:00:00.758) 0:00:40.728 ******* 2021-03-10T19:58:15.025 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.027 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.029 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.041 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.043 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.052 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.054 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.064 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.066 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.081 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.082 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.093 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.095 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.105 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.107 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.131 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:15 +0000 (0:00:00.114) 0:00:40.842 ******* 2021-03-10T19:58:15.138 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:58:15.139 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.139 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:15.141 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.142 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.142 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSC 2021-03-10T19:58:15.144 INFO:teuthology.task.ansible.out:INdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.153 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.155 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.165 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.168 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:15.169 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.180 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.182 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.191 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.193 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.203 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.214 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.216 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.226 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.228 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.238 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.239 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.250 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.252 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.262 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.264 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.274 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.275 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.286 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.297 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.299 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.308 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.320 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.321 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:15.323 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [gibba004.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.334 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.345 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.356 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.358 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.367 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.378 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.381 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.390 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.401 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.403 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.413 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.415 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba004.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.426 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.428 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.438 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.449 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.451 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.461 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.463 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.473 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.484 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.495 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.506 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.508 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba004.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.519 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.530 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.532 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.542 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.543 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.557 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.564 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.576 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.587 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.598 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.600 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba004.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T19:58:15.602 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.613 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.624 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.626 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.635 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.647 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.648 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.658 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.669 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.681 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.683 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.710 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:58:15.712 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T19:58:15.734 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:15 +0000 (0:00:00.603) 0:00:41.446 ******* 2021-03-10T19:58:15.786 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T19:58:15.808 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:15.830 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:15 +0000 (0:00:00.096) 0:00:41.542 ******* 2021-03-10T19:58:15.870 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:58:15.872 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T19:58:15.981 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T19:58:16.014 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T19:58:16.079 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T19:58:16.101 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T19:58:16.176 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T19:58:16.199 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T19:58:16.274 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T19:58:16.285 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T19:58:16.372 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T19:58:16.394 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T19:58:16.489 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T19:58:16.500 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T19:58:16.576 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T19:58:16.610 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T19:58:16.612 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:16.691 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T19:58:16.702 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T19:58:16.704 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:16.797 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T19:58:16.809 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T19:58:16.896 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T19:58:16.917 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T19:58:17.007 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T19:58:17.029 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T19:58:17.104 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T19:58:17.115 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T19:58:17.186 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T19:58:17.208 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T19:58:17.295 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T19:58:17.308 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T19:58:17.423 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T19:58:17.425 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T19:58:17.509 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T19:58:17.532 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T19:58:17.618 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T19:58:17.620 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:17.630 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T19:58:17.736 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T19:58:17.748 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T19:58:17.749 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:17.835 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T19:58:17.878 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T19:58:17.965 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T19:58:17.976 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T19:58:18.071 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T19:58:18.083 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T19:58:18.157 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T19:58:18.179 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T19:58:18.264 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T19:58:18.297 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T19:58:18.360 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T19:58:18.403 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T19:58:18.493 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T19:58:18.536 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T19:58:18.611 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T19:58:18.644 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T19:58:18.751 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T19:58:18.782 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T19:58:18.869 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T19:58:18.881 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T19:58:18.882 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:18.968 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T19:58:19.000 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T19:58:19.053 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T19:58:19.087 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T19:58:19.147 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T19:58:19.222 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T19:58:19.275 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T19:58:19.340 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T19:58:19.383 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T19:58:19.425 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T19:58:19.479 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T19:58:19.532 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T19:58:19.565 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T19:58:19.676 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T19:58:19.701 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T19:58:19.762 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T19:58:19.795 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T19:58:19.868 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T19:58:19.880 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T19:58:19.954 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T19:58:19.976 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T19:58:20.050 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T19:58:20.064 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T19:58:20.066 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:20.150 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T19:58:20.172 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T19:58:20.238 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T19:58:20.260 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T19:58:20.337 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T19:58:20.376 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T19:58:20.401 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:20 +0000 (0:00:04.570) 0:00:46.113 ******* 2021-03-10T19:58:20.463 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T19:58:20.559 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T19:58:20.655 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T19:58:20.729 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406300.5019794-28623-131888216482506/source", "state": "file", "uid": 0} 2021-03-10T19:58:20.753 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:20 +0000 (0:00:00.352) 0:00:46.465 ******* 2021-03-10T19:58:20.770 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:58:20.772 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T19:58:20.823 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T19:58:20.825 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => { "msg": "Host gibba004.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T19:58:20.846 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:20 +0000 (0:00:00.093) 0:00:46.558 ******* 2021-03-10T19:58:20.864 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:58:20.870 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T19:58:20.928 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T19:58:20.930 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T19:58:20.953 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:20 +0000 (0:00:00.106) 0:00:46.665 ******* 2021-03-10T19:58:20.962 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:58:20.964 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T19:58:21.009 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.055) 0:00:46.721 ******* 2021-03-10T19:58:21.026 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T19:58:21.028 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.052 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.042) 0:00:46.764 ******* 2021-03-10T19:58:21.122 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.146 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.093) 0:00:46.858 ******* 2021-03-10T19:58:21.215 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.241 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.094) 0:00:46.953 ******* 2021-03-10T19:58:21.322 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.346 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.105) 0:00:47.058 ******* 2021-03-10T19:58:21.364 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T19:58:21.370 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406301.1002882-28722-255605025813181/source", "state": "file", "uid": 0} 2021-03-10T19:58:21.398 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.051) 0:00:47.110 ******* 2021-03-10T19:58:21.447 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T19:58:21.459 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.472 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.074) 0:00:47.184 ******* 2021-03-10T19:58:21.482 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T19:58:21.484 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => { "msg": "Host gibba009.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T19:58:21.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.040) 0:00:47.225 ******* 2021-03-10T19:58:21.542 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T19:58:21.544 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.573 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.060) 0:00:47.285 ******* 2021-03-10T19:58:21.603 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T19:58:21.605 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T19:58:21.629 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.055) 0:00:47.341 ******* 2021-03-10T19:58:21.657 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.682 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.053) 0:00:47.394 ******* 2021-03-10T19:58:21.700 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T19:58:21.702 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.732 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.050) 0:00:47.444 ******* 2021-03-10T19:58:21.775 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.074) 0:00:47.518 ******* 2021-03-10T19:58:21.815 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T19:58:21.817 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.053) 0:00:47.572 ******* 2021-03-10T19:58:21.887 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T19:58:21.889 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:21.914 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.054) 0:00:47.626 ******* 2021-03-10T19:58:21.954 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T19:58:21.956 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:21.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:21 +0000 (0:00:00.065) 0:00:47.692 ******* 2021-03-10T19:58:22.009 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T19:58:22.012 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.036 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.055) 0:00:47.748 ******* 2021-03-10T19:58:22.085 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T19:58:22.088 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.117 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.081) 0:00:47.829 ******* 2021-03-10T19:58:22.124 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T19:58:22.126 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.154 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.037) 0:00:47.866 ******* 2021-03-10T19:58:22.227 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:22.252 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.097) 0:00:47.964 ******* 2021-03-10T19:58:22.294 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.041) 0:00:48.006 ******* 2021-03-10T19:58:22.337 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T19:58:22.339 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.375 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.081) 0:00:48.087 ******* 2021-03-10T19:58:22.377 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:22.385 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T19:58:22.387 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.413 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.038) 0:00:48.125 ******* 2021-03-10T19:58:22.452 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T19:58:22.454 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:22.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.063) 0:00:48.188 ******* 2021-03-10T19:58:22.494 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T19:58:22.496 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.521 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.044) 0:00:48.233 ******* 2021-03-10T19:58:22.551 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T19:58:22.553 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.062) 0:00:48.295 ******* 2021-03-10T19:58:22.602 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.627 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.043) 0:00:48.339 ******* 2021-03-10T19:58:22.628 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:22.658 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T19:58:22.660 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.695 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.068) 0:00:48.407 ******* 2021-03-10T19:58:22.727 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T19:58:22.729 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:22.739 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:22.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.069) 0:00:48.476 ******* 2021-03-10T19:58:22.782 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T19:58:22.783 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.813 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.049) 0:00:48.525 ******* 2021-03-10T19:58:22.848 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T19:58:22.849 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.874 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.060) 0:00:48.586 ******* 2021-03-10T19:58:22.904 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T19:58:22.906 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:22.931 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:22 +0000 (0:00:00.057) 0:00:48.643 ******* 2021-03-10T19:58:22.981 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T19:58:22.983 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.091) 0:00:48.734 ******* 2021-03-10T19:58:23.029 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T19:58:23.030 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:23.071 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.048) 0:00:48.783 ******* 2021-03-10T19:58:23.110 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T19:58:23.112 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:23.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.070) 0:00:48.854 ******* 2021-03-10T19:58:23.163 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:58:23.165 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.198 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.056) 0:00:48.910 ******* 2021-03-10T19:58:23.222 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.051) 0:00:48.961 ******* 2021-03-10T19:58:23.282 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.305 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.055) 0:00:49.017 ******* 2021-03-10T19:58:23.322 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T19:58:23.324 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:23.351 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.045) 0:00:49.062 ******* 2021-03-10T19:58:23.390 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T19:58:23.392 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.417 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.066) 0:00:49.129 ******* 2021-03-10T19:58:23.434 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T19:58:23.436 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.461 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.043) 0:00:49.173 ******* 2021-03-10T19:58:23.499 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T19:58:23.501 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.527 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.065) 0:00:49.238 ******* 2021-03-10T19:58:23.544 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T19:58:23.546 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.572 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.044) 0:00:49.283 ******* 2021-03-10T19:58:23.601 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T19:58:23.603 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.630 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.058) 0:00:49.342 ******* 2021-03-10T19:58:23.647 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T19:58:23.649 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.673 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.043) 0:00:49.385 ******* 2021-03-10T19:58:23.702 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T19:58:23.704 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.728 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.054) 0:00:49.440 ******* 2021-03-10T19:58:23.745 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T19:58:23.747 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.772 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.044) 0:00:49.484 ******* 2021-03-10T19:58:23.801 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T19:58:23.803 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:23.831 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.059) 0:00:49.543 ******* 2021-03-10T19:58:23.834 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:23.862 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T19:58:23.863 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:23.888 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.056) 0:00:49.600 ******* 2021-03-10T19:58:23.905 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T19:58:23.907 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.931 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.042) 0:00:49.642 ******* 2021-03-10T19:58:23.958 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:58:23.960 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:23.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:23 +0000 (0:00:00.053) 0:00:49.696 ******* 2021-03-10T19:58:24.002 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T19:58:24.003 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.032 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.047) 0:00:49.744 ******* 2021-03-10T19:58:24.060 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T19:58:24.061 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.084 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.051) 0:00:49.796 ******* 2021-03-10T19:58:24.111 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.054) 0:00:49.851 ******* 2021-03-10T19:58:24.157 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T19:58:24.159 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.182 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.043) 0:00:49.894 ******* 2021-03-10T19:58:24.211 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.222 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.066) 0:00:49.961 ******* 2021-03-10T19:58:24.269 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T19:58:24.271 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.307 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.057) 0:00:50.019 ******* 2021-03-10T19:58:24.334 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T19:58:24.336 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.360 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.053) 0:00:50.072 ******* 2021-03-10T19:58:24.377 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T19:58:24.379 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.406 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.046) 0:00:50.118 ******* 2021-03-10T19:58:24.434 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:58:24.436 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.459 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.052) 0:00:50.171 ******* 2021-03-10T19:58:24.476 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T19:58:24.478 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.501 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.042) 0:00:50.213 ******* 2021-03-10T19:58:24.583 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T19:58:24.585 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:24.607 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.105) 0:00:50.319 ******* 2021-03-10T19:58:24.626 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T19:58:24.628 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008410", "end": "2021-03-10 19:58:24.867243", "rc": 0, "start": "2021-03-10 19:58:24.858833", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T19:58:24.657 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.049) 0:00:50.368 ******* 2021-03-10T19:58:24.685 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.053) 0:00:50.422 ******* 2021-03-10T19:58:24.712 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:24.738 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T19:58:24.740 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.763 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.052) 0:00:50.474 ******* 2021-03-10T19:58:24.779 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T19:58:24.781 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.813 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.050) 0:00:50.525 ******* 2021-03-10T19:58:24.852 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T19:58:24.853 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.879 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.065) 0:00:50.591 ******* 2021-03-10T19:58:24.885 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T19:58:24.887 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:24.916 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:24 +0000 (0:00:00.037) 0:00:50.628 ******* 2021-03-10T19:58:24.996 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T19:58:24.998 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.106) 0:00:50.734 ******* 2021-03-10T19:58:25.113 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T19:58:25.114 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.137 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.114) 0:00:50.849 ******* 2021-03-10T19:58:25.218 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:58:25.219 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.241 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.103) 0:00:50.953 ******* 2021-03-10T19:58:25.415 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T19:58:25.416 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008082", "end": "2021-03-10 19:58:25.458370", "rc": 0, "start": "2021-03-10 19:58:25.450288", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T19:58:25.440 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.198) 0:00:51.151 ******* 2021-03-10T19:58:25.479 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:58:25.481 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.512 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T19:58:25.514 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.537 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.096) 0:00:51.248 ******* 2021-03-10T19:58:25.606 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:58:25.607 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.609 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T19:58:25.611 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.634 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.098) 0:00:51.346 ******* 2021-03-10T19:58:25.738 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:58:25.740 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.846 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.868 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.261) 0:00:51.608 ******* 2021-03-10T19:58:25.965 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:25.967 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [gibba009.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:25.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:25 +0000 (0:00:00.093) 0:00:51.701 ******* 2021-03-10T19:58:26.069 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T19:58:26.071 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.102 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.112) 0:00:51.814 ******* 2021-03-10T19:58:26.110 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:58:26.113 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:26.175 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T19:58:26.177 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.199 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.096) 0:00:51.911 ******* 2021-03-10T19:58:26.227 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:58:26.229 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:58:26.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.057) 0:00:51.968 ******* 2021-03-10T19:58:26.276 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T19:58:26.278 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.310 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.053) 0:00:52.022 ******* 2021-03-10T19:58:26.338 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T19:58:26.339 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.053) 0:00:52.075 ******* 2021-03-10T19:58:26.394 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T19:58:26.394 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.056) 0:00:52.131 ******* 2021-03-10T19:58:26.439 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.466 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.046) 0:00:52.177 ******* 2021-03-10T19:58:26.540 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:26.542 INFO:teuthology.task.ansible.out:TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.567 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.101) 0:00:52.278 ******* 2021-03-10T19:58:26.637 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T19:58:26.639 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.095) 0:00:52.374 ******* 2021-03-10T19:58:26.745 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T19:58:26.747 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:26.769 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:26 +0000 (0:00:00.106) 0:00:52.481 ******* 2021-03-10T19:58:27.252 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T19:58:27.253 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.732991", "end": "2021-03-10 19:58:27.500897", "rc": 0, "start": "2021-03-10 19:58:26.767906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:27.277 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.508) 0:00:52.989 ******* 2021-03-10T19:58:27.357 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T19:58:27.359 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:27.388 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.110) 0:00:53.100 ******* 2021-03-10T19:58:27.447 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T19:58:27.448 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.582188", "end": "2021-03-10 19:58:27.500919", "rc": 0, "start": "2021-03-10 19:58:26.918731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:27.472 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.083) 0:00:53.183 ******* 2021-03-10T19:58:27.542 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T19:58:27.544 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007678", "end": "2021-03-10 19:58:27.791246", "rc": 0, "start": "2021-03-10 19:58:27.783568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:27.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.096) 0:00:53.280 ******* 2021-03-10T19:58:27.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.023) 0:00:53.304 ******* 2021-03-10T19:58:27.745 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T19:58:27.747 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007687", "end": "2021-03-10 19:58:27.796009", "rc": 0, "start": "2021-03-10 19:58:27.788322", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:27.770 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:27 +0000 (0:00:00.177) 0:00:53.481 ******* 2021-03-10T19:58:29.424 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T19:58:29.426 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:29.454 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:29 +0000 (0:00:01.684) 0:00:55.166 ******* 2021-03-10T19:58:29.464 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:29.495 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:29 +0000 (0:00:00.040) 0:00:55.207 ******* 2021-03-10T19:58:29.963 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T19:58:29.964 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:30.002 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:29 +0000 (0:00:00.506) 0:00:55.714 ******* 2021-03-10T19:58:30.013 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:30.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:30 +0000 (0:00:00.042) 0:00:55.757 ******* 2021-03-10T19:58:30.083 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T19:58:30.085 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:30.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:30 +0000 (0:00:00.063) 0:00:55.821 ******* 2021-03-10T19:58:30.116 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:30.144 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:30 +0000 (0:00:00.034) 0:00:55.856 ******* 2021-03-10T19:58:30.730 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T19:58:30.732 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T19:58:30.755 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:30 +0000 (0:00:00.610) 0:00:56.467 ******* 2021-03-10T19:58:30.777 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:30 +0000 (0:00:00.022) 0:00:56.489 ******* 2021-03-10T19:58:31.206 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T19:58:31.208 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:31.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:31 +0000 (0:00:00.457) 0:00:56.947 ******* 2021-03-10T19:58:31.243 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:31.271 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:31 +0000 (0:00:00.035) 0:00:56.983 ******* 2021-03-10T19:58:31.561 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T19:58:31.563 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T19:58:31.594 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T19:58:31.814 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T19:58:31.846 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T19:58:32.035 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T19:58:32.039 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T19:58:32.065 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:32 +0000 (0:00:00.793) 0:00:57.777 ******* 2021-03-10T19:58:32.086 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:32 +0000 (0:00:00.021) 0:00:57.798 ******* 2021-03-10T19:58:32.186 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T19:58:32.188 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:58:32.211 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:32 +0000 (0:00:00.125) 0:00:57.923 ******* 2021-03-10T19:58:32.221 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:58:32.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:32 +0000 (0:00:00.037) 0:00:57.961 ******* 2021-03-10T19:58:32.518 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T19:58:32.520 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T19:58:32.541 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T19:58:32.752 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T19:58:32.753 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T19:58:32.952 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T19:58:32.981 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:32 +0000 (0:00:00.731) 0:00:58.692 ******* 2021-03-10T19:58:32.988 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T19:58:33.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.035) 0:00:58.728 ******* 2021-03-10T19:58:33.057 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T19:58:33.058 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:58:33.089 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.072) 0:00:58.800 ******* 2021-03-10T19:58:33.096 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:58:33.122 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.033) 0:00:58.834 ******* 2021-03-10T19:58:33.150 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T19:58:33.152 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.176 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.053) 0:00:58.887 ******* 2021-03-10T19:58:33.192 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.217 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.041) 0:00:58.929 ******* 2021-03-10T19:58:33.246 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T19:58:33.248 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:33.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.054) 0:00:58.983 ******* 2021-03-10T19:58:33.290 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:33.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.046) 0:00:59.030 ******* 2021-03-10T19:58:33.357 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T19:58:33.359 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.369 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.380 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.406 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.088) 0:00:59.118 ******* 2021-03-10T19:58:33.413 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.414 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.416 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.426 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.453 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.046) 0:00:59.165 ******* 2021-03-10T19:58:33.481 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T19:58:33.483 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.505 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.052) 0:00:59.217 ******* 2021-03-10T19:58:33.522 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:33.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.041) 0:00:59.259 ******* 2021-03-10T19:58:33.968 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:33.993 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:33 +0000 (0:00:00.445) 0:00:59.705 ******* 2021-03-10T19:58:34.031 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:34.061 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.068) 0:00:59.773 ******* 2021-03-10T19:58:34.289 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T19:58:34.291 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T19:58:34.321 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.260) 0:01:00.033 ******* 2021-03-10T19:58:34.364 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T19:58:34.400 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.078) 0:01:00.112 ******* 2021-03-10T19:58:34.676 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T19:58:34.705 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.304) 0:01:00.417 ******* 2021-03-10T19:58:34.733 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T19:58:34.762 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.057) 0:01:00.474 ******* 2021-03-10T19:58:34.865 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T19:58:34.867 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T19:58:34.951 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T19:58:34.990 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:34 +0000 (0:00:00.225) 0:01:00.700 ******* 2021-03-10T19:58:35.049 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T19:58:35.060 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T19:58:35.062 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:35.085 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.096) 0:01:00.797 ******* 2021-03-10T19:58:35.134 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T19:58:35.135 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T19:58:35.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.077) 0:01:00.874 ******* 2021-03-10T19:58:35.168 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T19:58:35.170 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:35.201 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.038) 0:01:00.913 ******* 2021-03-10T19:58:35.232 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T19:58:35.234 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:35.260 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.059) 0:01:00.972 ******* 2021-03-10T19:58:35.277 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T19:58:35.279 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:35.305 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.044) 0:01:01.017 ******* 2021-03-10T19:58:35.334 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T19:58:35.335 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:58:35.365 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.060) 0:01:01.077 ******* 2021-03-10T19:58:35.445 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T19:58:35.447 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:35.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.111) 0:01:01.188 ******* 2021-03-10T19:58:35.596 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:35.598 INFO:teuthology.task.ansible.out:TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T19:58:35.625 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.148) 0:01:01.337 ******* 2021-03-10T19:58:35.793 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T19:58:35.821 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.196) 0:01:01.533 ******* 2021-03-10T19:58:35.844 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T19:58:35.846 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ActiveEnterTimestampMonotonic": "13288199", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target nss-lookup.target systemd-tmpfiles-setup.service local-fs.target time-sync.target basic.target system.slice var-run.mount -.mount remote-fs.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:51 UTC", "AssertTimestampMonotonic": "13271098", "Before": "getty@tty1.service shutdown.target xdm.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:51 UTC", "Con 2021-03-10T19:58:35.848 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13271097", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1280", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ExecMainStartTimestampMonotonic": "13288083", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T19:58:35.849 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:51 UTC", "InactiveExitTimestampMonotonic": "13288199", "InvocationID": "95df2f93e90c4720ab4d82410290abc7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1280", "MemoryAccounting": "yes", "MemoryCurrent": "1376256", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T19:58:35.851 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:51 UTC", "StateChangeTimestampMonotonic": "13288199", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T19:58:35.853 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:58:35.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.050) 0:01:01.583 ******* 2021-03-10T19:58:35.943 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T19:58:35.946 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:35.972 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:35 +0000 (0:00:00.100) 0:01:01.684 ******* 2021-03-10T19:58:36.044 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T19:58:36.047 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ActiveEnterTimestampMonotonic": "13540127", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target local-fs.target system.slice network.target -.mount var-run.mount remote-fs.target sysinit.target systemd-journald.socket nss-lookup.target time-sync.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:51 UTC", "AssertTimestampMonotonic": "13451022", "Before": "shutdown.target multi-user.target plymouth-quit.service getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:51 UTC", "Con 2021-03-10T19:58:36.048 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13451021", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1266", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ExecMainStartTimestampMonotonic": "13540006", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T19:58:36.050 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:51 UTC", "InactiveExitTimestampMonotonic": "13540127", "InvocationID": "a6f72bbcf79c435a834fa2adafea2e03", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1266", "MemoryAccounting": "yes", "MemoryCurrent": "1273856", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T19:58:36.051 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:51 UTC", "StateChangeTimestampMonotonic": "13540127", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T19:58:36.053 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:58:36.081 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.109) 0:01:01.793 ******* 2021-03-10T19:58:36.175 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T19:58:36.177 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.204 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.123) 0:01:01.916 ******* 2021-03-10T19:58:36.288 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.317 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.112) 0:01:02.029 ******* 2021-03-10T19:58:36.422 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T19:58:36.424 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.460 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.142) 0:01:02.171 ******* 2021-03-10T19:58:36.530 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.532 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.100) 0:01:02.271 ******* 2021-03-10T19:58:36.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.027) 0:01:02.298 ******* 2021-03-10T19:58:36.635 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T19:58:36.637 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.660 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.073) 0:01:02.372 ******* 2021-03-10T19:58:36.666 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T19:58:36.668 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.033) 0:01:02.405 ******* 2021-03-10T19:58:36.731 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T19:58:36.733 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.757 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.063) 0:01:02.468 ******* 2021-03-10T19:58:36.774 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T19:58:36.775 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.799 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.042) 0:01:02.511 ******* 2021-03-10T19:58:36.827 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T19:58:36.829 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.856 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.056) 0:01:02.568 ******* 2021-03-10T19:58:36.874 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T19:58:36.876 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:36.908 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:36 +0000 (0:00:00.051) 0:01:02.620 ******* 2021-03-10T19:58:37.056 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T19:58:37.057 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.088 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.179) 0:01:02.800 ******* 2021-03-10T19:58:37.116 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T19:58:37.118 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.054) 0:01:02.854 ******* 2021-03-10T19:58:37.285 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T19:58:37.286 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.308 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.166) 0:01:03.020 ******* 2021-03-10T19:58:37.339 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.365 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.056) 0:01:03.076 ******* 2021-03-10T19:58:37.508 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T19:58:37.510 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.537 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.171) 0:01:03.248 ******* 2021-03-10T19:58:37.554 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T19:58:37.556 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.153) 0:01:03.402 ******* 2021-03-10T19:58:37.718 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T19:58:37.720 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.743 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.052) 0:01:03.455 ******* 2021-03-10T19:58:37.770 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T19:58:37.772 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:58:37.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.055) 0:01:03.510 ******* 2021-03-10T19:58:37.815 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T19:58:37.817 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:37.841 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.042) 0:01:03.553 ******* 2021-03-10T19:58:37.879 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T19:58:37.881 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T19:58:37.909 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.067) 0:01:03.621 ******* 2021-03-10T19:58:37.928 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T19:58:37.929 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:58:37.954 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:37 +0000 (0:00:00.045) 0:01:03.666 ******* 2021-03-10T19:58:37.993 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T19:58:37.995 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T19:58:38.019 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.065) 0:01:03.731 ******* 2021-03-10T19:58:38.060 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T19:58:38.062 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T19:58:38.089 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.069) 0:01:03.801 ******* 2021-03-10T19:58:38.106 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T19:58:38.108 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T19:58:38.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.046) 0:01:03.848 ******* 2021-03-10T19:58:38.173 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T19:58:38.175 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T19:58:38.201 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.065) 0:01:03.913 ******* 2021-03-10T19:58:38.203 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:38.229 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T19:58:38.232 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:58:38.255 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.053) 0:01:03.967 ******* 2021-03-10T19:58:38.283 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T19:58:38.284 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T19:58:38.312 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.056) 0:01:04.024 ******* 2021-03-10T19:58:38.414 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T19:58:38.416 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:58:38.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.134) 0:01:04.158 ******* 2021-03-10T19:58:38.468 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.022) 0:01:04.180 ******* 2021-03-10T19:58:38.539 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T19:58:38.540 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:38.563 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.094) 0:01:04.274 ******* 2021-03-10T19:58:38.631 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:38.635 INFO:teuthology.task.ansible.out:TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T19:58:38.636 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T19:58:38.661 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.098) 0:01:04.373 ******* 2021-03-10T19:58:38.685 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.023) 0:01:04.397 ******* 2021-03-10T19:58:38.735 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T19:58:38.737 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:38.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.075) 0:01:04.472 ******* 2021-03-10T19:58:38.836 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T19:58:38.837 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:38.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.100) 0:01:04.572 ******* 2021-03-10T19:58:38.877 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T19:58:38.879 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T19:58:38.904 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:38 +0000 (0:00:00.043) 0:01:04.616 ******* 2021-03-10T19:58:39.070 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T19:58:39.094 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:39 +0000 (0:00:00.190) 0:01:04.806 ******* 2021-03-10T19:58:39.279 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T19:58:39.281 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T19:58:39.304 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:39 +0000 (0:00:00.209) 0:01:05.016 ******* 2021-03-10T19:58:39.383 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T19:58:39.384 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba009"}, "changed": false} 2021-03-10T19:58:39.406 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:39 +0000 (0:00:00.101) 0:01:05.118 ******* 2021-03-10T19:58:39.464 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T19:58:39.465 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T19:58:39.492 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:39 +0000 (0:00:00.086) 0:01:05.204 ******* 2021-03-10T19:58:39.571 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T19:58:39.622 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba004"}, "changed": false} Wednesday 10 March 2021 19:58:39 +0000 (0:00:00.102) 0:01:05.307 ******* 2021-03-10T19:58:40.155 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-10T19:58:40.156 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba004", "ansible_hostname": "gibba004", "ansible_nodename": "gibba004"}, "changed": false, "name": "gibba004"} ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba009", "ansible_hostname": "gibba009", "ansible_nodename": "gibba009"}, "changed": false, "name": "gibba009"} 2021-03-10T19:58:40.179 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.584) 0:01:05.891 ******* 2021-03-10T19:58:40.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.022) 0:01:05.914 ******* 2021-03-10T19:58:40.482 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-10T19:58:40.484 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T19:58:40.508 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.306) 0:01:06.220 ******* 2021-03-10T19:58:40.516 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T19:58:40.544 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.035) 0:01:06.255 ******* 2021-03-10T19:58:40.790 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-10T19:58:40.792 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T19:58:40.815 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.271) 0:01:06.527 ******* 2021-03-10T19:58:40.832 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T19:58:40.857 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:40 +0000 (0:00:00.041) 0:01:06.569 ******* 2021-03-10T19:58:41.215 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T19:58:41.216 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T19:58:41.239 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.382) 0:01:06.951 ******* 2021-03-10T19:58:41.247 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T19:58:41.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.032) 0:01:06.984 ******* 2021-03-10T19:58:41.312 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T19:58:41.314 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.336 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.063) 0:01:07.048 ******* 2021-03-10T19:58:41.342 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.369 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.032) 0:01:07.081 ******* 2021-03-10T19:58:41.406 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:58:41.408 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.431 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.062) 0:01:07.143 ******* 2021-03-10T19:58:41.449 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.045) 0:01:07.189 ******* 2021-03-10T19:58:41.505 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T19:58:41.507 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.534 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.057) 0:01:07.246 ******* 2021-03-10T19:58:41.583 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.074) 0:01:07.321 ******* 2021-03-10T19:58:41.614 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:58:41.616 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.641 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.032) 0:01:07.353 ******* 2021-03-10T19:58:41.679 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.681 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:41.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.065) 0:01:07.419 ******* 2021-03-10T19:58:41.724 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T19:58:41.725 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.750 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.043) 0:01:07.462 ******* 2021-03-10T19:58:41.779 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.056) 0:01:07.518 ******* 2021-03-10T19:58:41.824 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:58:41.825 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.849 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.042) 0:01:07.561 ******* 2021-03-10T19:58:41.851 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:41.880 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.905 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.055) 0:01:07.617 ******* 2021-03-10T19:58:41.934 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T19:58:41.935 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:41.961 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:41 +0000 (0:00:00.055) 0:01:07.672 ******* 2021-03-10T19:58:41.978 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.005 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.044) 0:01:07.717 ******* 2021-03-10T19:58:42.033 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T19:58:42.035 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.059 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.053) 0:01:07.771 ******* 2021-03-10T19:58:42.087 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.114 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.054) 0:01:07.826 ******* 2021-03-10T19:58:42.132 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T19:58:42.159 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.045) 0:01:07.871 ******* 2021-03-10T19:58:42.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.076) 0:01:07.948 ******* 2021-03-10T19:58:42.238 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:42.244 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T19:58:42.275 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.038) 0:01:07.987 ******* 2021-03-10T19:58:42.340 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.064) 0:01:08.052 ******* 2021-03-10T19:58:42.357 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T19:58:42.386 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.045) 0:01:08.098 ******* 2021-03-10T19:58:42.444 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.058) 0:01:08.156 ******* 2021-03-10T19:58:42.473 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T19:58:42.475 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.501 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.055) 0:01:08.212 ******* 2021-03-10T19:58:42.528 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.059) 0:01:08.272 ******* 2021-03-10T19:58:42.615 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T19:58:42.617 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.642 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.082) 0:01:08.354 ******* 2021-03-10T19:58:42.661 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.663 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.697 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.054) 0:01:08.408 ******* 2021-03-10T19:58:42.736 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T19:58:42.737 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.064) 0:01:08.473 ******* 2021-03-10T19:58:42.785 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.812 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.051) 0:01:08.524 ******* 2021-03-10T19:58:42.841 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:58:42.843 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.866 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.054) 0:01:08.578 ******* 2021-03-10T19:58:42.905 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.929 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.063) 0:01:08.641 ******* 2021-03-10T19:58:42.946 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T19:58:42.947 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:42.971 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:42 +0000 (0:00:00.041) 0:01:08.683 ******* 2021-03-10T19:58:43.010 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.034 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.062) 0:01:08.746 ******* 2021-03-10T19:58:43.053 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T19:58:43.055 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.082 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.047) 0:01:08.794 ******* 2021-03-10T19:58:43.111 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.057) 0:01:08.851 ******* 2021-03-10T19:58:43.157 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T19:58:43.158 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.182 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.042) 0:01:08.894 ******* 2021-03-10T19:58:43.213 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.239 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.056) 0:01:08.951 ******* 2021-03-10T19:58:43.267 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T19:58:43.268 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.295 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.055) 0:01:09.006 ******* 2021-03-10T19:58:43.322 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.349 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.053) 0:01:09.061 ******* 2021-03-10T19:58:43.367 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:58:43.368 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.044) 0:01:09.105 ******* 2021-03-10T19:58:43.421 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.053) 0:01:09.158 ******* 2021-03-10T19:58:43.464 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:58:43.466 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.490 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.043) 0:01:09.202 ******* 2021-03-10T19:58:43.530 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.558 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.067) 0:01:09.270 ******* 2021-03-10T19:58:43.576 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:58:43.578 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.603 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.044) 0:01:09.315 ******* 2021-03-10T19:58:43.631 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.656 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.052) 0:01:09.367 ******* 2021-03-10T19:58:43.672 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T19:58:43.675 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.044) 0:01:09.412 ******* 2021-03-10T19:58:43.727 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.755 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.055) 0:01:09.467 ******* 2021-03-10T19:58:43.772 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:58:43.774 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.797 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.042) 0:01:09.509 ******* 2021-03-10T19:58:43.827 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.853 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.055) 0:01:09.565 ******* 2021-03-10T19:58:43.880 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:58:43.882 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.906 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.052) 0:01:09.617 ******* 2021-03-10T19:58:43.925 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:43.951 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:43 +0000 (0:00:00.045) 0:01:09.663 ******* 2021-03-10T19:58:43.979 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T19:58:43.980 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.005 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.053) 0:01:09.717 ******* 2021-03-10T19:58:44.033 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.058 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.052) 0:01:09.770 ******* 2021-03-10T19:58:44.075 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.100 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.041) 0:01:09.812 ******* 2021-03-10T19:58:44.129 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.153 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.053) 0:01:09.865 ******* 2021-03-10T19:58:44.183 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T19:58:44.185 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.210 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.056) 0:01:09.922 ******* 2021-03-10T19:58:44.237 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.265 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.054) 0:01:09.976 ******* 2021-03-10T19:58:44.283 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T19:58:44.285 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.311 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.045) 0:01:10.022 ******* 2021-03-10T19:58:44.338 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.366 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.055) 0:01:10.078 ******* 2021-03-10T19:58:44.385 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T19:58:44.387 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.411 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.044) 0:01:10.123 ******* 2021-03-10T19:58:44.440 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.466 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.055) 0:01:10.178 ******* 2021-03-10T19:58:44.484 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T19:58:44.486 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.511 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.043) 0:01:10.222 ******* 2021-03-10T19:58:44.539 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.563 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.052) 0:01:10.275 ******* 2021-03-10T19:58:44.581 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T19:58:44.583 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.044) 0:01:10.320 ******* 2021-03-10T19:58:44.636 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.665 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.056) 0:01:10.377 ******* 2021-03-10T19:58:44.684 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T19:58:44.685 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.711 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.045) 0:01:10.423 ******* 2021-03-10T19:58:44.740 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:44.766 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.055) 0:01:10.478 ******* 2021-03-10T19:58:44.868 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T19:58:44.869 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001405", "end": "2021-03-10 19:58:45.120733", "rc": 0, "start": "2021-03-10 19:58:45.119328", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:44.892 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.125) 0:01:10.604 ******* 2021-03-10T19:58:44.922 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001386", "end": "2021-03-10 19:58:44.965011", "rc": 0, "start": "2021-03-10 19:58:44.963625", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:44.948 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:44 +0000 (0:00:00.055) 0:01:10.660 ******* 2021-03-10T19:58:44.986 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T19:58:45.011 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.062) 0:01:10.722 ******* 2021-03-10T19:58:45.056 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.045) 0:01:10.768 ******* 2021-03-10T19:58:45.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T19:58:45.340 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T19:58:45.364 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.307) 0:01:11.075 ******* 2021-03-10T19:58:45.381 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T19:58:45.408 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.044) 0:01:11.120 ******* 2021-03-10T19:58:45.448 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:45.478 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.069) 0:01:11.190 ******* 2021-03-10T19:58:45.485 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:45.512 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:45 +0000 (0:00:00.033) 0:01:11.223 ******* 2021-03-10T19:58:46.447 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-10T19:58:46.449 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T19:58:46.515 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T19:58:47.039 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T19:58:47.062 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:01.550) 0:01:12.774 ******* 2021-03-10T19:58:47.187 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T19:58:47.214 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.151) 0:01:12.926 ******* 2021-03-10T19:58:47.529 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:47.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.345) 0:01:13.272 ******* 2021-03-10T19:58:47.641 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T19:58:47.669 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.108) 0:01:13.381 ******* 2021-03-10T19:58:47.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T19:58:47.677 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:47.704 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.035) 0:01:13.416 ******* 2021-03-10T19:58:47.706 INFO:teuthology.task.ansible.out: 2021-03-10T19:58:47.775 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T19:58:47.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.093) 0:01:13.510 ******* 2021-03-10T19:58:47.826 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-10T19:58:47.828 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010255", "end": "2021-03-10 19:58:47.876859", "rc": 0, "start": "2021-03-10 19:58:47.866604", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:47.852 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.053) 0:01:13.564 ******* 2021-03-10T19:58:47.964 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011114", "end": "2021-03-10 19:58:48.210334", "rc": 0, "start": "2021-03-10 19:58:48.199220", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:58:47.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:47 +0000 (0:00:00.136) 0:01:13.701 ******* 2021-03-10T19:58:49.569 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-10T19:58:49.571 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:49.593 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:49 +0000 (0:00:01.603) 0:01:15.305 ******* 2021-03-10T19:58:49.684 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:49.713 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:49 +0000 (0:00:00.120) 0:01:15.425 ******* 2021-03-10T19:58:58.338 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T19:58:58.340 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\n 2021-03-10T19:58:58.342 INFO:teuthology.task.ansible.out:Removing qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Readi 2021-03-10T19:58:58.343 INFO:teuthology.task.ansible.out:ng database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:58:58.367 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:58 +0000 (0:00:08.654) 0:01:24.079 ******* 2021-03-10T19:58:58.603 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\n 2021-03-10T19:58:58.605 INFO:teuthology.task.ansible.out:Removing qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Readi 2021-03-10T19:58:58.609 INFO:teuthology.task.ansible.out:ng database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:58:58.631 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:58 +0000 (0:00:00.263) 0:01:24.343 ******* 2021-03-10T19:58:58.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:58:58.840 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:58:58.867 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:58 +0000 (0:00:00.236) 0:01:24.579 ******* 2021-03-10T19:58:58.945 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T19:58:58.947 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:58.970 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:58 +0000 (0:00:00.102) 0:01:24.682 ******* 2021-03-10T19:58:59.106 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:58:59.108 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:58:59.134 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:59 +0000 (0:00:00.164) 0:01:24.846 ******* 2021-03-10T19:58:59.216 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T19:58:59.217 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:58:59.243 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:58:59 +0000 (0:00:00.109) 0:01:24.955 ******* 2021-03-10T19:59:08.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:59:08.347 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databa 2021-03-10T19:59:08.349 INFO:teuthology.task.ansible.out:se ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T19:59:08.351 INFO:teuthology.task.ansible.out: ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", 2021-03-10T19:59:08.352 INFO:teuthology.task.ansible.out: "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Se 2021-03-10T19:59:08.354 INFO:teuthology.task.ansible.out:tting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:59:08.374 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:08 +0000 (0:00:09.131) 0:01:34.086 ******* 2021-03-10T19:59:08.556 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (13.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databa 2021-03-10T19:59:08.558 INFO:teuthology.task.ansible.out:se ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T19:59:08.560 INFO:teuthology.task.ansible.out: ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (13.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", 2021-03-10T19:59:08.562 INFO:teuthology.task.ansible.out: "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Se 2021-03-10T19:59:08.564 INFO:teuthology.task.ansible.out:tting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:59:08.586 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:08 +0000 (0:00:00.211) 0:01:34.297 ******* 2021-03-10T19:59:08.846 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T19:59:08.848 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:08.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:08 +0000 (0:00:00.298) 0:01:34.596 ******* 2021-03-10T19:59:09.043 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:09.069 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.184) 0:01:34.781 ******* 2021-03-10T19:59:09.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T19:59:09.348 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:09.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.302) 0:01:35.083 ******* 2021-03-10T19:59:09.525 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T19:59:09.527 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T19:59:09.549 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.177) 0:01:35.261 ******* 2021-03-10T19:59:09.555 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T19:59:09.557 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:09.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.038) 0:01:35.299 ******* 2021-03-10T19:59:09.628 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T19:59:09.630 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:09.656 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.069) 0:01:35.368 ******* 2021-03-10T19:59:09.748 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T19:59:09.750 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T19:59:09.776 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.119) 0:01:35.488 ******* 2021-03-10T19:59:09.804 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T19:59:09.806 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T19:59:09.831 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.054) 0:01:35.542 ******* 2021-03-10T19:59:09.849 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T19:59:09.851 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:09.878 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:09 +0000 (0:00:00.047) 0:01:35.590 ******* 2021-03-10T19:59:10.044 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T19:59:10.046 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T19:59:10.067 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.189) 0:01:35.779 ******* 2021-03-10T19:59:10.179 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T19:59:10.181 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T19:59:10.205 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.137) 0:01:35.917 ******* 2021-03-10T19:59:10.382 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T19:59:10.384 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T19:59:10.410 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.205) 0:01:36.122 ******* 2021-03-10T19:59:10.417 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T19:59:10.418 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T19:59:10.444 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.034) 0:01:36.156 ******* 2021-03-10T19:59:10.570 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T19:59:10.615 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.163) 0:01:36.320 ******* 2021-03-10T19:59:10.617 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba009.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T19:59:10.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.043) 0:01:36.363 ******* 2021-03-10T19:59:10.819 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T19:59:10.821 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:59:10.846 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.194) 0:01:36.558 ******* 2021-03-10T19:59:10.854 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T19:59:10.856 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:52 UTC", "ActiveEnterTimestampMonotonic": "14333759", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target network.target systemd-journald.socket remote-fs.target systemd-tmpfiles-setup.service -.mount system.slice sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:51 UTC", "AssertTimestampMonotonic": "13358877", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ConditionTimestampMonotonic": "13358876", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T19:59:10.857 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1489", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:52 UTC", "ExecMainStartTimestampMonotonic": "14333745", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T19:59:10.859 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:51 UTC", "InactiveExitTimestampMonotonic": "13359517", "InvocationID": "09d8edd500c94cf0b2cbf9e62a60ca7c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1489", "MemoryAccounting": "yes", "MemoryCurrent": "10813440", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T19:59:10.861 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:52 UTC", "StateChangeTimestampMonotonic": "14333759", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T19:59:10.862 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:10.885 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:10 +0000 (0:00:00.039) 0:01:36.597 ******* 2021-03-10T19:59:10.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:59:10.990 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.014 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.128) 0:01:36.726 ******* 2021-03-10T19:59:11.086 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.110 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.095) 0:01:36.821 ******* 2021-03-10T19:59:11.118 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T19:59:11.120 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:52 UTC", "ActiveEnterTimestampMonotonic": "14480613", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket system.slice network.target basic.target nss-lookup.target systemd-tmpfiles-setup.service remote-fs.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:51 UTC", "AssertTimestampMonotonic": "13179057", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ConditionTimestampMonotonic": "13179057", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T19:59:11.122 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1489", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:52 UTC", "ExecMainStartTimestampMonotonic": "14480603", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T19:59:11.123 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:51 UTC", "InactiveExitTimestampMonotonic": "13179685", "InvocationID": "187cf690e2544a5998fbaaf0f8173b22", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1489", "MemoryAccounting": "yes", "MemoryCurrent": "10514432", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T19:59:11.125 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:52 UTC", "StateChangeTimestampMonotonic": "14480613", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T19:59:11.127 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:11.147 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.036) 0:01:36.858 ******* 2021-03-10T19:59:11.184 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:11.185 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:59:11.186 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.187 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:11.215 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.068) 0:01:36.927 ******* 2021-03-10T19:59:11.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:59:11.226 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.251 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.035) 0:01:36.963 ******* 2021-03-10T19:59:11.300 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T19:59:11.301 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.331 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.080) 0:01:37.043 ******* 2021-03-10T19:59:11.340 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T19:59:11.342 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.368 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.036) 0:01:37.080 ******* 2021-03-10T19:59:11.395 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:59:11.397 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.421 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.053) 0:01:37.133 ******* 2021-03-10T19:59:11.439 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:59:11.441 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.466 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.043) 0:01:37.177 ******* 2021-03-10T19:59:11.503 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T19:59:11.506 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.528 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.063) 0:01:37.240 ******* 2021-03-10T19:59:11.548 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T19:59:11.550 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.574 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.044) 0:01:37.285 ******* 2021-03-10T19:59:11.632 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:59:11.634 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.664 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.090) 0:01:37.376 ******* 2021-03-10T19:59:11.678 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:59:11.680 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.708 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.043) 0:01:37.420 ******* 2021-03-10T19:59:11.747 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:59:11.749 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.773 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.064) 0:01:37.484 ******* 2021-03-10T19:59:11.800 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T19:59:11.802 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.826 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.053) 0:01:37.538 ******* 2021-03-10T19:59:11.843 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:11.844 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.846 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:11.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.057) 0:01:37.595 ******* 2021-03-10T19:59:11.904 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:59:11.905 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.943 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.059) 0:01:37.655 ******* 2021-03-10T19:59:11.962 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:59:11.964 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:11.991 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:11 +0000 (0:00:00.047) 0:01:37.703 ******* 2021-03-10T19:59:12.029 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:59:12.031 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.057 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.065) 0:01:37.769 ******* 2021-03-10T19:59:12.097 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:59:12.098 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.124 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.066) 0:01:37.835 ******* 2021-03-10T19:59:12.144 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.171 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.047) 0:01:37.883 ******* 2021-03-10T19:59:12.210 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:59:12.212 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.065) 0:01:37.948 ******* 2021-03-10T19:59:12.264 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:59:12.266 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.065) 0:01:38.013 ******* 2021-03-10T19:59:12.334 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T19:59:12.335 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.377 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.075) 0:01:38.088 ******* 2021-03-10T19:59:12.396 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:59:12.398 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.422 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.045) 0:01:38.134 ******* 2021-03-10T19:59:12.472 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:59:12.474 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.498 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.075) 0:01:38.209 ******* 2021-03-10T19:59:12.515 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:59:12.517 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.045) 0:01:38.255 ******* 2021-03-10T19:59:12.582 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:59:12.584 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.614 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.071) 0:01:38.326 ******* 2021-03-10T19:59:12.623 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T19:59:12.625 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.650 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.035) 0:01:38.362 ******* 2021-03-10T19:59:12.699 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:12.701 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.727 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.075) 0:01:38.438 ******* 2021-03-10T19:59:12.733 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:59:12.735 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.035) 0:01:38.473 ******* 2021-03-10T19:59:12.801 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:59:12.803 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.832 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.070) 0:01:38.544 ******* 2021-03-10T19:59:12.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:59:12.852 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.880 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.048) 0:01:38.592 ******* 2021-03-10T19:59:12.909 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:59:12.911 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.937 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.056) 0:01:38.649 ******* 2021-03-10T19:59:12.967 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:12.968 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:12.993 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:12 +0000 (0:00:00.056) 0:01:38.705 ******* 2021-03-10T19:59:13.023 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T19:59:13.024 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.050 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.056) 0:01:38.762 ******* 2021-03-10T19:59:13.067 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:59:13.069 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.094 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.043) 0:01:38.806 ******* 2021-03-10T19:59:13.124 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:59:13.125 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.148 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.053) 0:01:38.860 ******* 2021-03-10T19:59:13.150 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:13.177 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:59:13.179 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.054) 0:01:38.914 ******* 2021-03-10T19:59:13.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:59:13.233 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.261 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.058) 0:01:38.973 ******* 2021-03-10T19:59:13.280 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.306 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.044) 0:01:39.018 ******* 2021-03-10T19:59:13.334 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:13.336 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.056) 0:01:39.074 ******* 2021-03-10T19:59:13.380 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:59:13.382 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.407 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.044) 0:01:39.119 ******* 2021-03-10T19:59:13.434 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.459 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.052) 0:01:39.171 ******* 2021-03-10T19:59:13.476 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:59:13.478 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.042) 0:01:39.214 ******* 2021-03-10T19:59:13.540 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.566 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.063) 0:01:39.278 ******* 2021-03-10T19:59:13.583 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:13.585 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.042) 0:01:39.320 ******* 2021-03-10T19:59:13.636 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:13.638 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.053) 0:01:39.374 ******* 2021-03-10T19:59:13.681 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.045) 0:01:39.419 ******* 2021-03-10T19:59:13.735 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T19:59:13.737 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.057) 0:01:39.476 ******* 2021-03-10T19:59:13.765 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:13.785 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:13.788 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.814 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.049) 0:01:39.526 ******* 2021-03-10T19:59:13.900 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:59:13.902 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:13.931 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.116) 0:01:39.643 ******* 2021-03-10T19:59:13.949 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T19:59:13.951 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T19:59:13.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:13 +0000 (0:00:00.048) 0:01:39.692 ******* 2021-03-10T19:59:14.009 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T19:59:14.010 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:14.035 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.055) 0:01:39.747 ******* 2021-03-10T19:59:14.190 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T19:59:14.192 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T19:59:14.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.180) 0:01:39.928 ******* 2021-03-10T19:59:14.265 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:59:14.267 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T19:59:14.292 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.076) 0:01:40.004 ******* 2021-03-10T19:59:14.372 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:59:14.374 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:14.398 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.105) 0:01:40.110 ******* 2021-03-10T19:59:14.533 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:59:14.536 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T19:59:14.558 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.160) 0:01:40.270 ******* 2021-03-10T19:59:14.629 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:59:14.631 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:14.657 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.098) 0:01:40.369 ******* 2021-03-10T19:59:14.706 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T19:59:14.708 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T19:59:14.731 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.074) 0:01:40.443 ******* 2021-03-10T19:59:14.959 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T19:59:14.983 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:14 +0000 (0:00:00.251) 0:01:40.695 ******* 2021-03-10T19:59:15.063 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T19:59:15.065 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T19:59:15.087 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.104) 0:01:40.799 ******* 2021-03-10T19:59:15.311 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T19:59:15.340 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.252) 0:01:41.052 ******* 2021-03-10T19:59:15.400 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T19:59:15.402 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T19:59:15.426 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.085) 0:01:41.137 ******* 2021-03-10T19:59:15.579 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T19:59:15.580 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:59:15.603 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.176) 0:01:41.314 ******* 2021-03-10T19:59:15.642 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T19:59:15.645 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T19:59:15.669 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.066) 0:01:41.381 ******* 2021-03-10T19:59:15.675 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T19:59:15.676 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:15.704 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.035) 0:01:41.416 ******* 2021-03-10T19:59:15.778 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T19:59:15.780 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:15.813 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.108) 0:01:41.525 ******* 2021-03-10T19:59:15.843 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T19:59:15.845 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:59:15.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.056) 0:01:41.582 ******* 2021-03-10T19:59:15.887 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T19:59:15.889 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:15.913 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.042) 0:01:41.625 ******* 2021-03-10T19:59:15.940 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T19:59:15.942 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:15.966 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:15 +0000 (0:00:00.052) 0:01:41.678 ******* 2021-03-10T19:59:15.984 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T19:59:15.986 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.012 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.045) 0:01:41.724 ******* 2021-03-10T19:59:16.043 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T19:59:16.044 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.068 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.055) 0:01:41.780 ******* 2021-03-10T19:59:16.069 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:16.097 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T19:59:16.099 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.122 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.054) 0:01:41.834 ******* 2021-03-10T19:59:16.151 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T19:59:16.152 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.181 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.058) 0:01:41.893 ******* 2021-03-10T19:59:16.199 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:16.200 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T19:59:16.230 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.049) 0:01:41.942 ******* 2021-03-10T19:59:16.259 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.288 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.057) 0:01:42.000 ******* 2021-03-10T19:59:16.317 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T19:59:16.319 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.329 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.352 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.363 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.365 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.376 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.377 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.379 INFO:teuthology.task.ansible.out:TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba004.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T19:59:16.403 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.114) 0:01:42.115 ******* 2021-03-10T19:59:16.411 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.413 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.414 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.425 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.438 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.440 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.451 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.482 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.079) 0:01:42.194 ******* 2021-03-10T19:59:16.490 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:16.492 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T19:59:16.521 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.038) 0:01:42.232 ******* 2021-03-10T19:59:16.654 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T19:59:16.655 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.666 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.677 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.679 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.689 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.710 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T19:59:16.712 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.714 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.726 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.728 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:16.749 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.751 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.763 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.765 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003837", "end": "2021-03-10 19:59:16.734140", "rc": 0, "start": "2021-03-10 19:59:16.730303", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T19:59:16.765 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.799 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.278) 0:01:42.511 ******* 2021-03-10T19:59:16.831 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.032) 0:01:42.543 ******* 2021-03-10T19:59:16.883 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T19:59:16.885 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:16.911 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:16 +0000 (0:00:00.079) 0:01:42.623 ******* 2021-03-10T19:59:16.989 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T19:59:16.991 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.105) 0:01:42.728 ******* 2021-03-10T19:59:17.100 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T19:59:17.102 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003353", "end": "2021-03-10 19:59:17.071270", "rc": 0, "start": "2021-03-10 19:59:17.067917", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.125 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.108) 0:01:42.837 ******* 2021-03-10T19:59:17.157 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.031) 0:01:42.868 ******* 2021-03-10T19:59:17.239 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T19:59:17.241 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.269 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.112) 0:01:42.981 ******* 2021-03-10T19:59:17.351 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T19:59:17.353 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.376 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.106) 0:01:43.088 ******* 2021-03-10T19:59:17.466 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T19:59:17.468 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.490 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.113) 0:01:43.201 ******* 2021-03-10T19:59:17.593 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T19:59:17.594 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:17.622 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.132) 0:01:43.334 ******* 2021-03-10T19:59:17.702 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T19:59:17.704 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:17.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.104) 0:01:43.438 ******* 2021-03-10T19:59:17.806 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [gibba004.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T19:59:17.837 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.110) 0:01:43.549 ******* 2021-03-10T19:59:17.839 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:17.946 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T19:59:17.947 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:17.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:17 +0000 (0:00:00.143) 0:01:43.692 ******* 2021-03-10T19:59:17.986 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T19:59:17.988 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002462", "end": "2021-03-10 19:59:18.233662", "rc": 0, "start": "2021-03-10 19:59:18.231200", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:18.013 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.033) 0:01:43.725 ******* 2021-03-10T19:59:18.053 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:18.055 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:18.081 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.067) 0:01:43.793 ******* 2021-03-10T19:59:18.109 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T19:59:18.111 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:18.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.055) 0:01:43.848 ******* 2021-03-10T19:59:18.175 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:59:18.177 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T19:59:18.201 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.065) 0:01:43.913 ******* 2021-03-10T19:59:18.218 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T19:59:18.247 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.045) 0:01:43.959 ******* 2021-03-10T19:59:18.350 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:59:18.352 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002459", "end": "2021-03-10 19:59:18.401985", "rc": 0, "start": "2021-03-10 19:59:18.399526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:18.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.133) 0:01:44.092 ******* 2021-03-10T19:59:18.473 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T19:59:18.475 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:18.498 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.117) 0:01:44.210 ******* 2021-03-10T19:59:18.571 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T19:59:18.595 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:18 +0000 (0:00:00.097) 0:01:44.307 ******* 2021-03-10T19:59:18.687 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:59:18.689 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:20.103 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRj1AD5VnqrjqHKzBSSTJE3vWTt0A9kO9iR'], 'uuids': ['0ba5bc07-0ca1-4d8f-9025-f6246070e06d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.654907", "end": "2021-03-10 19:59:20.345219", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRj1AD5VnqrjqHKzBSSTJE3vWTt0A9kO9iR"], "labels": [], "masters": [], "uuids": ["0ba5bc07-0ca1-4d8f-9025-f6246070e06d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:18.690312", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:20.105 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:20.116 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:20.337 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTB0KEGhoFMmFkc67nbJ1mILVyNAhfIuqJz'], 'uuids': ['08ca14d8-c0a5-43ef-b0a9-b117f13f02bf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.531329", "end": "2021-03-10 19:59:20.373442", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTB0KEGhoFMmFkc67nbJ1mILVyNAhfIuqJz"], "labels": [], "masters": [], "uuids": ["08ca14d8-c0a5-43ef-b0a9-b117f13f02bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:18.842113", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:20.349 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:20.350 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:21.336 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjeqDUjuI5abZv7SfNwzqyQGXaDjrlBZgk'], 'uuids': ['92016fbf-8e84-4537-af14-f76988e6b1c8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.130323", "end": "2021-03-10 19:59:21.581511", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjeqDUjuI5abZv7SfNwzqyQGXaDjrlBZgk"], "labels": [], "masters": [], "uuids": ["92016fbf-8e84-4537-af14-f76988e6b1c8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:20.451188", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:21.349 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'wwn-0x50000399ab9813ce'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'wwn-0x50000399ab9813ce-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813ce', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "wwn-0x50000399ab9813ce"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1", "wwn-0x50000399ab9813ce-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ce"}}, "skip_reason": "Cond 2021-03-10T19:59:21.356 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:59:21.567 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBdCKSGAVRk0kpWZMzS0Pb8jMqENi6FVXQ'], 'uuids': ['7bce7875-e7ef-4075-abd5-f8ddf9e2ec8f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122092", "end": "2021-03-10 19:59:21.604580", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBdCKSGAVRk0kpWZMzS0Pb8jMqENi6FVXQ"], "labels": [], "masters": [], "uuids": ["7bce7875-e7ef-4075-abd5-f8ddf9e2ec8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:20.482488", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:21.580 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF', 'wwn-0x50000399ab9813cf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF-part1', 'wwn-0x50000399ab9813cf-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cf', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K1F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF", "wwn-0x50000399ab9813cf"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF-part1", "wwn-0x50000399ab9813cf-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K1F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cf"}}, "skip_reason": "Cond 2021-03-10T19:59:21.582 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:59:22.596 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-gINHcx-HBDu-lzod-p9Lk-xjfO-xs4h-v1f3xe', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A', 'nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.146444", "end": "2021-03-10 19:59:22.841531", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-gINHcx-HBDu-lzod-p9Lk-xjfO-xs4h-v1f3xe", "nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A", "nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:21.695087", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T19:59:22.598 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:22.608 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:22.620 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:22.812 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-tm5Gqu-JuTN-j1Uz-LjwB-YQH0-HsUQ-nl65db', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400KC375A', 'nvme-nvme.8086-50484b4d3931333430304b4333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.126049", "end": "2021-03-10 19:59:22.849150", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-tm5Gqu-JuTN-j1Uz-LjwB-YQH0-HsUQ-nl65db", "nvme-INTEL_SSDPEL1K375GA_PHKM913400KC375A", "nvme-nvme.8086-50484b4d3931333430304b4333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:21.723101", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T19:59:22.814 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:22.825 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:22.829 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:23.837 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje0UiKczDVmWrize3XsKZxNN8B6X4docN'], 'uuids': ['14c4a41e-6a56-4c86-b771-a63ecf32d707']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.121833", "end": "2021-03-10 19:59:24.075287", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje0UiKczDVmWrize3XsKZxNN8B6X4docN"], "labels": [], "masters": [], "uuids": ["14c4a41e-6a56-4c86-b771-a63ecf32d707"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:22.953454", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:23.838 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:23.850 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:24.044 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBLCqbuounC4TLTevAQbXdyb83KjOYdgkw'], 'uuids': ['36c473d3-96ec-480c-95a7-eaa1760e16c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.111407", "end": "2021-03-10 19:59:24.088118", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBLCqbuounC4TLTevAQbXdyb83KjOYdgkw"], "labels": [], "masters": [], "uuids": ["36c473d3-96ec-480c-95a7-eaa1760e16c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:22.976711", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:24.056 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:24.068 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:25.058 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje1nYGZcoOxesrKqcYs8pGanGYTrg82tj'], 'uuids': ['d2dc54de-e5f4-4a8c-9c31-eb12a4342204']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.114532", "end": "2021-03-10 19:59:25.304015", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje1nYGZcoOxesrKqcYs8pGanGYTrg82tj"], "labels": [], "masters": [], "uuids": ["d2dc54de-e5f4-4a8c-9c31-eb12a4342204"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:24.189483", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:25.070 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:25.281 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBgkZ30aiWHWpBKzB91oygy5x6Tr4HdsbN'], 'uuids': ['2d37ef44-3f15-4efe-8aac-312216ec48a6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.099210", "end": "2021-03-10 19:59:25.321348", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBgkZ30aiWHWpBKzB91oygy5x6Tr4HdsbN"], "labels": [], "masters": [], "uuids": ["2d37ef44-3f15-4efe-8aac-312216ec48a6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:24.222138", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:25.293 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.269 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjxydx9fHlWNnlMGzPxw1UyO3oyFeQIcm8'], 'uuids': ['dbbf5a13-d72e-4c24-9981-c14766f538bd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.106183", "end": "2021-03-10 19:59:26.508283", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjxydx9fHlWNnlMGzPxw1UyO3oyFeQIcm8"], "labels": [], "masters": [], "uuids": ["dbbf5a13-d72e-4c24-9981-c14766f538bd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:25.402100", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:26.309 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:26 +0000 (0:00:07.713) 0:01:52.021 ******* 2021-03-10T19:59:26.401 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:59:26.403 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.486 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:59:26.488 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBXtQkJj0ov9D5rcb0DY49Fw6cfCJ4zv1E'], 'uuids': ['9a9635f1-0f39-487d-88da-cd29e0f89bad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.108742", "end": "2021-03-10 19:59:26.526543", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBXtQkJj0ov9D5rcb0DY49Fw6cfCJ4zv1E"], "labels": [], "masters": [], "uuids": ["9a9635f1-0f39-487d-88da-cd29e0f89bad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:25.417801", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:59:26.523 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:26 +0000 (0:00:00.213) 0:01:52.235 ******* 2021-03-10T19:59:26.571 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:59:26.572 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRj1AD5VnqrjqHKzBSSTJE3vWTt0A9kO9iR'], 'uuids': ['0ba5bc07-0ca1-4d8f-9025-f6246070e06d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078509", "end": "2021-03-10 19:59:26.816952", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRj1AD5VnqrjqHKzBSSTJE3vWTt0A9kO9iR"], "labels": [], "masters": [], "uuids": ["0ba5bc07-0ca1-4d8f-9025-f6246070e06d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:26.738443", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772256 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772256 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:26.574 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.596 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.608 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.756 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjeqDUjuI5abZv7SfNwzqyQGXaDjrlBZgk'], 'uuids': ['92016fbf-8e84-4537-af14-f76988e6b1c8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077665", "end": "2021-03-10 19:59:26.999031", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjeqDUjuI5abZv7SfNwzqyQGXaDjrlBZgk"], "labels": [], "masters": [], "uuids": ["92016fbf-8e84-4537-af14-f76988e6b1c8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:26.921366", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764519 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764519 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:26.758 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'wwn-0x50000399ab9813ce'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'wwn-0x50000399ab9813ce-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813ce', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "wwn-0x50000399ab9813ce"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1", "wwn-0x50000399ab9813ce-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ce"}}, "skip_reason": "Cond 2021-03-10T19:59:26.759 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:59:26.781 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTB0KEGhoFMmFkc67nbJ1mILVyNAhfIuqJz'], 'uuids': ['08ca14d8-c0a5-43ef-b0a9-b117f13f02bf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077926", "end": "2021-03-10 19:59:26.823078", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTB0KEGhoFMmFkc67nbJ1mILVyNAhfIuqJz"], "labels": [], "masters": [], "uuids": ["08ca14d8-c0a5-43ef-b0a9-b117f13f02bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:26.745152", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766247 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766247 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:26.793 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.794 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.869 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-gINHcx-HBDu-lzod-p9Lk-xjfO-xs4h-v1f3xe', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A', 'nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025190", "end": "2021-03-10 19:59:27.118794", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-gINHcx-HBDu-lzod-p9Lk-xjfO-xs4h-v1f3xe", "nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A", "nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.093604", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.02394 s, 4.8 GB/s", "stderr_lines": ["110 2021-03-10T19:59:26.871 INFO:teuthology.task.ansible.out:+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.02394 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:26.881 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.892 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:26.967 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBdCKSGAVRk0kpWZMzS0Pb8jMqENi6FVXQ'], 'uuids': ['7bce7875-e7ef-4075-abd5-f8ddf9e2ec8f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077769", "end": "2021-03-10 19:59:27.009411", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBdCKSGAVRk0kpWZMzS0Pb8jMqENi6FVXQ"], "labels": [], "masters": [], "uuids": ["7bce7875-e7ef-4075-abd5-f8ddf9e2ec8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:26.931642", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0765232 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0765232 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:26.968 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF', 'wwn-0x50000399ab9813cf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF-part1', 'wwn-0x50000399ab9813cf-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cf', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2K1F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF", "wwn-0x50000399ab9813cf"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF-part1", "wwn-0x50000399ab9813cf-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K1F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cf"}}, "skip_reason": "Cond 2021-03-10T19:59:26.970 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:59:27.053 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje0UiKczDVmWrize3XsKZxNN8B6X4docN'], 'uuids': ['14c4a41e-6a56-4c86-b771-a63ecf32d707']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078089", "end": "2021-03-10 19:59:27.298855", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje0UiKczDVmWrize3XsKZxNN8B6X4docN"], "labels": [], "masters": [], "uuids": ["14c4a41e-6a56-4c86-b771-a63ecf32d707"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.220766", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767926 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767926 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.065 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.066 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.099 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-tm5Gqu-JuTN-j1Uz-LjwB-YQH0-HsUQ-nl65db', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400KC375A', 'nvme-nvme.8086-50484b4d3931333430304b4333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025439", "end": "2021-03-10 19:59:27.138718", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-tm5Gqu-JuTN-j1Uz-LjwB-YQH0-HsUQ-nl65db", "nvme-INTEL_SSDPEL1K375GA_PHKM913400KC375A", "nvme-nvme.8086-50484b4d3931333430304b4333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.113279", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0241975 s, 4.8 GB/s", "stderr_lines": ["1 2021-03-10T19:59:27.101 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0241975 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.112 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.250 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje1nYGZcoOxesrKqcYs8pGanGYTrg82tj'], 'uuids': ['d2dc54de-e5f4-4a8c-9c31-eb12a4342204']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078364", "end": "2021-03-10 19:59:27.499996", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRje1nYGZcoOxesrKqcYs8pGanGYTrg82tj"], "labels": [], "masters": [], "uuids": ["d2dc54de-e5f4-4a8c-9c31-eb12a4342204"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.421632", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770929 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770929 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.261 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.285 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBLCqbuounC4TLTevAQbXdyb83KjOYdgkw'], 'uuids': ['36c473d3-96ec-480c-95a7-eaa1760e16c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077884", "end": "2021-03-10 19:59:27.322961", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBLCqbuounC4TLTevAQbXdyb83KjOYdgkw"], "labels": [], "masters": [], "uuids": ["36c473d3-96ec-480c-95a7-eaa1760e16c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.245077", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766201 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766201 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.286 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.298 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.427 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjxydx9fHlWNnlMGzPxw1UyO3oyFeQIcm8'], 'uuids': ['dbbf5a13-d72e-4c24-9981-c14766f538bd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078158", "end": "2021-03-10 19:59:27.673474", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eqFCTj43MMKbyNKtcyPAq7IrRMgSDLRjxydx9fHlWNnlMGzPxw1UyO3oyFeQIcm8"], "labels": [], "masters": [], "uuids": ["dbbf5a13-d72e-4c24-9981-c14766f538bd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.595316", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769079 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769079 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.462 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:27 +0000 (0:00:00.938) 0:01:53.173 ******* 2021-03-10T19:59:27.472 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBgkZ30aiWHWpBKzB91oygy5x6Tr4HdsbN'], 'uuids': ['2d37ef44-3f15-4efe-8aac-312216ec48a6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078562", "end": "2021-03-10 19:59:27.502801", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBgkZ30aiWHWpBKzB91oygy5x6Tr4HdsbN"], "labels": [], "masters": [], "uuids": ["2d37ef44-3f15-4efe-8aac-312216ec48a6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.424239", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773172 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773172 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.473 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:27.643 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBXtQkJj0ov9D5rcb0DY49Fw6cfCJ4zv1E'], 'uuids': ['9a9635f1-0f39-487d-88da-cd29e0f89bad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078274", "end": "2021-03-10 19:59:27.693246", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zZi0XkzWcee9RGyOWoxrrEWpxOp4asTBXtQkJj0ov9D5rcb0DY49Fw6cfCJ4zv1E"], "labels": [], "masters": [], "uuids": ["9a9635f1-0f39-487d-88da-cd29e0f89bad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:59:27.614972", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770207 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770207 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:27 +0000 (0:00:00.231) 0:01:53.405 ******* 2021-03-10T19:59:27.797 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T19:59:27.799 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.160882", "end": "2021-03-10 19:59:27.981882", "rc": 0, "start": "2021-03-10 19:59:27.821000", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:27.824 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:27 +0000 (0:00:00.130) 0:01:53.536 ******* 2021-03-10T19:59:28.009 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T19:59:28.011 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.080805", "end": "2021-03-10 19:59:28.261012", "rc": 0, "start": "2021-03-10 19:59:28.180207", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:28.040 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.215) 0:01:53.752 ******* 2021-03-10T19:59:28.078 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T19:59:28.080 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.210869", "end": "2021-03-10 19:59:28.061464", "rc": 0, "start": "2021-03-10 19:59:27.850595", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:28.104 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.064) 0:01:53.816 ******* 2021-03-10T19:59:28.122 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T19:59:28.199 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.094) 0:01:53.910 ******* 2021-03-10T19:59:28.228 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T19:59:28.230 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.253 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.054) 0:01:53.965 ******* 2021-03-10T19:59:28.281 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.304 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.050) 0:01:54.016 ******* 2021-03-10T19:59:28.311 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T19:59:28.313 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.083311", "end": "2021-03-10 19:59:28.336674", "rc": 0, "start": "2021-03-10 19:59:28.253363", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:28.339 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.035) 0:01:54.051 ******* 2021-03-10T19:59:28.348 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T19:59:28.350 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.041) 0:01:54.092 ******* 2021-03-10T19:59:28.387 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T19:59:28.415 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.034) 0:01:54.127 ******* 2021-03-10T19:59:28.422 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T19:59:28.424 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.449 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.033) 0:01:54.161 ******* 2021-03-10T19:59:28.457 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T19:59:28.458 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.037) 0:01:54.199 ******* 2021-03-10T19:59:28.526 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T19:59:28.528 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.554 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.067) 0:01:54.266 ******* 2021-03-10T19:59:28.562 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T19:59:28.564 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:59:28.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.037) 0:01:54.303 ******* 2021-03-10T19:59:28.600 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T19:59:28.602 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.172) 0:01:54.476 ******* 2021-03-10T19:59:28.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:59:28.775 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.804 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.039) 0:01:54.515 ******* 2021-03-10T19:59:28.810 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T19:59:28.812 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.837 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.033) 0:01:54.549 ******* 2021-03-10T19:59:28.844 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T19:59:28.845 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.033) 0:01:54.583 ******* 2021-03-10T19:59:28.904 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:28.932 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.059) 0:01:54.643 ******* 2021-03-10T19:59:28.960 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:59:28.983 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:28 +0000 (0:00:00.052) 0:01:54.695 ******* 2021-03-10T19:59:28.991 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:28.993 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.018 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.034) 0:01:54.730 ******* 2021-03-10T19:59:29.041 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:59:29.043 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.069 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.051) 0:01:54.781 ******* 2021-03-10T19:59:29.076 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T19:59:29.077 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.103 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.033) 0:01:54.815 ******* 2021-03-10T19:59:29.110 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T19:59:29.112 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.032) 0:01:54.847 ******* 2021-03-10T19:59:29.141 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T19:59:29.143 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.169 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.033) 0:01:54.881 ******* 2021-03-10T19:59:29.175 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:29.177 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.032) 0:01:54.914 ******* 2021-03-10T19:59:29.207 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T19:59:29.209 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.239 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.037) 0:01:54.951 ******* 2021-03-10T19:59:29.241 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:29.248 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:29.250 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.274 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.034) 0:01:54.986 ******* 2021-03-10T19:59:29.301 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T19:59:29.303 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.327 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.053) 0:01:55.039 ******* 2021-03-10T19:59:29.356 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T19:59:29.357 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.053) 0:01:55.093 ******* 2021-03-10T19:59:29.432 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T19:59:29.434 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:29.456 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.075) 0:01:55.168 ******* 2021-03-10T19:59:29.916 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T19:59:29.918 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T19:59:29.945 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.488) 0:01:55.657 ******* 2021-03-10T19:59:29.964 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T19:59:29.966 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:29.992 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:29 +0000 (0:00:00.047) 0:01:55.704 ******* 2021-03-10T19:59:30.511 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:30.532 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:30.796 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:30.830 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.164 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.206 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.480 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.617 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.810 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:31.813 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:31.839 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:31 +0000 (0:00:01.847) 0:01:57.551 ******* 2021-03-10T19:59:31.962 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T19:59:31.964 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T19:59:31.988 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:31 +0000 (0:00:00.148) 0:01:57.700 ******* 2021-03-10T19:59:31.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:59:31.997 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:59:32.032 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.037) 0:01:57.738 ******* 2021-03-10T19:59:32.148 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:59:32.151 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T19:59:32.174 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.147) 0:01:57.886 ******* 2021-03-10T19:59:32.225 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:59:32.226 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.312 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.323 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.387 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.399 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.414 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.438 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.263) 0:01:58.150 ******* 2021-03-10T19:59:32.466 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T19:59:32.468 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.491 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.053) 0:01:58.203 ******* 2021-03-10T19:59:32.509 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:59:32.510 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.521 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.545 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.053) 0:01:58.257 ******* 2021-03-10T19:59:32.572 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:59:32.574 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:59:32.584 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.614 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.068) 0:01:58.326 ******* 2021-03-10T19:59:32.643 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T19:59:32.645 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.667 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.053) 0:01:58.379 ******* 2021-03-10T19:59:32.675 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T19:59:32.676 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:32.705 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.037) 0:01:58.416 ******* 2021-03-10T19:59:32.712 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T19:59:32.714 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:32.741 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.036) 0:01:58.453 ******* 2021-03-10T19:59:32.748 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T19:59:32.750 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T19:59:32.780 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.039) 0:01:58.492 ******* 2021-03-10T19:59:32.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T19:59:32.866 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:32.892 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.111) 0:01:58.603 ******* 2021-03-10T19:59:32.934 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T19:59:32.936 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T19:59:32.960 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:32 +0000 (0:00:00.068) 0:01:58.672 ******* 2021-03-10T19:59:33.103 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T19:59:33.105 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true} changed: [gibba004.front.sepia.ceph.com] => {"changed": true} 2021-03-10T19:59:33.131 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.171) 0:01:58.843 ******* 2021-03-10T19:59:33.154 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.022) 0:01:58.866 ******* 2021-03-10T19:59:33.444 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T19:59:33.446 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T19:59:33.475 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.319) 0:01:59.186 ******* 2021-03-10T19:59:33.510 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.035) 0:01:59.222 ******* 2021-03-10T19:59:33.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T19:59:33.522 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.551 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.041) 0:01:59.263 ******* 2021-03-10T19:59:33.559 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.585 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.033) 0:01:59.297 ******* 2021-03-10T19:59:33.592 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T19:59:33.594 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.624 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.038) 0:01:59.336 ******* 2021-03-10T19:59:33.632 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.664 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.039) 0:01:59.376 ******* 2021-03-10T19:59:33.671 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T19:59:33.673 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.036) 0:01:59.412 ******* 2021-03-10T19:59:33.719 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.756 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.055) 0:01:59.468 ******* 2021-03-10T19:59:33.771 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T19:59:33.773 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.799 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.043) 0:01:59.511 ******* 2021-03-10T19:59:33.807 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:33.852 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.052) 0:01:59.563 ******* 2021-03-10T19:59:33.953 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-10T19:59:33.955 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:59:33.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:33 +0000 (0:00:00.128) 0:01:59.692 ******* 2021-03-10T19:59:34.009 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:59:34.042 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.061) 0:01:59.754 ******* 2021-03-10T19:59:34.102 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T19:59:34.104 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:34.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.086) 0:01:59.840 ******* 2021-03-10T19:59:34.189 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:34.215 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.086) 0:01:59.927 ******* 2021-03-10T19:59:34.453 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T19:59:34.455 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T19:59:34.480 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.265) 0:02:00.192 ******* 2021-03-10T19:59:34.509 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T19:59:34.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.055) 0:02:00.247 ******* 2021-03-10T19:59:34.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T19:59:34.812 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T19:59:34.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.297) 0:02:00.545 ******* 2021-03-10T19:59:34.841 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T19:59:34.867 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:34 +0000 (0:00:00.033) 0:02:00.578 ******* 2021-03-10T19:59:35.270 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-10T19:59:35.272 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:35.295 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.428) 0:02:01.007 ******* 2021-03-10T19:59:35.302 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:35.327 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.032) 0:02:01.039 ******* 2021-03-10T19:59:35.520 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T19:59:35.522 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.112724", "end": "2021-03-10 19:59:35.767109", "rc": 0, "start": "2021-03-10 19:59:35.654385", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T19:59:35.545 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.218) 0:02:01.257 ******* 2021-03-10T19:59:35.584 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:35.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.063) 0:02:01.321 ******* 2021-03-10T19:59:35.617 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T19:59:35.618 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.114439", "end": "2021-03-10 19:59:35.638229", "rc": 0, "start": "2021-03-10 19:59:35.523790", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T19:59:35.642 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.032) 0:02:01.354 ******* 2021-03-10T19:59:35.648 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T19:59:35.650 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:35.677 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.033) 0:02:01.387 ******* 2021-03-10T19:59:35.682 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:35.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.031) 0:02:01.419 ******* 2021-03-10T19:59:35.735 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T19:59:35.737 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:35.762 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:35 +0000 (0:00:00.054) 0:02:01.474 ******* 2021-03-10T19:59:36.089 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T19:59:36.091 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:36.114 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.351) 0:02:01.825 ******* 2021-03-10T19:59:36.141 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T19:59:36.143 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:36.166 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.052) 0:02:01.878 ******* 2021-03-10T19:59:36.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:36.211 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.045) 0:02:01.923 ******* 2021-03-10T19:59:36.239 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T19:59:36.241 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:36.264 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.052) 0:02:01.975 ******* 2021-03-10T19:59:36.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T19:59:36.418 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T19:59:36.443 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.179) 0:02:02.155 ******* 2021-03-10T19:59:36.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T19:59:36.471 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:36.497 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.053) 0:02:02.208 ******* 2021-03-10T19:59:36.526 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T19:59:36.527 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T19:59:36.553 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.055) 0:02:02.264 ******* 2021-03-10T19:59:36.580 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T19:59:36.582 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:36.606 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.053) 0:02:02.318 ******* 2021-03-10T19:59:36.655 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T19:59:36.657 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ActiveEnterTimestampMonotonic": "12876770", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount systemd-journald.socket basic.target network.target system.slice sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:50 UTC", "AssertTimestampMonotonic": "12578821", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:50 UTC", "ConditionTimestampMonotonic": "12578821", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-03-10T19:59:36.658 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "986", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:51 UTC", "ExecMainStartTimestampMonotonic": "12876761", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:50 UTC", "InactiveExitTimestampMonotonic": "12579405", "InvocationID": "c4ec499d2b754b3e8f051cd3c5b970e7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T19:59:36.660 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "986", "MemoryAccounting": "yes", "MemoryCurrent": "3928064", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "Requir 2021-03-10T19:59:36.661 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:51 UTC", "StateChangeTimestampMonotonic": "12876770", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:36.697 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.090) 0:02:02.408 ******* 2021-03-10T19:59:36.729 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:36.731 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T19:59:36.765 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.068) 0:02:02.477 ******* 2021-03-10T19:59:36.787 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T19:59:36.789 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:56:50 UTC", "ActiveEnterTimestampMonotonic": "12571208", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice sysinit.target systemd-tmpfiles-setup.service basic.target -.mount network.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:56:50 UTC", "AssertTimestampMonotonic": "12439033", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:56:50 UTC", "ConditionTimestampMonotonic": "12439032", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-03-10T19:59:36.791 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1009", "ExecMainStartTimestamp": "Wed 2021-03-10 19:56:50 UTC", "ExecMainStartTimestampMonotonic": "12571192", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:56:50 UTC", "InactiveExitTimestampMonotonic": "12439602", "InvocationID": "38cbdd322bb44c27a9b6d421fb7be282", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-03-10T19:59:36.793 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1009", "MemoryAccounting": "yes", "MemoryCurrent": "3747840", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requ 2021-03-10T19:59:36.795 INFO:teuthology.task.ansible.out:iresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:56:50 UTC", "StateChangeTimestampMonotonic": "12571208", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:36.817 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.052) 0:02:02.529 ******* 2021-03-10T19:59:36.830 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:36.831 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T19:59:36.863 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.045) 0:02:02.575 ******* 2021-03-10T19:59:36.871 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:36.873 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T19:59:36.902 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.038) 0:02:02.614 ******* 2021-03-10T19:59:36.911 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T19:59:36.913 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:36.945 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.043) 0:02:02.657 ******* 2021-03-10T19:59:36.955 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:36.958 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T19:59:36.986 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:36 +0000 (0:00:00.040) 0:02:02.698 ******* 2021-03-10T19:59:37.026 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T19:59:37.028 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:37.051 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:37 +0000 (0:00:00.064) 0:02:02.762 ******* 2021-03-10T19:59:37.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T19:59:37.754 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:37.788 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:37 +0000 (0:00:00.737) 0:02:03.499 ******* 2021-03-10T19:59:37.815 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T19:59:37.817 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:37.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:37 +0000 (0:00:00.060) 0:02:03.559 ******* 2021-03-10T19:59:37.933 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T19:59:37.935 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:37.963 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:37 +0000 (0:00:00.114) 0:02:03.674 ******* 2021-03-10T19:59:38.001 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T19:59:38.003 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:59:38.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:38 +0000 (0:00:00.082) 0:02:03.757 ******* 2021-03-10T19:59:38.047 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:38.075 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:38 +0000 (0:00:00.029) 0:02:03.786 ******* 2021-03-10T19:59:38.215 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:59:38.246 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:38 +0000 (0:00:00.171) 0:02:03.958 ******* 2021-03-10T19:59:38.464 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T19:59:38.466 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T19:59:38.490 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:38 +0000 (0:00:00.243) 0:02:04.201 ******* 2021-03-10T19:59:38.613 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T19:59:38.639 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:38 +0000 (0:00:00.149) 0:02:04.351 ******* 2021-03-10T19:59:40.374 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T19:59:40.375 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T19:59:40.399 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:01.760) 0:02:06.111 ******* 2021-03-10T19:59:40.417 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T19:59:40.444 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.044) 0:02:06.156 ******* 2021-03-10T19:59:40.735 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T19:59:40.737 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false} 2021-03-10T19:59:40.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.319) 0:02:06.476 ******* 2021-03-10T19:59:40.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T19:59:40.794 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} TASK [testnode : Purge resolvconf] ********************************************* ok: [gibba004.front.sepia.ceph.com] => {"changed": false} 2021-03-10T19:59:40.818 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.053) 0:02:06.530 ******* 2021-03-10T19:59:40.840 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.022) 0:02:06.552 ******* 2021-03-10T19:59:40.857 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T19:59:40.859 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T19:59:40.883 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.042) 0:02:06.595 ******* 2021-03-10T19:59:40.975 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T19:59:40.976 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615406226.9916992, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615406226.9876993, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615406226.9876993, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T19:59:41.001 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:40 +0000 (0:00:00.118) 0:02:06.713 ******* 2021-03-10T19:59:41.022 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615406227.2780335, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615406227.2740333, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615406227.2740333, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T19:59:41.047 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.045) 0:02:06.759 ******* 2021-03-10T19:59:41.423 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T19:59:41.425 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T19:59:41.448 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.400) 0:02:07.160 ******* 2021-03-10T19:59:41.486 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T19:59:41.489 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T19:59:41.518 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.070) 0:02:07.230 ******* 2021-03-10T19:59:41.541 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.022) 0:02:07.253 ******* 2021-03-10T19:59:41.560 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T19:59:41.583 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.042) 0:02:07.295 ******* 2021-03-10T19:59:41.590 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:41.618 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.034) 0:02:07.330 ******* 2021-03-10T19:59:41.624 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:41.650 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.032) 0:02:07.362 ******* 2021-03-10T19:59:41.753 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T19:59:41.754 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T19:59:41.779 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.129) 0:02:07.491 ******* 2021-03-10T19:59:41.785 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T19:59:41.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.031) 0:02:07.523 ******* 2021-03-10T19:59:41.968 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T19:59:41.969 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T19:59:41.993 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:41 +0000 (0:00:00.181) 0:02:07.705 ******* 2021-03-10T19:59:42.022 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.047 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.053) 0:02:07.758 ******* 2021-03-10T19:59:42.085 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba004.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.087 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.100 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.102 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.102 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.140 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.093) 0:02:07.852 ******* 2021-03-10T19:59:42.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T19:59:42.175 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T19:59:42.206 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.066) 0:02:07.918 ******* 2021-03-10T19:59:42.217 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T19:59:42.220 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.221 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.221 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.234 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.051) 0:02:07.970 ******* 2021-03-10T19:59:42.280 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.021) 0:02:07.991 ******* 2021-03-10T19:59:42.287 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:42.288 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.316 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.036) 0:02:08.028 ******* 2021-03-10T19:59:42.324 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T19:59:42.326 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.336 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.337 INFO:teuthology.task.ansible.out: skipping: [gibba009.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.339 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.054) 0:02:08.083 ******* 2021-03-10T19:59:42.415 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.043) 0:02:08.126 ******* 2021-03-10T19:59:42.423 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T19:59:42.425 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.451 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.036) 0:02:08.163 ******* 2021-03-10T19:59:42.459 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T19:59:42.461 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.471 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.473 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba009.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.474 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.476 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.498 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.046) 0:02:08.210 ******* 2021-03-10T19:59:42.519 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.020) 0:02:08.231 ******* 2021-03-10T19:59:42.524 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T19:59:42.526 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.552 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.032) 0:02:08.264 ******* 2021-03-10T19:59:42.558 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:59:42.560 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.585 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.033) 0:02:08.297 ******* 2021-03-10T19:59:42.591 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:59:42.592 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.619 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.033) 0:02:08.331 ******* 2021-03-10T19:59:42.626 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T19:59:42.627 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.032) 0:02:08.363 ******* 2021-03-10T19:59:42.660 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T19:59:42.662 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.038) 0:02:08.402 ******* 2021-03-10T19:59:42.698 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T19:59:42.699 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.725 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.035) 0:02:08.437 ******* 2021-03-10T19:59:42.732 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:59:42.733 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.757 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.031) 0:02:08.469 ******* 2021-03-10T19:59:42.763 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T19:59:42.765 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.789 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.031) 0:02:08.501 ******* 2021-03-10T19:59:42.816 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.849 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.059) 0:02:08.561 ******* 2021-03-10T19:59:42.875 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:59:42.877 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.901 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.052) 0:02:08.613 ******* 2021-03-10T19:59:42.907 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:59:42.908 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002444", "end": "2021-03-10 19:59:43.134635", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 19:59:43.132191", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:42.930 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T19:59:42.932 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:42.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:42 +0000 (0:00:00.054) 0:02:08.668 ******* 2021-03-10T19:59:42.985 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:59:42.987 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:43.009 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.052) 0:02:08.721 ******* 2021-03-10T19:59:43.016 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:59:43.017 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001757", "end": "2021-03-10 19:59:43.238317", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 19:59:43.236560", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.102 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001705", "end": "2021-03-10 19:59:43.336739", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 19:59:43.335034", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.155 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002486", "end": "2021-03-10 19:59:43.194300", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 19:59:43.191814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.229 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026062", "end": "2021-03-10 19:59:43.471560", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 19:59:43.445498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.248) 0:02:08.969 ******* 2021-03-10T19:59:43.259 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:43.266 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001766", "end": "2021-03-10 19:59:43.300314", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 19:59:43.298548", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.289 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T19:59:43.316 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.058) 0:02:09.028 ******* 2021-03-10T19:59:43.367 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:59:43.369 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001623", "end": "2021-03-10 19:59:43.401686", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 19:59:43.400063", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.442 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T19:59:43.444 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T19:59:43.512 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:59:43.514 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026752", "end": "2021-03-10 19:59:43.532224", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 19:59:43.505472", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:43.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.226) 0:02:09.254 ******* 2021-03-10T19:59:43.569 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T19:59:43.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.049) 0:02:09.304 ******* 2021-03-10T19:59:43.725 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T19:59:43.727 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T19:59:43.798 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-10T19:59:43.818 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.225) 0:02:09.529 ******* 2021-03-10T19:59:43.838 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:43 +0000 (0:00:00.020) 0:02:09.550 ******* 2021-03-10T19:59:44.699 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba004.front.sepia.ceph.com] 2021-03-10T19:59:44.753 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:44 +0000 (0:00:00.914) 0:02:10.465 ******* 2021-03-10T19:59:44.791 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:44.793 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T19:59:44.818 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:44 +0000 (0:00:00.065) 0:02:10.530 ******* 2021-03-10T19:59:44.845 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T19:59:44.847 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] 2021-03-10T19:59:44.856 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:44.858 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:44.889 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:44 +0000 (0:00:00.070) 0:02:10.601 ******* 2021-03-10T19:59:44.943 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:44 +0000 (0:00:00.053) 0:02:10.655 ******* 2021-03-10T19:59:44.950 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T19:59:44.952 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T19:59:44.980 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:44 +0000 (0:00:00.035) 0:02:10.691 ******* 2021-03-10T19:59:44.985 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:44.987 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T19:59:45.011 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.032) 0:02:10.723 ******* 2021-03-10T19:59:45.050 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:45.052 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:45.074 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.062) 0:02:10.786 ******* 2021-03-10T19:59:45.125 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T19:59:45.126 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T19:59:45.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.075) 0:02:10.862 ******* 2021-03-10T19:59:45.452 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T19:59:45.454 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"cache_update_time": 1615406243, "cache_updated": false, "changed": false} 2021-03-10T19:59:45.476 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.325) 0:02:11.188 ******* 2021-03-10T19:59:45.503 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:45.505 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:45.533 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.057) 0:02:11.245 ******* 2021-03-10T19:59:45.578 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:45.580 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T19:59:45.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.076) 0:02:11.322 ******* 2021-03-10T19:59:45.621 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** ok: [gibba009.front.sepia.ceph.com] => {"cache_update_time": 1615406247, "cache_updated": false, "changed": false} 2021-03-10T19:59:45.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.040) 0:02:11.363 ******* 2021-03-10T19:59:45.678 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:45.680 INFO:teuthology.task.ansible.out:skipping: [gibba009.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:59:45.703 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.051) 0:02:11.414 ******* 2021-03-10T19:59:45.743 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:59:45.745 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T19:59:45.769 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.066) 0:02:11.481 ******* 2021-03-10T19:59:45.778 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-10T19:59:45.780 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:45.874 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:45.907 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:45 +0000 (0:00:00.138) 0:02:11.619 ******* 2021-03-10T19:59:45.947 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:46.116 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:59:46.143 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:46 +0000 (0:00:00.235) 0:02:11.855 ******* 2021-03-10T19:59:46.254 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-10T19:59:46.255 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406385.9681032-8494-267915261364945/source", "state": "file", "uid": 0} 2021-03-10T19:59:46.508 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406386.1981757-8543-264520582704654/source", "state": "file", "uid": 0} 2021-03-10T19:59:46.510 INFO:teuthology.task.ansible.out: 2021-03-10T19:59:46.584 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406386.2747757-8494-92459686121984/source", "state": "file", "uid": 0} 2021-03-10T19:59:46.620 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:46 +0000 (0:00:00.476) 0:02:12.331 ******* 2021-03-10T19:59:46.818 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406386.5277145-8543-218983429326576/source", "state": "file", "uid": 0} 2021-03-10T19:59:46.845 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:46 +0000 (0:00:00.225) 0:02:12.556 ******* 2021-03-10T19:59:49.956 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T19:59:49.958 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-v9thy6xf\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-v9thy6xf"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-v9thy6xf\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ac8c180d30055e12d030dcdd83c95321e3ea8482beb27e36398aead2903839b0\n Stored in directory: /tmp/pip-ephem-wheel-cache-16pvi5w_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=0e21bb9ed707d1dd520d86380215d5697d5c868e0b861e5f78f14a1d4554d9cc\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T19:59:49.959 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-v9thy6xf", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ac8c180d30055e12d030dcdd83c95321e3ea8482beb27e36398aead2903839b0", " Stored in directory: /tmp/pip-ephem-wheel-cache-16pvi5w_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=0e21bb9ed707d1dd520d86380215d5697d5c868e0b861e5f78f14a1d4554d9cc", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T19:59:49.982 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:49 +0000 (0:00:03.136) 0:02:15.693 ******* 2021-03-10T19:59:50.010 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5azvd0mu\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5azvd0mu"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-5azvd0mu\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ac8c180d30055e12d030dcdd83c95321e3ea8482beb27e36398aead2903839b0\n Stored in directory: /tmp/pip-ephem-wheel-cache-0lm1rd3t/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=0e21bb9ed707d1dd520d86380215d5697d5c868e0b861e5f78f14a1d4554d9cc\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T19:59:50.012 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-5azvd0mu", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ac8c180d30055e12d030dcdd83c95321e3ea8482beb27e36398aead2903839b0", " Stored in directory: /tmp/pip-ephem-wheel-cache-0lm1rd3t/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=0e21bb9ed707d1dd520d86380215d5697d5c868e0b861e5f78f14a1d4554d9cc", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T19:59:50.036 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.053) 0:02:15.747 ******* 2021-03-10T19:59:50.140 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T19:59:50.142 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T19:59:50.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.132) 0:02:15.880 ******* 2021-03-10T19:59:50.188 INFO:teuthology.task.ansible.out:ok: [gibba009.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T19:59:50.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.050) 0:02:15.930 ******* 2021-03-10T19:59:50.519 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T19:59:50.521 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406390.2364824-8935-34168426995461/source", "state": "file", "uid": 0} 2021-03-10T19:59:50.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.329) 0:02:16.259 ******* 2021-03-10T19:59:50.558 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406390.2636633-8940-129416628002187/source", "state": "file", "uid": 0} 2021-03-10T19:59:50.592 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.044) 0:02:16.304 ******* 2021-03-10T19:59:50.705 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T19:59:50.706 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.019019", "end": "2021-03-10 19:59:50.950509", "rc": 0, "start": "2021-03-10 19:59:50.931490", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:50.731 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.139) 0:02:16.443 ******* 2021-03-10T19:59:50.792 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018813", "end": "2021-03-10 19:59:50.838500", "rc": 0, "start": "2021-03-10 19:59:50.819687", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:59:50.817 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:59:50 +0000 (0:00:00.085) 0:02:16.529 ******* 2021-03-10T19:59:54.429 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-10T19:59:54.431 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket network-online.target system.slice basic.target firewalld.service docker.socket containerd.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T19:59:54.432 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T19:59:54.434 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T19:59:54.436 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:57:14 UTC", "StateChangeTimestampMonotonic": "36391465", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:54.646 INFO:teuthology.task.ansible.out:changed: [gibba009.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target sysinit.target systemd-journald.socket containerd.service basic.target system.slice docker.socket firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T19:59:54.647 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T19:59:54.649 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T19:59:54.651 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:57:14 UTC", "StateChangeTimestampMonotonic": "36092933", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:59:54.715 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-10T19:59:54.716 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-10T19:59:54.718 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* gibba004.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 gibba009.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 Wednesday 10 March 2021 19:59:54 +0000 (0:00:03.900) 0:02:20.430 ******* =============================================================================== 2021-03-10T19:59:54.719 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 15.45s Create all admin users with sudo access. ------------------------------- 14.55s testnode : Install packages --------------------------------------------- 9.13s testnode : Ensure packages are not present. ----------------------------- 8.65s testnode : Zap all non-root disks --------------------------------------- 7.71s Remove revoked users ---------------------------------------------------- 4.57s container-host : Restart docker service --------------------------------- 3.90s container-host : Install registries-conf-ctl ---------------------------- 3.14s Gathering Facts --------------------------------------------------------- 2.06s testnode : Create logical volume(s) ------------------------------------- 1.85s testnode : Install packages via pip ------------------------------------- 1.76s common : Update apt cache ----------------------------------------------- 1.69s testnode : Update apt cache. -------------------------------------------- 1.60s testnode : Install apt keys --------------------------------------------- 1.55s testnode : Blow away lingering OSD data and FSIDs ----------------------- 0.94s Gathering Facts --------------------------------------------------------- 0.91s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.82s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.79s ansible-managed : Add authorized keys for the ansible user. ------------- 0.76s users : Update authorized_keys for each user with literal keys ---------- 0.76s 2021-03-10T19:59:55.055 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba004.front.sepia.ceph.com'), Remote(name='ubuntu@gibba009.front.sepia.ceph.com')] 2021-03-10T19:59:55.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T19:59:55.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:59:55.099 DEBUG:teuthology.orchestra.run.gibba004:> true 2021-03-10T19:59:55.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T19:59:55.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:59:55.245 DEBUG:teuthology.orchestra.run.gibba009:> true 2021-03-10T19:59:55.330 INFO:teuthology.run_tasks:Running task clock... 2021-03-10T19:59:55.342 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-10T19:59:55.343 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T19:59:55.345 DEBUG:teuthology.orchestra.run.gibba004:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T19:59:55.366 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T19:59:55.367 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Command line: ntpd -gq 2021-03-10T19:59:55.367 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: proto: precision = 0.034 usec (-25) 2021-03-10T19:59:55.367 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:59:55.368 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:59:55.368 INFO:teuthology.orchestra.run.gibba004.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:59:55.369 INFO:teuthology.orchestra.run.gibba004.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:59:55.370 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T19:59:55.370 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T19:59:55.370 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T19:59:55.371 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen normally on 3 enp1s0f0 172.21.2.104:123 2021-03-10T19:59:55.371 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen normally on 4 lo [::1]:123 2021-03-10T19:59:55.371 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8bfe%4]:123 2021-03-10T19:59:55.371 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 19:59:55 ntpd[8660]: Listening on routing socket on fd #22 for interface updates 2021-03-10T19:59:56.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:56.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:56.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:56.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:56.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:56.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:56.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:59:56.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:59:56.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:56.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:56.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:59:56.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:56 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:59:58.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:58.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:58.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:58.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:58.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:58.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:58.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:59:58.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:59:58.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:58.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:58.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:59:58.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:58 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:59:59.366 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:59.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:59.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:59:59.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:59:59.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:59:59.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 19:59:59 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:00.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:00.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:00.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:00.371 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:00.371 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:00.371 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:00.371 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:00.372 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:00 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:01.366 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:01.366 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:01.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:01.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:01.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:01.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:01 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:02.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:02.367 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:02.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:02.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:02.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:02.368 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:02.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:02.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:02.369 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:02.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:02.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:02.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:02.370 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:02.371 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:02.371 INFO:teuthology.orchestra.run.gibba004.stdout:10 Mar 20:00:02 ntpd[8660]: ntpd: time set -0.265472 s 2021-03-10T20:00:02.371 INFO:teuthology.orchestra.run.gibba004.stdout:ntpd: time set -0.265472s 2021-03-10T20:00:02.372 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T20:00:02.372 INFO:teuthology.orchestra.run.gibba004.stderr:10 Mar 20:00:02 ntpd[8660]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T20:00:02.433 INFO:teuthology.orchestra.run.gibba004.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T20:00:02.434 INFO:teuthology.orchestra.run.gibba004.stdout:============================================================================== 2021-03-10T20:00:02.434 INFO:teuthology.orchestra.run.gibba004.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:02.435 INFO:teuthology.orchestra.run.gibba004.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:02.435 INFO:teuthology.orchestra.run.gibba004.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:02.435 INFO:teuthology.orchestra.run.gibba004.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:02.437 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T20:00:02.437 DEBUG:teuthology.orchestra.run.gibba009:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T20:00:02.459 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T20:00:02.459 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Command line: ntpd -gq 2021-03-10T20:00:02.459 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: proto: precision = 0.034 usec (-25) 2021-03-10T20:00:02.460 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T20:00:02.460 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T20:00:02.460 INFO:teuthology.orchestra.run.gibba009.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T20:00:02.461 INFO:teuthology.orchestra.run.gibba009.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T20:00:02.461 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T20:00:02.462 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T20:00:02.462 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T20:00:02.466 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen normally on 3 enp1s0f0 172.21.2.109:123 2021-03-10T20:00:02.466 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen normally on 4 lo [::1]:123 2021-03-10T20:00:02.467 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8bfc%4]:123 2021-03-10T20:00:02.467 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:02 ntpd[8647]: Listening on routing socket on fd #22 for interface updates 2021-03-10T20:00:03.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:03.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:03.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:03.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:03.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:03.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:03 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:05.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:05.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:05.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:05.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:05.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:05.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:05 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:06.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:06.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:06.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:06.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:06.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:06.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:06 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:07.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:07.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:07.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:07.464 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:07.464 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:07.464 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:07.464 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:07.464 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:07 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:08.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:08.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:08.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:08.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:08.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:08.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:08 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:09.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:09.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:09.460 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:09.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:09.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:09.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:09.461 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T20:00:09.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T20:00:09.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T20:00:09.462 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T20:00:09.463 INFO:teuthology.orchestra.run.gibba009.stdout:10 Mar 20:00:09 ntpd[8647]: ntpd: time set -0.062595 s 2021-03-10T20:00:09.463 INFO:teuthology.orchestra.run.gibba009.stdout:ntpd: time set -0.062595s 2021-03-10T20:00:09.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T20:00:09.463 INFO:teuthology.orchestra.run.gibba009.stderr:10 Mar 20:00:09 ntpd[8647]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T20:00:09.535 INFO:teuthology.orchestra.run.gibba009.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T20:00:09.535 INFO:teuthology.orchestra.run.gibba009.stdout:============================================================================== 2021-03-10T20:00:09.535 INFO:teuthology.orchestra.run.gibba009.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:09.536 INFO:teuthology.orchestra.run.gibba009.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:09.536 INFO:teuthology.orchestra.run.gibba009.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:09.536 INFO:teuthology.orchestra.run.gibba009.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T20:00:09.537 INFO:teuthology.run_tasks:Running task cephadm... 2021-03-10T20:00:09.611 INFO:tasks.cephadm:Config: {'allow_ptrace': False, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b26fc080937a021ce826cdc94d1adb52c064381a'} 2021-03-10T20:00:09.612 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2021-03-10T20:00:09.613 INFO:tasks.cephadm:Cluster fsid is 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:09.613 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-03-10T20:00:09.614 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.104', 'mon.c': '[v2:172.21.2.104:3301,v1:172.21.2.104:6790]', 'mon.b': '172.21.2.109'} 2021-03-10T20:00:09.614 INFO:tasks.cephadm:First mon is mon.a on gibba004 2021-03-10T20:00:09.615 INFO:tasks.cephadm:First mgr is y 2021-03-10T20:00:09.615 INFO:tasks.cephadm:Normalizing hostnames... 2021-03-10T20:00:09.615 DEBUG:teuthology.orchestra.run.gibba004:> sudo hostname $(hostname -s) 2021-03-10T20:00:09.634 DEBUG:teuthology.orchestra.run.gibba009:> sudo hostname $(hostname -s) 2021-03-10T20:00:09.657 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2021-03-10T20:00:09.658 DEBUG:teuthology.orchestra.run.gibba004:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.749 INFO:teuthology.orchestra.run.gibba004.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 20:00 /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.750 DEBUG:teuthology.orchestra.run.gibba009:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.947 INFO:teuthology.orchestra.run.gibba009.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 20:00 /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.948 DEBUG:teuthology.orchestra.run.gibba004:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.960 DEBUG:teuthology.orchestra.run.gibba009:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T20:00:09.977 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /etc/ceph 2021-03-10T20:00:09.999 DEBUG:teuthology.orchestra.run.gibba009:> sudo mkdir -p /etc/ceph 2021-03-10T20:00:10.010 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 777 /etc/ceph 2021-03-10T20:00:10.049 DEBUG:teuthology.orchestra.run.gibba009:> sudo chmod 777 /etc/ceph 2021-03-10T20:00:10.060 INFO:tasks.cephadm:Writing seed config... 2021-03-10T20:00:10.062 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-03-10T20:00:10.062 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-03-10T20:00:10.062 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-03-10T20:00:10.063 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-03-10T20:00:10.063 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-03-10T20:00:10.063 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-03-10T20:00:10.064 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-03-10T20:00:10.064 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-03-10T20:00:10.064 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-03-10T20:00:10.065 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-03-10T20:00:10.065 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-03-10T20:00:10.066 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:00:10.066 DEBUG:teuthology.orchestra.run.gibba004:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-03-10T20:00:10.071 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 37a23cfe-81db-11eb-9080-001a4aab830c mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 1 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-03-10T20:00:10.072 DEBUG:teuthology.orchestra.run.gibba004:mon.a> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service 2021-03-10T20:00:10.074 DEBUG:teuthology.orchestra.run.gibba004:mgr.y> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service 2021-03-10T20:00:10.077 INFO:tasks.cephadm:Bootstrapping... 2021-03-10T20:00:10.077 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 37a23cfe-81db-11eb-9080-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.104 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-03-10T20:00:10.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:00:10.109 INFO:journalctl@ceph.mgr.y.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:00:10.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2021-03-10T20:00:10.218 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Verifying podman|docker is present... 2021-03-10T20:00:10.218 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Verifying lvm2 is present... 2021-03-10T20:00:10.219 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Verifying time synchronization is in place... 2021-03-10T20:00:10.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T20:00:10.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T20:00:10.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T20:00:10.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T20:00:10.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T20:00:10.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T20:00:10.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T20:00:10.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T20:00:10.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T20:00:10.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T20:00:10.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T20:00:10.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T20:00:10.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T20:00:10.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T20:00:10.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T20:00:10.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T20:00:10.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T20:00:10.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Repeating the final host check... 2021-03-10T20:00:10.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2021-03-10T20:00:10.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:systemctl is present 2021-03-10T20:00:10.240 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:lvcreate is present 2021-03-10T20:00:10.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T20:00:10.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T20:00:10.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T20:00:10.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T20:00:10.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T20:00:10.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T20:00:10.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T20:00:10.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T20:00:10.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T20:00:10.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T20:00:10.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T20:00:10.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T20:00:10.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T20:00:10.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T20:00:10.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T20:00:10.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T20:00:10.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T20:00:10.258 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T20:00:10.258 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Host looks OK 2021-03-10T20:00:10.259 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:root:Cluster fsid: 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:10.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Acquiring lock 140661166014816 on /run/cephadm/37a23cfe-81db-11eb-9080-001a4aab830c.lock 2021-03-10T20:00:10.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Lock 140661166014816 acquired on /run/cephadm/37a23cfe-81db-11eb-9080-001a4aab830c.lock 2021-03-10T20:00:10.259 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Verifying IP 172.21.2.104 port 3300 ... 2021-03-10T20:00:10.259 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Verifying IP 172.21.2.104 port 6789 ... 2021-03-10T20:00:10.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Base mon IP is 172.21.2.104, final addrv is [v2:172.21.2.104:3300,v1:172.21.2.104:6789] 2021-03-10T20:00:10.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2021-03-10T20:00:10.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 2021-03-10T20:00:10.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 proto dhcp src 172.21.2.104 metric 100 2021-03-10T20:00:10.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-03-10T20:00:10.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.104 2021-03-10T20:00:10.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp1s0f0 proto dhcp scope link src 172.21.2.104 metric 100 2021-03-10T20:00:10.262 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Mon IP 172.21.2.104 is in CIDR network 172.21.0.0/20 2021-03-10T20:00:10.262 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2021-03-10T20:00:10.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2021-03-10T20:00:12.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2021-03-10T20:00:12.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2021-03-10T20:00:12.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2021-03-10T20:00:13.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Verifying Checksum 2021-03-10T20:00:13.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2021-03-10T20:00:13.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2021-03-10T20:00:13.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2021-03-10T20:00:14.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2021-03-10T20:00:18.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2021-03-10T20:00:18.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2021-03-10T20:00:18.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2021-03-10T20:00:18.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2021-03-10T20:00:18.544 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2021-03-10T20:00:18.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2021-03-10T20:00:18.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2021-03-10T20:00:26.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:stat:stdout 167 167 2021-03-10T20:00:27.544 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Creating initial keys... 2021-03-10T20:00:27.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T20:00:27.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T20:00:28.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBcJUlguj/iFRAA8SN4D82+kXVcQt+DSR0FsA== 2021-03-10T20:00:28.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T20:00:28.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T20:00:29.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBdJUlg088TJxAAf85h682FMdvEtKhj5QihwA== 2021-03-10T20:00:30.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T20:00:30.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T20:00:30.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBeJUlgCquYOhAAnALf/6I02fSqEFko+AsViw== 2021-03-10T20:00:31.479 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Creating initial monmap... 2021-03-10T20:00:31.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/tmp/ceph-tmpd1l3utw8:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '37a23cfe-81db-11eb-9080-001a4aab830c', '--addv', 'a', '[v2:172.21.2.104:3300,v1:172.21.2.104:6789]', '/tmp/monmap'] 2021-03-10T20:00:31.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /tmp/ceph-tmpd1l3utw8:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 37a23cfe-81db-11eb-9080-001a4aab830c --addv a [v2:172.21.2.104:3300,v1:172.21.2.104:6789] /tmp/monmap 2021-03-10T20:00:32.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2021-03-10T20:00:32.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:32.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-03-10T20:00:32.743 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Creating mon... 2021-03-10T20:00:32.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpv0696tm4:/tmp/keyring:z', '-v', '/tmp/ceph-tmpd1l3utw8:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '37a23cfe-81db-11eb-9080-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2021-03-10T20:00:32.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpv0696tm4:/tmp/keyring:z -v /tmp/ceph-tmpd1l3utw8:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-03-10T20:00:33.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:00:33.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 1 imported monmap: 2021-03-10T20:00:33.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2021-03-10T20:00:33.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:33.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2021-03-10T20:00:32.237586+0000 2021-03-10T20:00:33.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2021-03-10T20:00:32.237586+0000 2021-03-10T20:00:33.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2021-03-10T20:00:33.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] mon.a 2021-03-10T20:00:33.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 /usr/bin/ceph-mon: set fsid to 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:33.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:00:33.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:00:33.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:00:33.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:00:33.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:00:33.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:00:33.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T20:00:33.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:00:33.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T20:00:33.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: DB SUMMARY 2021-03-10T20:00:33.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-03-10T20:00:33.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-03-10T20:00:33.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:00:33.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.create_if_missing: 1 2021-03-10T20:00:33.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:00:33.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.env: 0x563a8b92f1a0 2021-03-10T20:00:33.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.info_log: 0x563a8e063a80 2021-03-10T20:00:33.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:00:33.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:00:33.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:00:33.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:00:33.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:00:33.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:00:33.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:00:33.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:00:33.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:00:33.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:00:33.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:00:33.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:00:33.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:00:33.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:00:33.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.db_log_dir: 2021-03-10T20:00:33.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T20:00:33.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:00:33.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:00:33.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:00:33.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:00:33.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:00:33.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:00:33.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:00:33.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:00:33.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:00:33.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.write_buffer_manager: 0x563a8ec04120 2021-03-10T20:00:33.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:00:33.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:00:33.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:00:33.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:00:33.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:00:33.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:00:33.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:00:33.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:00:33.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:00:33.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:00:33.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:00:33.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:00:33.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:00:33.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.row_cache: None 2021-03-10T20:00:33.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.wal_filter: None 2021-03-10T20:00:33.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:00:33.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:00:33.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:00:33.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:00:33.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:00:33.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:00:33.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:00:33.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:00:33.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:00:33.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:00:33.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:00:33.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:00:33.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:00:33.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:00:33.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:00:33.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:00:33.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:00:33.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:00:33.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:00:33.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:00:33.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:00:33.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Compression algorithms supported: 2021-03-10T20:00:33.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:00:33.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kZSTD supported: 0 2021-03-10T20:00:33.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:00:33.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:00:33.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:00:33.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:00:33.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:00:33.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:00:33.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:00:33.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.526+0000 7fb7ddefd6c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2021-03-10T20:00:33.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-03-10T20:00:33.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T20:00:33.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:00:33.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.merge_operator: 2021-03-10T20:00:33.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:00:33.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:00:33.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:00:33.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:00:33.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563a8df8c130) 2021-03-10T20:00:33.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2021-03-10T20:00:33.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T20:00:33.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:00:33.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2021-03-10T20:00:33.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2021-03-10T20:00:33.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2021-03-10T20:00:33.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:00:33.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2021-03-10T20:00:33.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2021-03-10T20:00:33.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2021-03-10T20:00:33.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x563a8dfc2510 2021-03-10T20:00:33.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2021-03-10T20:00:33.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2021-03-10T20:00:33.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2021-03-10T20:00:33.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2021-03-10T20:00:33.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2021-03-10T20:00:33.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2021-03-10T20:00:33.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2021-03-10T20:00:33.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2021-03-10T20:00:33.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2021-03-10T20:00:33.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2021-03-10T20:00:33.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2021-03-10T20:00:33.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2021-03-10T20:00:33.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2021-03-10T20:00:33.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2021-03-10T20:00:33.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2021-03-10T20:00:33.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:00:33.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2021-03-10T20:00:33.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2021-03-10T20:00:33.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2021-03-10T20:00:33.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2021-03-10T20:00:33.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2021-03-10T20:00:33.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2021-03-10T20:00:33.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:00:33.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:00:33.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:00:33.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:00:33.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:00:33.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:00:33.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.num_levels: 7 2021-03-10T20:00:33.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:00:33.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:00:33.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:00:33.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:00:33.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:00:33.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:00:33.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:00:33.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:00:33.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:00:33.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:00:33.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:00:33.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:00:33.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:00:33.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:00:33.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:00:33.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:00:33.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:00:33.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:00:33.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:00:33.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:00:33.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:00:33.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:00:33.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:00:33.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:00:33.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:00:33.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:00:33.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:00:33.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:00:33.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:00:33.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:00:33.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:00:33.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:00:33.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:00:33.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:00:33.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:00:33.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:00:33.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:00:33.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:00:33.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:00:33.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:00:33.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:00:33.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:00:33.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:00:33.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:00:33.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:00:33.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:00:33.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:00:33.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:00:33.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:00:33.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:00:33.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:00:33.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:00:33.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:00:33.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:00:33.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:00:33.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:00:33.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:00:33.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:00:33.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: Options.ttl: 0 2021-03-10T20:00:33.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:00:33.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T20:00:33.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: DB pointer 0x563a8e05e400 2021-03-10T20:00:33.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7c70be700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T20:00:33.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7c70be700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T20:00:33.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2021-03-10T20:00:33.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:33.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:00:33.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:00:33.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:00:33.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:00:33.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:00:33.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:00:33.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T20:00:33.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:33.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:33.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:00:33.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:00:33.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T20:00:33.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:33.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:33.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:33.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:33.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:33.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:00:33.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:00:33.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:00:33.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:33.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:33.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:00:33.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:00:33.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T20:00:33.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:33.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:33.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:00:33.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:00:33.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T20:00:33.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:33.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:33.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:33.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:33.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:33.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:00:33.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:00:33.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:00:33.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:33.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:33.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:00:33.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:00:33.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T20:00:33.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2021-03-10T20:00:33.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2021-03-10T20:00:33.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T20:00:33.530+0000 7fb7ddefd6c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-03-10T20:00:34.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:34.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2021-03-10T20:00:34.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2021-03-10T20:00:34.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-03-10T20:00:34.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2021-03-10T20:00:34.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target 2021-03-10T20:00:34.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target. 2021-03-10T20:00:34.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target. 2021-03-10T20:00:34.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl start ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target 2021-03-10T20:00:34.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T20:00:34.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a 2021-03-10T20:00:34.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a 2021-03-10T20:00:34.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service: Unit ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service not loaded. 2021-03-10T20:00:34.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a 2021-03-10T20:00:34.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target.wants/ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c@.service. 2021-03-10T20:00:34.667 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl start ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a 2021-03-10T20:00:34.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T20:00:34.695 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for mon to start... 2021-03-10T20:00:34.695 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for mon... 2021-03-10T20:00:34.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2021-03-10T20:00:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:34 gibba004 docker[9358]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.a 2021-03-10T20:00:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:34 gibba004 systemd[1]: Started Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:00:36.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2021-03-10T20:00:36.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:36.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2021-03-10T20:00:36.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:36.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2021-03-10T20:00:36.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.156923s) 2021-03-10T20:00:36.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2021-03-10T20:00:36.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2021-03-10T20:00:36.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:36.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2021-03-10T20:00:36.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2021-03-10T20:00:36.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2021-03-10T20:00:36.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2021-03-10T20:00:36.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2021-03-10T20:00:36.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:35 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.875110+0000 mon.a (mon.0) 0 : [INF] mkfs 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:35 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.871767+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T20:00:36.611 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2021-03-10T20:00:36.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T20:00:36.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z -v /var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-03-10T20:00:36.883 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.874427+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T20:00:36.884 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.874678+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0]} 2021-03-10T20:00:36.884 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.876150+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:00:36.884 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.878101+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T20:00:37.294 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: cluster 2021-03-10T20:00:35.878552+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T20:00:37.295 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:36 gibba004 bash[9376]: audit 2021-03-10T20:00:36.031331+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.104:0/4003370737' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-03-10T20:00:37.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:37.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2021-03-10T20:00:37.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:37.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 3 2021-03-10T20:00:37.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.2.104:3300,v1:172.21.2.104:6789] 2021-03-10T20:00:37.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2021-03-10T20:00:37.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2021-03-10T20:00:37.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2021-03-10T20:00:37.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2021-03-10T20:00:37.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:37.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2021-03-10T20:00:37.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2021-03-10T20:00:37.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:37.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2021-03-10T20:00:37.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2021-03-10T20:00:37.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2021-03-10T20:00:38.043 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2021-03-10T20:00:38.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T20:00:38.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z -v /var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-03-10T20:00:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:37 gibba004 bash[9376]: audit 2021-03-10T20:00:37.505452+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.104:0/650982586' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-03-10T20:00:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:37 gibba004 bash[9376]: audit 2021-03-10T20:00:37.507766+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.104:0/650982586' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-03-10T20:00:39.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:38 gibba004 bash[9376]: audit 2021-03-10T20:00:38.929623+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.104:0/2293186365' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:39.424 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Restarting the monitor... 2021-03-10T20:00:39.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a 2021-03-10T20:00:39.778 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:39 gibba004 systemd[1]: Stopping Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:00:39.779 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:39 gibba004 bash[9376]: debug 2021-03-10T20:00:39.510+0000 7f5969638700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:00:39.779 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:39 gibba004 bash[9376]: debug 2021-03-10T20:00:39.510+0000 7f5969638700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-03-10T20:00:40.124 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Setting mon public_network... 2021-03-10T20:00:40.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2021-03-10T20:00:40.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2021-03-10T20:00:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 docker[9723]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.a 2021-03-10T20:00:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T20:00:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 systemd[1]: Stopped Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:00:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 systemd[1]: Starting Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:00:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 docker[9759]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.a 2021-03-10T20:00:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:40 gibba004 systemd[1]: Started Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:00:41.435 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.234+0000 7fa81fac76c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:00:41.436 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.234+0000 7fa81fac76c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T20:00:41.436 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.234+0000 7fa81fac76c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:00:41.436 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 load: jerasure load: lrc load: isa 2021-03-10T20:00:41.436 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:00:41.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:00:41.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:00:41.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:00:41.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:00:41.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:00:41.438 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 1 rocksdb: do_open column families: [default] 2021-03-10T20:00:41.438 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T20:00:41.438 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:00:41.438 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T20:00:41.438 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: DB SUMMARY 2021-03-10T20:00:41.439 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:00:41.439 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:00:41.439 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2021-03-10T20:00:41.439 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-03-10T20:00:41.440 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69017 ; 2021-03-10T20:00:41.440 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:00:41.440 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:00:41.440 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:00:41.441 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.env: 0x55e6cadb91a0 2021-03-10T20:00:41.441 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.info_log: 0x55e6cd4429a0 2021-03-10T20:00:41.441 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:00:41.442 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:00:41.442 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:00:41.442 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:00:41.442 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:00:41.442 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:00:41.443 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:00:41.443 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:00:41.443 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:00:41.443 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:00:41.444 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:00:41.444 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:00:41.444 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:00:41.444 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:00:41.444 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.db_log_dir: 2021-03-10T20:00:41.445 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T20:00:41.445 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:00:41.445 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:00:41.445 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:00:41.445 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:00:41.446 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:00:41.446 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:00:41.446 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:00:41.446 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:00:41.447 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:00:41.447 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.write_buffer_manager: 0x55e6cdfdcae0 2021-03-10T20:00:41.447 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:00:41.447 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:00:41.447 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:00:41.448 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:00:41.448 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:00:41.448 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:00:41.448 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:00:41.449 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:00:41.449 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:00:41.449 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:00:41.449 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:00:41.449 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:00:41.450 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:00:41.450 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.row_cache: None 2021-03-10T20:00:41.450 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.wal_filter: None 2021-03-10T20:00:41.450 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:00:41.450 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:00:41.451 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:00:41.451 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:00:41.451 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:00:41.451 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:00:41.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:00:41.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:00:41.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:00:41.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:00:41.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:00:41.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:00:41.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:00:41.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:00:41.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:00:41.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:00:41.454 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:00:41.454 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:00:41.454 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:00:41.454 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:00:41.455 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:00:41.455 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Compression algorithms supported: 2021-03-10T20:00:41.455 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:00:41.455 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kZSTD supported: 0 2021-03-10T20:00:41.455 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:00:41.456 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:00:41.456 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:00:41.456 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:00:41.456 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:00:41.457 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:00:41.457 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:00:41.457 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-03-10T20:00:41.457 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T20:00:41.457 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:00:41.458 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.merge_operator: 2021-03-10T20:00:41.458 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:00:41.458 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:00:41.458 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:00:41.458 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:00:41.459 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e6cd362138) 2021-03-10T20:00:41.459 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cache_index_and_filter_blocks: 1 2021-03-10T20:00:41.459 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T20:00:41.459 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:00:41.460 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: pin_top_level_index_and_filter: 1 2021-03-10T20:00:41.460 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: index_type: 0 2021-03-10T20:00:41.460 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: data_block_index_type: 0 2021-03-10T20:00:41.461 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:00:41.461 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: hash_index_allow_collision: 1 2021-03-10T20:00:41.461 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: checksum: 1 2021-03-10T20:00:41.461 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: no_block_cache: 0 2021-03-10T20:00:41.462 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_cache: 0x55e6cd398610 2021-03-10T20:00:41.462 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_cache_name: BinnedLRUCache 2021-03-10T20:00:41.462 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_cache_options: 2021-03-10T20:00:41.462 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: capacity : 536870912 2021-03-10T20:00:41.462 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: num_shard_bits : 4 2021-03-10T20:00:41.463 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: strict_capacity_limit : 0 2021-03-10T20:00:41.463 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: high_pri_pool_ratio: 0.000 2021-03-10T20:00:41.463 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_cache_compressed: (nil) 2021-03-10T20:00:41.463 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: persistent_cache: (nil) 2021-03-10T20:00:41.464 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_size: 4096 2021-03-10T20:00:41.464 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_size_deviation: 10 2021-03-10T20:00:41.464 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_restart_interval: 16 2021-03-10T20:00:41.464 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: index_block_restart_interval: 1 2021-03-10T20:00:41.465 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: metadata_block_size: 4096 2021-03-10T20:00:41.465 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: partition_filters: 0 2021-03-10T20:00:41.465 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: use_delta_encoding: 1 2021-03-10T20:00:41.465 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:00:41.466 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: whole_key_filtering: 1 2021-03-10T20:00:41.466 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: verify_compression: 0 2021-03-10T20:00:41.466 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: read_amp_bytes_per_bit: 0 2021-03-10T20:00:41.466 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: format_version: 2 2021-03-10T20:00:41.466 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: enable_index_compression: 1 2021-03-10T20:00:41.467 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: block_align: 0 2021-03-10T20:00:41.467 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:00:41.467 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:00:41.467 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:00:41.468 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:00:41.468 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:00:41.468 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:00:41.468 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.num_levels: 7 2021-03-10T20:00:41.468 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:00:41.469 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:00:41.469 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:00:41.469 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:00:41.469 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:00:41.470 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:00:41.470 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:00:41.470 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:00:41.470 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:00:41.470 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:00:41.471 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:00:41.471 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:00:41.471 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:00:41.471 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:00:41.472 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:00:41.472 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:00:41.472 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:00:41.472 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:00:41.472 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:00:41.473 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:00:41.473 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:00:41.473 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:00:41.473 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:00:41.474 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:00:41.474 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:00:41.474 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:00:41.474 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:00:41.474 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:00:41.475 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:00:41.475 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:00:41.475 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:00:41.475 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:00:41.475 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:00:41.476 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:00:41.476 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:00:41.476 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:00:41.476 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:00:41.476 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:00:41.477 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:00:41.477 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:00:41.477 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:00:41.477 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:00:41.478 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:00:41.478 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:00:41.478 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:00:41.478 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:00:41.479 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:00:41.479 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:00:41.479 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:00:41.479 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:00:41.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:00:41.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:00:41.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:00:41.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:00:41.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:00:41.481 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:00:41.481 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:00:41.481 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:00:41.481 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: Options.ttl: 0 2021-03-10T20:00:41.481 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:00:41.482 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2021-03-10T20:00:41.482 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406441244723, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-03-10T20:00:41.482 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2021-03-10T20:00:41.482 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406441245387, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66112, "table_properties": {"data_size": 64407, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59461, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T20:00:41.483 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2021-03-10T20:00:41.483 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.238+0000 7fa81fac76c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406441245892, "job": 1, "event": "recovery_finished"} 2021-03-10T20:00:41.483 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 4 rocksdb: DB pointer 0x55e6cd433200 2021-03-10T20:00:41.483 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa806c14700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T20:00:41.483 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa806c14700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T20:00:41.484 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** DB Stats ** 2021-03-10T20:00:41.484 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:41.484 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:00:41.484 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:00:41.484 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:00:41.485 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:00:41.485 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:00:41.485 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:00:41.485 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** Compaction Stats [default] ** 2021-03-10T20:00:41.486 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:41.486 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:41.486 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: L0 2/0 66.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.486 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Sum 2/0 66.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.486 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.487 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** Compaction Stats [default] ** 2021-03-10T20:00:41.487 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:41.487 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:41.487 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.487 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:41.488 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:41.488 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:41.488 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:00:41.488 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:00:41.489 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:00:41.489 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Cumulative compaction: 0.00 GB write, 23.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:41.489 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Interval compaction: 0.00 GB write, 23.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:41.489 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:00:41.489 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:00:41.490 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** Compaction Stats [default] ** 2021-03-10T20:00:41.490 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:41.490 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:41.490 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: L0 2/0 66.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.490 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Sum 2/0 66.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.491 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:00:41.491 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** Compaction Stats [default] ** 2021-03-10T20:00:41.491 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:00:41.491 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:00:41.492 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.9 0.00 0.00 1 0.000 0 0 2021-03-10T20:00:41.492 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:00:41.492 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:41.492 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:00:41.492 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:00:41.493 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:00:41.493 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:00:41.493 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Cumulative compaction: 0.00 GB write, 23.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:41.493 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:00:41.493 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:00:41.494 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:00:41.494 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 starting mon.a rank 0 at public addrs [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] at bind addrs [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:41.494 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 1 mon.a@-1(???) e1 preinit fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:41.494 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).mds e1 new map 2021-03-10T20:00:41.495 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).mds e1 print_map 2021-03-10T20:00:41.495 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: e1 2021-03-10T20:00:41.495 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:00:41.495 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:00:41.495 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: legacy client fscid: -1 2021-03-10T20:00:41.496 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: 2021-03-10T20:00:41.496 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: No filesystems configured 2021-03-10T20:00:41.496 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T20:00:41.496 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T20:00:41.496 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-03-10T20:00:41.497 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T20:00:41.497 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: audit 2021-03-10T20:00:38.929623+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.104:0/2293186365' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:41.497 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-03-10T20:00:41.497 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expand map: {default=false} 2021-03-10T20:00:41.497 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta from 'false' to 'false' 2021-03-10T20:00:41.498 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expanded map: {default=false} 2021-03-10T20:00:41.498 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expand map: {default=info} 2021-03-10T20:00:41.498 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta from 'info' to 'info' 2021-03-10T20:00:41.498 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expanded map: {default=info} 2021-03-10T20:00:41.499 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T20:00:41.499 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T20:00:41.499 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T20:00:41.499 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expand map: {default=debug} 2021-03-10T20:00:41.499 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T20:00:41.500 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: debug 2021-03-10T20:00:41.242+0000 7fa81fac76c0 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T20:00:41.500 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cluster 2021-03-10T20:00:41.250790+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T20:00:41.500 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cluster 2021-03-10T20:00:41.250827+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0]} 2021-03-10T20:00:41.500 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cluster 2021-03-10T20:00:41.250850+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-03-10T20:00:41.500 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cluster 2021-03-10T20:00:41.250868+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T20:00:41.501 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:41 gibba004 bash[9777]: cluster 2021-03-10T20:00:41.251306+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T20:00:41.964 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Creating mgr... 2021-03-10T20:00:41.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T20:00:42.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y 2021-03-10T20:00:42.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y 2021-03-10T20:00:42.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service: Unit ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service not loaded. 2021-03-10T20:00:42.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y 2021-03-10T20:00:42.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c.target.wants/ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-37a23cfe-81db-11eb-9080-001a4aab830c@.service. 2021-03-10T20:00:42.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: systemctl start ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y 2021-03-10T20:00:42.234 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:42 gibba004 systemd[1]: Starting Ceph mgr.y for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:00:42.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T20:00:42.238 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-03-10T20:00:42.238 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2021-03-10T20:00:42.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for mgr to start... 2021-03-10T20:00:42.239 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for mgr... 2021-03-10T20:00:42.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T20:00:42.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T20:00:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:42 gibba004 bash[9777]: audit 2021-03-10T20:00:41.379811+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.2.104:0/3583315457' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2021-03-10T20:00:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:42 gibba004 bash[9777]: audit 2021-03-10T20:00:41.381782+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.2.104:0/3583315457' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2021-03-10T20:00:42.564 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:42 gibba004 docker[9994]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mgr.y 2021-03-10T20:00:42.564 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:42 gibba004 systemd[1]: Started Ceph mgr.y for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:00:43.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:43.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:43.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "37a23cfe-81db-11eb-9080-001a4aab830c", 2021-03-10T20:00:43.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T20:00:43.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T20:00:43.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T20:00:43.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T20:00:43.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T20:00:43.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T20:00:43.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T20:00:43.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:43.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T20:00:43.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T20:00:43.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:43.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2021-03-10T20:00:43.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T20:00:43.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:43.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T20:00:43.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T20:00:43.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T20:00:43.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:43.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T20:00:43.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T20:00:43.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T20:00:43.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T20:00:43.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T20:00:43.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T20:00:43.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T20:00:43.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T20:00:43.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T20:00:43.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T20:00:43.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T20:00:43.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T20:00:43.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T20:00:43.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T20:00:43.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T20:00:43.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T20:00:43.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:43.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T20:00:43.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T20:00:43.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T20:00:43.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T20:00:43.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T20:00:43.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T20:00:43.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T20:00:43.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T20:00:43.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:43.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:43.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T20:00:43.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:43.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T20:00:35.875353+0000", 2021-03-10T20:00:43.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:43.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:43.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T20:00:43.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:43 gibba004 bash[9777]: audit 2021-03-10T20:00:43.542065+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.2.104:0/1491780035' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T20:00:44.230 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2021-03-10T20:00:45.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T20:00:45.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T20:00:46.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:46.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:46.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "37a23cfe-81db-11eb-9080-001a4aab830c", 2021-03-10T20:00:46.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T20:00:46.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T20:00:46.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T20:00:46.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T20:00:46.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T20:00:46.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T20:00:46.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T20:00:46.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:46.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T20:00:46.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T20:00:46.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:46.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2021-03-10T20:00:46.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T20:00:46.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:46.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T20:00:46.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T20:00:46.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T20:00:46.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:46.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T20:00:46.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T20:00:46.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T20:00:46.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T20:00:46.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T20:00:46.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T20:00:46.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T20:00:46.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T20:00:46.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T20:00:46.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T20:00:46.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T20:00:46.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T20:00:46.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T20:00:46.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T20:00:46.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T20:00:46.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T20:00:46.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:46.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T20:00:46.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T20:00:46.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T20:00:46.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T20:00:46.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T20:00:46.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T20:00:46.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T20:00:46.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T20:00:46.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:46.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:46.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T20:00:46.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:46.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T20:00:35.875353+0000", 2021-03-10T20:00:46.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:46.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:46.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T20:00:46.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: cluster 2021-03-10T20:00:46.158552+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-03-10T20:00:46.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: cluster 2021-03-10T20:00:46.160741+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00223671s) 2021-03-10T20:00:46.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.161484+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:00:46.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.161565+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:00:46.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.161647+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:00:46.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.161938+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:00:46.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.162107+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:00:46.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: cluster 2021-03-10T20:00:46.163552+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-03-10T20:00:46.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.172278+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:00:46.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:46 gibba004 bash[9777]: audit 2021-03-10T20:00:46.239484+0000 mon.a (mon.0) 18 : audit [DBG] from='client.? 172.21.2.104:0/2217807097' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T20:00:46.838 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2021-03-10T20:00:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.241562+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-03-10T20:00:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: cluster 2021-03-10T20:00:46.241584+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-03-10T20:00:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.243578+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:00:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.247376+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"01c7d24f-46fb-4ba5-acfa-8740dd3cbc47"}]: dispatch 2021-03-10T20:00:47.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.249209+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"01c7d24f-46fb-4ba5-acfa-8740dd3cbc47"}]': finished 2021-03-10T20:00:47.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.249709+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"1a97b5fe-c214-4c5a-9c07-4d9923f44ecb"}]: dispatch 2021-03-10T20:00:47.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: audit 2021-03-10T20:00:46.251202+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"1a97b5fe-c214-4c5a-9c07-4d9923f44ecb"}]': finished 2021-03-10T20:00:47.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:47 gibba004 bash[9777]: cluster 2021-03-10T20:00:47.169677+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.01119s) 2021-03-10T20:00:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T20:00:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T20:00:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:48 gibba004 bash[9777]: audit 2021-03-10T20:00:47.247304+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.2.104:0/3440082700' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:00:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:48 gibba004 bash[9777]: cluster 2021-03-10T20:00:47.247439+0000 mon.a (mon.0) 28 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-03-10T20:00:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:48 gibba004 bash[9777]: audit 2021-03-10T20:00:47.260060+0000 mon.a (mon.0) 29 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T20:00:48.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:48 gibba004 bash[9777]: audit 2021-03-10T20:00:47.414388+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T20:00:48.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T20:00:48.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:48.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "37a23cfe-81db-11eb-9080-001a4aab830c", 2021-03-10T20:00:48.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T20:00:48.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T20:00:48.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T20:00:48.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T20:00:48.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T20:00:48.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T20:00:48.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T20:00:48.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:48.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T20:00:48.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T20:00:48.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:48.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2021-03-10T20:00:48.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T20:00:48.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:48.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T20:00:48.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T20:00:48.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T20:00:48.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2021-03-10T20:00:48.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T20:00:48.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T20:00:48.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T20:00:48.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T20:00:48.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T20:00:48.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T20:00:48.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T20:00:48.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T20:00:48.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T20:00:48.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T20:00:48.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T20:00:48.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T20:00:48.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T20:00:48.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T20:00:48.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T20:00:48.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T20:00:48.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:48.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T20:00:48.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T20:00:48.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T20:00:48.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T20:00:48.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T20:00:48.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T20:00:48.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T20:00:48.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T20:00:48.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:48.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:48.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T20:00:48.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T20:00:48.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T20:00:35.875353+0000", 2021-03-10T20:00:48.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T20:00:48.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:48.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T20:00:48.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:49.486 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Enabling cephadm module... 2021-03-10T20:00:49.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2021-03-10T20:00:49.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2021-03-10T20:00:49.508 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:49 gibba004 bash[9777]: cluster 2021-03-10T20:00:48.257520+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-03-10T20:00:49.508 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:49 gibba004 bash[9777]: audit 2021-03-10T20:00:48.948491+0000 mon.a (mon.0) 32 : audit [DBG] from='client.? 172.21.2.104:0/2514260817' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T20:00:51.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:50 gibba004 bash[9777]: audit 2021-03-10T20:00:50.594502+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.2.104:0/1594664605' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-03-10T20:00:51.063 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:50 gibba004 bash[10014]: ignoring --setuser ceph since I am not root 2021-03-10T20:00:51.063 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:50 gibba004 bash[10014]: ignoring --setgroup ceph since I am not root 2021-03-10T20:00:51.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T20:00:51.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T20:00:51.930 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:51 gibba004 bash[9777]: audit 2021-03-10T20:00:50.647701+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.2.104:0/1594664605' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-03-10T20:00:51.931 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:51 gibba004 bash[9777]: cluster 2021-03-10T20:00:50.647734+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 4s) 2021-03-10T20:00:52.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2021-03-10T20:00:52.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2021-03-10T20:00:52.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T20:00:52.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T20:00:52.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:00:52.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:00:52.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:6800", 2021-03-10T20:00:52.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1513196736 2021-03-10T20:00:52.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T20:00:52.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:6801", 2021-03-10T20:00:52.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1513196736 2021-03-10T20:00:52.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:00:52.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.104:6801/1513196736", 2021-03-10T20:00:52.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T20:00:46.158485+0000", 2021-03-10T20:00:52.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T20:00:52.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T20:00:52.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T20:00:52.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T20:00:52.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T20:00:52.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T20:00:52.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T20:00:52.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T20:00:52.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T20:00:52.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:52.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:52.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:52.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:00:52.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:00:52.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:00:52.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T20:00:52.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:52.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:52.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:52.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:52.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:52.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:52.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:52.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:52.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:52.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T20:00:52.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T20:00:52.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T20:00:52.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T20:00:52.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T20:00:52.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T20:00:52.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T20:00:52.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T20:00:52.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T20:00:52.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T20:00:52.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T20:00:52.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T20:00:52.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T20:00:52.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T20:00:52.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T20:00:52.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T20:00:52.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T20:00:52.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T20:00:52.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T20:00:52.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T20:00:52.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T20:00:52.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T20:00:52.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T20:00:52.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T20:00:52.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T20:00:52.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T20:00:52.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T20:00:52.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:52.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:52.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:52.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T20:00:52.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T20:00:52.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T20:00:52.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T20:00:52.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T20:00:52.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T20:00:52.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T20:00:52.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T20:00:52.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T20:00:52.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T20:00:52.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:00:52.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:00:52.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T20:00:52.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T20:00:52.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T20:00:52.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T20:00:52.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T20:00:52.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T20:00:52.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:00:52.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T20:00:52.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T20:00:52.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T20:00:52.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T20:00:52.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T20:00:52.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T20:00:52.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T20:00:52.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T20:00:52.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T20:00:52.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T20:00:52.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T20:00:52.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:00:52.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T20:00:52.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T20:00:52.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T20:00:52.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T20:00:52.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T20:00:52.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T20:00:52.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T20:00:52.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T20:00:52.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T20:00:52.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T20:00:52.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T20:00:52.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T20:00:52.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:00:52.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T20:00:52.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T20:00:52.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T20:00:52.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T20:00:52.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T20:00:52.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:52.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:52.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:52.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:52.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:52.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:52.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:52.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:52.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:52.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T20:00:52.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T20:00:52.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:00:52.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:00:52.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T20:00:52.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T20:00:52.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T20:00:52.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T20:00:52.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T20:00:52.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T20:00:52.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T20:00:52.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T20:00:52.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T20:00:52.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T20:00:52.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T20:00:52.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:00:52.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:00:52.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:00:52.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T20:00:52.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T20:00:52.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T20:00:52.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:00:52.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T20:00:52.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T20:00:52.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T20:00:52.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T20:00:52.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T20:00:52.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:00:52.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:00:52.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T20:00:52.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T20:00:52.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:52.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:52.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:52.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T20:00:52.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T20:00:52.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T20:00:52.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T20:00:52.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T20:00:52.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T20:00:52.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T20:00:52.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T20:00:52.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T20:00:52.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T20:00:52.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:00:52.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T20:00:52.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T20:00:52.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T20:00:52.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T20:00:52.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T20:00:52.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T20:00:52.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T20:00:52.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:00:52.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T20:00:52.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:52.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:52.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:52.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:52.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T20:00:52.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:52.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:52.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:52.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:52.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:52.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T20:00:52.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T20:00:52.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T20:00:52.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T20:00:52.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T20:00:52.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T20:00:52.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T20:00:52.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T20:00:52.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:52.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T20:00:52.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T20:00:52.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T20:00:52.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T20:00:52.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T20:00:52.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T20:00:52.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T20:00:52.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T20:00:52.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T20:00:52.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T20:00:52.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T20:00:52.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:52.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:52.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:52.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:52.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:52.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:52.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:52.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:52.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:52.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:52.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:52.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:52.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T20:00:52.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T20:00:52.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T20:00:52.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T20:00:52.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T20:00:52.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T20:00:52.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:52.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T20:00:52.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T20:00:52.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:52.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:52.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T20:00:52.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:52.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:52.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:52.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T20:00:52.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T20:00:52.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T20:00:52.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T20:00:52.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T20:00:52.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T20:00:52.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T20:00:52.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T20:00:52.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T20:00:52.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T20:00:52.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T20:00:52.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T20:00:52.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T20:00:52.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T20:00:52.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T20:00:52.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T20:00:52.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T20:00:52.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T20:00:52.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T20:00:52.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T20:00:52.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T20:00:52.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T20:00:52.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T20:00:52.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T20:00:52.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:00:52.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T20:00:52.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T20:00:52.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T20:00:52.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T20:00:52.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T20:00:52.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T20:00:52.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:00:52.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T20:00:52.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T20:00:52.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T20:00:52.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T20:00:52.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T20:00:52.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T20:00:52.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T20:00:52.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T20:00:52.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T20:00:52.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T20:00:52.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T20:00:52.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T20:00:52.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T20:00:52.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T20:00:52.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T20:00:52.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T20:00:52.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T20:00:52.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T20:00:52.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T20:00:52.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T20:00:52.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T20:00:52.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T20:00:52.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T20:00:52.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T20:00:52.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T20:00:52.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T20:00:52.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T20:00:52.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:00:52.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T20:00:52.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T20:00:52.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T20:00:52.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T20:00:52.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T20:00:52.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T20:00:52.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T20:00:52.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T20:00:52.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T20:00:52.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T20:00:52.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:00:52.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T20:00:52.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T20:00:52.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T20:00:52.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T20:00:52.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T20:00:52.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T20:00:52.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T20:00:52.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T20:00:52.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T20:00:52.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T20:00:52.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T20:00:52.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T20:00:52.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:52.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T20:00:52.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T20:00:52.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T20:00:52.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T20:00:52.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:00:52.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T20:00:52.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T20:00:52.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:00:52.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T20:00:52.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T20:00:52.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:00:52.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T20:00:52.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T20:00:52.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T20:00:52.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T20:00:52.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T20:00:52.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T20:00:52.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T20:00:52.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:52.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T20:00:52.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T20:00:52.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T20:00:52.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:52.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:52.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:52.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:52.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:52.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:52.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:52.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:52.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:52.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:52.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:52.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:52.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:52.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:52.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:52.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:52.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:52.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:52.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:52.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:52.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:52.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:52.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:52.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:52.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:52.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:52.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:52.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T20:00:53.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T20:00:53.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:00:53.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:00:53.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T20:00:53.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:00:53.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:00:53.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T20:00:53.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T20:00:53.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T20:00:53.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T20:00:53.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T20:00:53.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T20:00:53.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T20:00:53.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T20:00:53.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T20:00:53.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T20:00:53.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T20:00:53.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T20:00:53.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T20:00:53.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T20:00:53.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T20:00:53.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T20:00:53.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T20:00:53.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T20:00:53.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T20:00:53.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T20:00:53.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T20:00:53.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T20:00:53.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T20:00:53.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T20:00:53.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T20:00:53.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T20:00:53.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T20:00:53.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T20:00:53.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T20:00:53.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T20:00:53.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T20:00:53.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T20:00:53.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T20:00:53.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T20:00:53.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T20:00:53.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T20:00:53.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T20:00:53.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T20:00:53.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T20:00:53.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T20:00:53.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T20:00:53.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T20:00:53.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:00:53.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:00:53.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:00:53.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T20:00:53.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T20:00:53.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T20:00:53.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T20:00:53.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T20:00:53.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T20:00:53.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T20:00:53.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T20:00:53.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T20:00:53.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T20:00:53.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T20:00:53.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T20:00:53.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:00:53.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:00:53.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:00:53.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T20:00:53.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T20:00:53.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T20:00:53.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T20:00:53.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T20:00:53.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T20:00:53.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T20:00:53.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T20:00:53.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T20:00:53.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T20:00:53.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T20:00:53.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:00:53.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:00:53.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T20:00:53.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T20:00:53.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T20:00:53.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T20:00:53.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T20:00:53.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T20:00:53.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T20:00:53.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T20:00:53.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T20:00:53.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T20:00:53.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T20:00:53.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:00:53.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T20:00:53.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T20:00:53.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T20:00:53.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T20:00:53.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T20:00:53.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T20:00:53.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T20:00:53.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T20:00:53.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T20:00:53.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T20:00:53.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T20:00:53.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T20:00:53.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T20:00:53.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T20:00:53.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:00:53.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T20:00:53.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T20:00:53.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T20:00:53.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T20:00:53.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T20:00:53.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T20:00:53.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T20:00:53.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T20:00:53.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T20:00:53.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T20:00:53.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T20:00:53.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T20:00:53.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T20:00:53.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T20:00:53.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T20:00:53.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T20:00:53.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T20:00:53.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T20:00:53.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T20:00:53.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T20:00:53.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T20:00:53.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T20:00:53.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T20:00:53.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T20:00:53.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T20:00:53.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T20:00:53.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T20:00:53.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T20:00:53.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T20:00:53.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T20:00:53.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T20:00:53.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T20:00:53.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T20:00:53.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T20:00:53.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:00:53.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:00:53.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:00:53.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T20:00:53.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T20:00:53.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T20:00:53.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T20:00:53.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T20:00:53.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T20:00:53.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T20:00:53.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:00:53.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T20:00:53.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T20:00:53.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T20:00:53.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T20:00:53.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T20:00:53.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T20:00:53.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T20:00:53.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T20:00:53.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:00:53.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:00:53.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:00:53.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:00:53.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T20:00:53.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T20:00:53.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T20:00:53.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T20:00:53.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T20:00:53.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T20:00:53.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T20:00:53.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T20:00:53.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:00:53.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:00:53.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:00:53.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:00:53.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T20:00:53.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.390 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.390 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.390 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.390 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.390 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.391 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.391 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.391 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.391 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.392 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.392 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.392 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.392 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.392 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.393 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.393 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.393 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.393 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.393 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.394 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.394 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.394 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.394 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.394 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.395 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.395 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.395 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.395 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.395 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.396 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.396 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.396 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.396 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.397 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.397 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.397 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.397 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.397 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.398 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.398 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.398 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.398 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.398 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.399 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.399 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.399 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.399 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.399 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.400 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.400 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.400 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.400 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.400 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.401 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.401 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.401 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.401 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.401 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.402 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.402 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.402 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.402 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.403 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.403 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.403 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T20:00:53.403 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.403 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.404 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.404 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.404 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.404 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.404 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.405 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.405 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.405 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.405 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.405 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.406 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.406 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.406 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.406 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.406 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.407 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.407 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.407 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.407 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.407 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.408 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.408 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.408 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.408 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.408 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.409 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.409 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.409 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.409 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.409 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.410 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.410 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.410 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.410 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.411 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.411 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.411 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.411 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.411 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.412 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.412 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.412 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.412 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.412 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.413 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.413 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.413 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.413 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.413 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.414 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.414 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.414 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.414 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.414 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.415 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.415 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.415 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.415 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.416 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.416 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.416 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.416 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.416 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.417 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.417 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.417 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.417 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.417 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.418 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.418 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.418 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.418 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T20:00:53.418 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T20:00:53.419 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.419 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.419 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.419 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.420 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.421 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.421 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.421 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.421 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T20:00:53.421 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T20:00:53.422 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.422 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.422 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.422 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T20:00:53.422 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.423 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T20:00:53.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T20:00:53.424 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.425 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.425 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.425 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.425 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.425 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.426 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.426 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.426 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.426 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.427 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.427 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.427 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T20:00:53.427 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T20:00:53.427 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.428 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.428 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.428 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.428 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.428 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.429 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.429 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.429 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.429 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.429 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.430 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.430 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T20:00:53.430 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T20:00:53.430 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:00:53.430 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.431 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.431 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.431 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.431 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.431 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.432 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.432 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.432 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.432 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.433 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.433 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T20:00:53.433 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T20:00:53.433 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.433 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.434 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.434 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.434 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.434 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.434 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.435 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.435 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.435 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.435 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.435 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.436 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T20:00:53.436 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T20:00:53.436 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.436 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.436 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.437 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.437 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.437 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.437 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.437 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.438 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.438 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.438 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.438 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.439 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T20:00:53.439 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T20:00:53.439 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.439 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.439 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.440 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.440 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.440 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.440 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.440 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.441 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.441 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.441 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.441 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.441 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T20:00:53.442 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T20:00:53.442 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.442 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.442 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.443 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.443 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.443 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.443 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.443 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.444 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.444 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.444 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.444 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.444 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T20:00:53.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T20:00:53.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T20:00:53.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T20:00:53.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T20:00:53.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T20:00:53.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T20:00:53.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T20:00:53.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T20:00:53.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:00:53.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:00:53.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T20:00:53.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T20:00:53.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T20:00:53.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T20:00:53.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T20:00:53.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T20:00:53.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T20:00:53.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T20:00:53.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T20:00:53.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:00:53.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T20:00:53.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T20:00:53.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T20:00:53.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T20:00:53.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T20:00:53.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T20:00:53.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T20:00:53.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T20:00:53.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T20:00:53.509 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.509 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.509 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.509 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.509 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T20:00:53.510 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T20:00:53.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.511 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:00:53.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:00:53.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T20:00:53.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T20:00:53.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T20:00:53.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T20:00:53.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T20:00:53.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.520 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.520 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T20:00:53.520 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T20:00:53.520 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.521 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.521 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.521 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.521 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T20:00:53.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T20:00:53.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T20:00:53.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T20:00:53.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T20:00:53.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T20:00:53.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T20:00:53.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T20:00:53.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T20:00:53.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T20:00:53.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:00:53.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:00:53.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:00:53.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T20:00:53.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T20:00:53.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T20:00:53.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T20:00:53.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T20:00:53.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:00:53.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:00:53.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:00:53.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:00:53.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:00:53.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:00:53.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:00:53.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:00:53.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:00:53.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:00:53.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:00:53.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:00:53.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:00:53.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:00:53.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:00:53.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:00:53.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:00:53.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:00:53.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:00:53.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:00:53.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:00:53.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:00:53.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:00:53.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:00:53.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T20:00:53.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T20:00:53.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:00:53.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T20:00:53.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T20:00:53.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:00:53.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T20:00:53.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T20:00:53.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T20:00:53.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:00:53.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:00:53.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:00:53.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T20:00:53.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:00:53.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:00:53.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:00:53.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:00:53.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:00:53.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:00:53.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:00:53.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T20:00:53.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T20:00:53.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T20:00:53.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T20:00:53.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T20:00:53.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T20:00:53.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T20:00:53.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T20:00:53.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T20:00:53.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T20:00:53.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T20:00:53.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T20:00:53.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T20:00:53.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T20:00:53.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T20:00:53.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T20:00:53.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T20:00:53.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T20:00:53.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T20:00:53.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T20:00:53.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T20:00:53.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T20:00:53.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T20:00:53.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:00:53.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2021-03-10T20:00:53.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T20:00:53.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:00:53.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:00:53.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:00:53.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2575069528 2021-03-10T20:00:53.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:00:53.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:00:53.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:00:53.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:00:53.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 460307678 2021-03-10T20:00:53.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:00:53.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:00:53.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:00:53.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:53.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:00:53.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:00:53.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2571685211 2021-03-10T20:00:53.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:00:53.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:00:53.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:53.649 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:52 gibba004 bash[9777]: audit 2021-03-10T20:00:52.254533+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.2.104:0/272430221' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T20:00:53.650 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T20:00:53.650 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2021-03-10T20:00:53.650 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T20:00:53.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T20:00:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:53 gibba004 bash[9777]: cluster 2021-03-10T20:00:53.459338+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2021-03-10T20:00:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:53 gibba004 bash[9777]: cluster 2021-03-10T20:00:53.459902+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2021-03-10T20:00:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:53 gibba004 bash[9777]: cluster 2021-03-10T20:00:53.461374+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-03-10T20:00:54.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:00:54.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2021-03-10T20:00:54.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T20:00:54.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:00:54.734 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: cluster 2021-03-10T20:00:53.653865+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.194021s) 2021-03-10T20:00:54.735 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.655084+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:00:54.735 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.655740+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:00:54.735 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.655869+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:00:54.735 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.655968+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:00:54.736 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.656342+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:00:54.736 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.656838+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:00:54.736 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.657139+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:00:54.736 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: cluster 2021-03-10T20:00:53.658609+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2021-03-10T20:00:54.736 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.675019+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T20:00:54.737 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:54 gibba004 bash[9777]: audit 2021-03-10T20:00:53.831286+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T20:00:55.298 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2021-03-10T20:00:55.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2021-03-10T20:00:55.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2021-03-10T20:00:56.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:55 gibba004 bash[9777]: cluster 2021-03-10T20:00:54.662962+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.20312s) 2021-03-10T20:00:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:56 gibba004 bash[9777]: cluster 2021-03-10T20:00:55.674814+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-03-10T20:00:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:56 gibba004 bash[9777]: audit 2021-03-10T20:00:56.400509+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2021-03-10T20:00:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:56 gibba004 bash[9777]: audit 2021-03-10T20:00:56.402585+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2021-03-10T20:00:56.972 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Generating ssh key... 2021-03-10T20:00:56.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2021-03-10T20:00:56.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2021-03-10T20:00:58.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:57 gibba004 bash[9777]: audit 2021-03-10T20:00:56.399546+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:58.564 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: Generating public/private rsa key pair. 2021-03-10T20:00:58.564 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: Your identification has been saved in /tmp/tmp5p5z9rvs/key. 2021-03-10T20:00:58.564 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: Your public key has been saved in /tmp/tmp5p5z9rvs/key.pub. 2021-03-10T20:00:58.565 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: The key fingerprint is: 2021-03-10T20:00:58.565 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: SHA256:EEb7hK7/hWRyDfxFPOwSpcIkIcqKfch+/IcapFnJcLM ceph-37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:00:58.565 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: The key's randomart image is: 2021-03-10T20:00:58.565 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: +---[RSA 3072]----+ 2021-03-10T20:00:58.565 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | ..*.. +o | 2021-03-10T20:00:58.566 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | . . o O .o+ | 2021-03-10T20:00:58.566 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | + o + * .o.. | 2021-03-10T20:00:58.566 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: |.+ = = + =... | 2021-03-10T20:00:58.566 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: |o + E o S o. | 2021-03-10T20:00:58.566 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | . B . = . | 2021-03-10T20:00:58.567 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | + = .. . | 2021-03-10T20:00:58.567 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | . +. .. | 2021-03-10T20:00:58.567 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: | ..oo. | 2021-03-10T20:00:58.567 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[10014]: +----[SHA256]-----+ 2021-03-10T20:00:58.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2021-03-10T20:00:58.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2021-03-10T20:00:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: audit 2021-03-10T20:00:58.029928+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: cephadm 2021-03-10T20:00:58.030095+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2021-03-10T20:00:59.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: audit 2021-03-10T20:00:58.133369+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAtGR28oN0OAtFMwto8d/QKctwY2mlufPiqsiIxRvmtJLkejRu6Yxv\nFYh8wXKx3eKqzEFY5p3oFAOJs1//egoicOgPXIH76ijsqOJ40Y4IujZvarDtKQ8sG/unpH\nl44juV+YRMgcTzt0dNHeVucoIgcC8b76MD8dFxPAU62PDewxBkYh7WzjW4gLv6MCGOaIPT\nuZOzvdDKngNuAuFaMVZLbLnYK6oB0rYzPygSjlxCjWtq9ae0klYNJQp/sL+5BeWdmEFhHu\nA6OhotNefF54jbGYy4oNziBUs+j1wuGy8pCrR5JrLyzRyToFI34BArh/zxMfifLLq1/Vf5\nwl/Nre7DDMY3CwQBX5T4L9xepBDktFujU2Bs4hG9eJQGeyoQ6gcVsUeVc03zfDoEHBxY6/\n3G9yiVDi8+flcQh9zTuYZcOUMz6DwOQbxDNqv4loT8fIwU2cfZzteoZ94odLZ4pgpXLvK2\nFVa91f0chTRzQuf07wIXus5JyoocMHc3Kf5UhRr9AAAFoMo5zR3KOc0dAAAAB3NzaC1yc2\nEAAAGBALRkdvKDdDgLRTMLaPHf0CnLcGNppbnz4qrIiMUb5rSS5Ho0bumMbxWIfMFysd3i\nqsxBWOad6BQDibNf/3oKInDoD1yB++oo7KjieNGOCLo2b2qw7SkPLBv7p6R5eOI7lfmETI\nHE87dHTR3lbnKCIHAvG++jA/HRcTwFOtjw3sMQZGIe1s41uIC7+jAhjmiD07mTs73Qyp4D\nbgLhWjFWS2y52CuqAdK2Mz8oEo5cQo1ravWntJJWDSUKf7C/uQXlnZhBYR7gOjoaLTXnxe\neI2xmMuKDc4gVLPo9cLhsvKQq0eSay8s0ck6BSN+AQK4f88TH4nyy6tf1X+cJfza3uwwzG\nNwsEAV+U+C/cXqQQ5LRbo1NgbOIRvXiUBnsqEOoHFbFHlXNN83w6BBwcWOv9xvcolQ4vPn\n5XEIfc07mGXDlDM+g8DkG8Qzar+JaE/HyMFNnH2c7XqGfeKHS2eKYKVy7ythVWvdX9HIU0\nc0Ln9O8CF7rOScqKHDB3Nyn+VIUa/QAAAAMBAAEAAAGAPf7E7kWFHHmrF4bVU0Li7GoxPs\nkhHo4VmTH/5xXWrLpK8UCx2WvdBV552ZXMUQBESJwwrFkaWD57BX15dHylJ35pQRae9/OG\nmefzM7mHgE+S7OzPJKxFMXzEOX9RrxZhTXZNQM/qHlPPyfV+hrX35fYauLmicmnTa5g0iD\ngHpqwsg5grpITL2to/emkd4wdjLUT4ocRuze1J0o2WDJymoUAhbagopjzd0de4wNouOSHw\niWpQYXZXYCKCjcDmGoO1mA1DNFdp+gUCzg9BguxJKNZqY+jhNyc91K/neNZTOv0bUG6fti\n/8eJsdjdld01kE5U5oj1sQLM6ZHEyh0y2xg76N8a+Zt4NRRW3ybuiJFurGRzta+mwj0umQ\nKMhfHJSokGLlPask8/SWnpO/lKV/tRm6PqdDXWYxiC/Nhf+O+nWfPHJrNpFBP9B57W2mSi\nPHzgi+gW210I5xvN+FnR86l8C2BxcNtrM+VNIqvcSQF59LKHWIqnbGMTT/lE7dAsahAAAA\nwQDNgl4ZQRfd9mAQRCAjIXhSBW0/+K9oa1cSDwsgYzjAOglhs/QdFaehGnkmVlq01YJWXP\n98rfFYP7JUxanxOzwDnIg4FKmfyFvy4Z/i09uSYa3bqyDO9hSJm70ZuydXN95YTjt97/Ms\nHwtAKBqwczlhZFwftxK+i8dgHTbGD/pE0bo3XsYY4EAidvdTTp0BZZsqEb4M6aW+rCSzA3\nQMroS/K4YAE8yOHIGMEEpbXivGMHG7v2hBoMjFIfDHyVbecbEAAADBAO5NkrmZfCchC3lk\n0CpN+7x3kKSOwiKmFi/OAtJNNY09QfO8nqLCpZD+Vufj3NKbPhtxuQoLUXIdBeff9bB9AT\nsaZIq37SVFF4WJqyBR8/nlon58YINxV/e7eMjbUUIOhKXo3zpOJTcB7lh3kFIk8wewXZtT\nVM8jVCPjynwJvbowEBjF3X+J6OcjsCheiGqwIjIcJ9pc5y97BfDOt4F2I6DXBOHjewecHt\n/ayo09UckfUJ1Lae/VGzfXl6JNKWDI5QAAAMEAwcnxFvHygzyjLGNSR8knNStlrWjbONRc\njl08Z7LWb0P5OYKEcI1XyuKltOi3c2/b6Vq4YMV4njP2mvRBJuEmIbvOf17OTUgg2le0Ms\nA/WrPd9czNWMhysuXobbrDMQnAJTBL8VHilKDXIoNJJdIBEEpFSc9gMRl+Ajs8Y+F4qIJL\nAvFkYkLQJJJG1xCN0+9/kDdPlx2Mq+YJGM91nmogiiwKCof46uWlF2dqw8qOGIPN/p8bRt\nEjkeqwDY7CcOA5AAAAKWNlcGgtMzdhMjNjZmUtODFkYi0xMWViLTkwODAtMDAxYTRhYWI4\nMzBjAQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:00:59.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: audit 2021-03-10T20:00:58.135051+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAtGR28oN0OAtFMwto8d/QKctwY2mlufPiqsiIxRvmtJLkejRu6Yxv\nFYh8wXKx3eKqzEFY5p3oFAOJs1//egoicOgPXIH76ijsqOJ40Y4IujZvarDtKQ8sG/unpH\nl44juV+YRMgcTzt0dNHeVucoIgcC8b76MD8dFxPAU62PDewxBkYh7WzjW4gLv6MCGOaIPT\nuZOzvdDKngNuAuFaMVZLbLnYK6oB0rYzPygSjlxCjWtq9ae0klYNJQp/sL+5BeWdmEFhHu\nA6OhotNefF54jbGYy4oNziBUs+j1wuGy8pCrR5JrLyzRyToFI34BArh/zxMfifLLq1/Vf5\nwl/Nre7DDMY3CwQBX5T4L9xepBDktFujU2Bs4hG9eJQGeyoQ6gcVsUeVc03zfDoEHBxY6/\n3G9yiVDi8+flcQh9zTuYZcOUMz6DwOQbxDNqv4loT8fIwU2cfZzteoZ94odLZ4pgpXLvK2\nFVa91f0chTRzQuf07wIXus5JyoocMHc3Kf5UhRr9AAAFoMo5zR3KOc0dAAAAB3NzaC1yc2\nEAAAGBALRkdvKDdDgLRTMLaPHf0CnLcGNppbnz4qrIiMUb5rSS5Ho0bumMbxWIfMFysd3i\nqsxBWOad6BQDibNf/3oKInDoD1yB++oo7KjieNGOCLo2b2qw7SkPLBv7p6R5eOI7lfmETI\nHE87dHTR3lbnKCIHAvG++jA/HRcTwFOtjw3sMQZGIe1s41uIC7+jAhjmiD07mTs73Qyp4D\nbgLhWjFWS2y52CuqAdK2Mz8oEo5cQo1ravWntJJWDSUKf7C/uQXlnZhBYR7gOjoaLTXnxe\neI2xmMuKDc4gVLPo9cLhsvKQq0eSay8s0ck6BSN+AQK4f88TH4nyy6tf1X+cJfza3uwwzG\nNwsEAV+U+C/cXqQQ5LRbo1NgbOIRvXiUBnsqEOoHFbFHlXNN83w6BBwcWOv9xvcolQ4vPn\n5XEIfc07mGXDlDM+g8DkG8Qzar+JaE/HyMFNnH2c7XqGfeKHS2eKYKVy7ythVWvdX9HIU0\nc0Ln9O8CF7rOScqKHDB3Nyn+VIUa/QAAAAMBAAEAAAGAPf7E7kWFHHmrF4bVU0Li7GoxPs\nkhHo4VmTH/5xXWrLpK8UCx2WvdBV552ZXMUQBESJwwrFkaWD57BX15dHylJ35pQRae9/OG\nmefzM7mHgE+S7OzPJKxFMXzEOX9RrxZhTXZNQM/qHlPPyfV+hrX35fYauLmicmnTa5g0iD\ngHpqwsg5grpITL2to/emkd4wdjLUT4ocRuze1J0o2WDJymoUAhbagopjzd0de4wNouOSHw\niWpQYXZXYCKCjcDmGoO1mA1DNFdp+gUCzg9BguxJKNZqY+jhNyc91K/neNZTOv0bUG6fti\n/8eJsdjdld01kE5U5oj1sQLM6ZHEyh0y2xg76N8a+Zt4NRRW3ybuiJFurGRzta+mwj0umQ\nKMhfHJSokGLlPask8/SWnpO/lKV/tRm6PqdDXWYxiC/Nhf+O+nWfPHJrNpFBP9B57W2mSi\nPHzgi+gW210I5xvN+FnR86l8C2BxcNtrM+VNIqvcSQF59LKHWIqnbGMTT/lE7dAsahAAAA\nwQDNgl4ZQRfd9mAQRCAjIXhSBW0/+K9oa1cSDwsgYzjAOglhs/QdFaehGnkmVlq01YJWXP\n98rfFYP7JUxanxOzwDnIg4FKmfyFvy4Z/i09uSYa3bqyDO9hSJm70ZuydXN95YTjt97/Ms\nHwtAKBqwczlhZFwftxK+i8dgHTbGD/pE0bo3XsYY4EAidvdTTp0BZZsqEb4M6aW+rCSzA3\nQMroS/K4YAE8yOHIGMEEpbXivGMHG7v2hBoMjFIfDHyVbecbEAAADBAO5NkrmZfCchC3lk\n0CpN+7x3kKSOwiKmFi/OAtJNNY09QfO8nqLCpZD+Vufj3NKbPhtxuQoLUXIdBeff9bB9AT\nsaZIq37SVFF4WJqyBR8/nlon58YINxV/e7eMjbUUIOhKXo3zpOJTcB7lh3kFIk8wewXZtT\nVM8jVCPjynwJvbowEBjF3X+J6OcjsCheiGqwIjIcJ9pc5y97BfDOt4F2I6DXBOHjewecHt\n/ayo09UckfUJ1Lae/VGzfXl6JNKWDI5QAAAMEAwcnxFvHygzyjLGNSR8knNStlrWjbONRc\njl08Z7LWb0P5OYKEcI1XyuKltOi3c2/b6Vq4YMV4njP2mvRBJuEmIbvOf17OTUgg2le0Ms\nA/WrPd9czNWMhysuXobbrDMQnAJTBL8VHilKDXIoNJJdIBEEpFSc9gMRl+Ajs8Y+F4qIJL\nAvFkYkLQJJJG1xCN0+9/kDdPlx2Mq+YJGM91nmogiiwKCof46uWlF2dqw8qOGIPN/p8bRt\nEjkeqwDY7CcOA5AAAAKWNlcGgtMzdhMjNjZmUtODFkYi0xMWViLTkwODAtMDAxYTRhYWI4\nMzBjAQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2021-03-10T20:00:59.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: audit 2021-03-10T20:00:58.135599+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c\n"}]: dispatch 2021-03-10T20:00:59.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:00:58 gibba004 bash[9777]: audit 2021-03-10T20:00:58.136803+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c\n"}]': finished 2021-03-10T20:00:59.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:01:00.233 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-03-10T20:01:00.233 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2021-03-10T20:01:00.234 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Adding host gibba004... 2021-03-10T20:01:00.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'gibba004'] 2021-03-10T20:01:00.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add gibba004 2021-03-10T20:01:01.031 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:00 gibba004 bash[9777]: audit 2021-03-10T20:00:59.758389+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:01.563 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:01:01 gibba004 bash[10014]: Warning: Permanently added 'gibba004,172.21.2.104' (ECDSA) to the list of known hosts. 2021-03-10T20:01:02.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'gibba004' 2021-03-10T20:01:02.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.299355+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba004", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:02.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.637320+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba004\": {\"hostname\": \"gibba004\", \"addr\": \"gibba004\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T20:01:02.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.639010+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba004\": {\"hostname\": \"gibba004\", \"addr\": \"gibba004\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T20:01:02.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: cephadm 2021-03-10T20:01:01.639403+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host gibba004 2021-03-10T20:01:02.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.752385+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:02.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.754114+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:02.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:01.754785+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:02.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:02.082982+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:02.081513\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:02.082544\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:02.082608\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:02.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:02.084808+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:02.081513\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:02.082544\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:02.082608\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:02.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:02 gibba004 bash[9777]: audit 2021-03-10T20:01:02.085352+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.2.104:0/596247155' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:03.206 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Enabling the dashboard module... 2021-03-10T20:01:03.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2021-03-10T20:01:03.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2021-03-10T20:01:05.401 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:05 gibba004 bash[9777]: audit 2021-03-10T20:01:05.021875+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.2.104:0/2578708328' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-03-10T20:01:05.401 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:01:05 gibba004 bash[10014]: ignoring --setuser ceph since I am not root 2021-03-10T20:01:05.402 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:01:05 gibba004 bash[10014]: ignoring --setgroup ceph since I am not root 2021-03-10T20:01:05.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T20:01:05.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T20:01:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:06 gibba004 bash[9777]: audit 2021-03-10T20:01:05.075065+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.2.104:0/2578708328' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-03-10T20:01:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:06 gibba004 bash[9777]: cluster 2021-03-10T20:01:05.075094+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 11s) 2021-03-10T20:01:07.445 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2021-03-10T20:01:07.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2021-03-10T20:01:07.446 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T20:01:07.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T20:01:07.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:01:07.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:01:07.447 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:6800", 2021-03-10T20:01:07.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2454854716 2021-03-10T20:01:07.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T20:01:07.448 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:6801", 2021-03-10T20:01:07.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2454854716 2021-03-10T20:01:07.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:01:07.449 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.104:6801/2454854716", 2021-03-10T20:01:07.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T20:00:53.459837+0000", 2021-03-10T20:01:07.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T20:01:07.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T20:01:07.450 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T20:01:07.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T20:01:07.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T20:01:07.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2021-03-10T20:01:07.451 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T20:01:07.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T20:01:07.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T20:01:07.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.452 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T20:01:07.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:01:07.453 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:01:07.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.454 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:01:07.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.455 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T20:01:07.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.456 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.458 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.459 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.460 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.461 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.462 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.463 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.464 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.465 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.466 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.467 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.468 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.469 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.470 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.471 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T20:01:07.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T20:01:07.472 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.473 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T20:01:07.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T20:01:07.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T20:01:07.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.476 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T20:01:07.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T20:01:07.477 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.478 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T20:01:07.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T20:01:07.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.479 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.480 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T20:01:07.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.481 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T20:01:07.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T20:01:07.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.482 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.483 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T20:01:07.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.484 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T20:01:07.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T20:01:07.485 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T20:01:07.486 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T20:01:07.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.487 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T20:01:07.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T20:01:07.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.489 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T20:01:07.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.490 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T20:01:07.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T20:01:07.491 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.492 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T20:01:07.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.493 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T20:01:07.494 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T20:01:07.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.495 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.496 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T20:01:07.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.497 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T20:01:07.498 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T20:01:07.499 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T20:01:07.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.500 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T20:01:07.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.501 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T20:01:07.502 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T20:01:07.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T20:01:07.503 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T20:01:07.504 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T20:01:07.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.505 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T20:01:07.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T20:01:07.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:01:07.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.506 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:01:07.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T20:01:07.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T20:01:07.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.507 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T20:01:07.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T20:01:07.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.508 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.512 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T20:01:07.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T20:01:07.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:01:07.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.513 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T20:01:07.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T20:01:07.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T20:01:07.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.514 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T20:01:07.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.515 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T20:01:07.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T20:01:07.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.516 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T20:01:07.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.517 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T20:01:07.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T20:01:07.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.518 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T20:01:07.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T20:01:07.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:01:07.519 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.521 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T20:01:07.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T20:01:07.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T20:01:07.522 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T20:01:07.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T20:01:07.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.523 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T20:01:07.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T20:01:07.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.524 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T20:01:07.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.525 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T20:01:07.526 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T20:01:07.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.527 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T20:01:07.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T20:01:07.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:01:07.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.528 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T20:01:07.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T20:01:07.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T20:01:07.529 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T20:01:07.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T20:01:07.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.530 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.531 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.532 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.533 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.534 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.535 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.536 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.537 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.538 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.539 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.540 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.541 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.542 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.543 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.544 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.545 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T20:01:07.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T20:01:07.546 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:01:07.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:01:07.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.547 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T20:01:07.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.548 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T20:01:07.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T20:01:07.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.549 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T20:01:07.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.550 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T20:01:07.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T20:01:07.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T20:01:07.551 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T20:01:07.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.552 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T20:01:07.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T20:01:07.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.553 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.554 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T20:01:07.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.555 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:01:07.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:01:07.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.556 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:01:07.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.557 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T20:01:07.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.558 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T20:01:07.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T20:01:07.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.559 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:01:07.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T20:01:07.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.560 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T20:01:07.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T20:01:07.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.561 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T20:01:07.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T20:01:07.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T20:01:07.562 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:01:07.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.563 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T20:01:07.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.564 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T20:01:07.565 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T20:01:07.566 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T20:01:07.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.567 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T20:01:07.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T20:01:07.568 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T20:01:07.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T20:01:07.569 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T20:01:07.570 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T20:01:07.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.571 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T20:01:07.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T20:01:07.572 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:01:07.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.573 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T20:01:07.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.574 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T20:01:07.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T20:01:07.575 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T20:01:07.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.576 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T20:01:07.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.577 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T20:01:07.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T20:01:07.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.578 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:01:07.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.579 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T20:01:07.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.580 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.581 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.582 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.583 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.584 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.585 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.586 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T20:01:07.587 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.588 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.589 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.590 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.591 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.592 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.593 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.594 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.595 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T20:01:07.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T20:01:07.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.596 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T20:01:07.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.597 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T20:01:07.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T20:01:07.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T20:01:07.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.598 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T20:01:07.599 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T20:01:07.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:07.600 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T20:01:07.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.601 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T20:01:07.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T20:01:07.602 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.603 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T20:01:07.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.604 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T20:01:07.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T20:01:07.605 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.606 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T20:01:07.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.607 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T20:01:07.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T20:01:07.608 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.609 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T20:01:07.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.610 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.611 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T20:01:07.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.612 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.613 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.614 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.615 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.616 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.617 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.618 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.619 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.620 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.621 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.622 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.623 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.624 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.625 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.626 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T20:01:07.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T20:01:07.627 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T20:01:07.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.628 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T20:01:07.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.629 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T20:01:07.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T20:01:07.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.630 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T20:01:07.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.631 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T20:01:07.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.632 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T20:01:07.633 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T20:01:07.634 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T20:01:07.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.635 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.636 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T20:01:07.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T20:01:07.637 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.638 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.639 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T20:01:07.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T20:01:07.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.640 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.641 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.642 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T20:01:07.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T20:01:07.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.643 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.644 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.645 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T20:01:07.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T20:01:07.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.646 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.647 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.648 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T20:01:07.649 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T20:01:07.649 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.649 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.649 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.649 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.650 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.650 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.650 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.650 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.651 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T20:01:07.652 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T20:01:07.652 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.652 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.652 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.653 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.653 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.653 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.653 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.653 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.654 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.654 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.654 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.654 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.654 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T20:01:07.655 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T20:01:07.655 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.655 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.655 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.655 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.656 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.657 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.657 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.657 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.657 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T20:01:07.657 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T20:01:07.658 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.658 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.658 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.658 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.658 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.659 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.659 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.659 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.659 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.660 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.660 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.660 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.660 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T20:01:07.660 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T20:01:07.661 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.661 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.661 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.661 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.661 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.662 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.662 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.662 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.662 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.662 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.663 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.663 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.663 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T20:01:07.663 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T20:01:07.663 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.664 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.664 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.664 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.664 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.664 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.665 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.665 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.665 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.665 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.665 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.666 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.666 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T20:01:07.666 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T20:01:07.666 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.666 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.667 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.667 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:01:07.667 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.667 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.668 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.668 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.668 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.668 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.668 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.669 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.669 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T20:01:07.669 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T20:01:07.669 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.669 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.670 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.671 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.672 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T20:01:07.672 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T20:01:07.672 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.672 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.672 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.673 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.673 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.673 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.673 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.673 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.674 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.674 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.674 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.674 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.675 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T20:01:07.675 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T20:01:07.675 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.675 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.675 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.676 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:01:07.676 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.676 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.676 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.676 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.677 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.677 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.677 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.677 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.677 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T20:01:07.678 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T20:01:07.678 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.678 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.678 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.679 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.679 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.679 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.679 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.679 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.680 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.680 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.680 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.680 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.680 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T20:01:07.681 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T20:01:07.681 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.681 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.681 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.681 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.682 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.682 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.682 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.682 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.682 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.683 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.683 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.683 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.683 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T20:01:07.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T20:01:07.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.684 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.685 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T20:01:07.686 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T20:01:07.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.687 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.688 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T20:01:07.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T20:01:07.689 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.690 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.691 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T20:01:07.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T20:01:07.692 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.693 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.694 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T20:01:07.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T20:01:07.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.695 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.696 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.697 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T20:01:07.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T20:01:07.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.698 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.699 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.700 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T20:01:07.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T20:01:07.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.701 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.702 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.703 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T20:01:07.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T20:01:07.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.704 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.705 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.706 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T20:01:07.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T20:01:07.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.707 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.708 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.709 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T20:01:07.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T20:01:07.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.710 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T20:01:07.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.711 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T20:01:07.712 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T20:01:07.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.713 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:01:07.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.714 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T20:01:07.715 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T20:01:07.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T20:01:07.716 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.717 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T20:01:07.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T20:01:07.718 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T20:01:07.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.719 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.720 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T20:01:07.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T20:01:07.721 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.722 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.723 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T20:01:07.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T20:01:07.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.724 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T20:01:07.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.725 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.726 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T20:01:07.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T20:01:07.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.727 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.728 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.729 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T20:01:07.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T20:01:07.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.730 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T20:01:07.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.731 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.732 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T20:01:07.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T20:01:07.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.733 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T20:01:07.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.734 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T20:01:07.735 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T20:01:07.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.736 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.737 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T20:01:07.738 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T20:01:07.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.739 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.740 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T20:01:07.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T20:01:07.741 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.742 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.743 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T20:01:07.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T20:01:07.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.744 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T20:01:07.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.745 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.746 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T20:01:07.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T20:01:07.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.747 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:01:07.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.748 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.749 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T20:01:07.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T20:01:07.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.750 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:01:07.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.751 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.752 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T20:01:07.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T20:01:07.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.753 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.754 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.755 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T20:01:07.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T20:01:07.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.756 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T20:01:07.757 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T20:01:07.758 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T20:01:07.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T20:01:07.759 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.760 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T20:01:07.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T20:01:07.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.762 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.763 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.764 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.765 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.766 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.767 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.768 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.769 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.770 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.771 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.772 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.773 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.774 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.775 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.776 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.777 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.778 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T20:01:07.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T20:01:07.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.779 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.780 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:01:07.781 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:01:07.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T20:01:07.782 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.783 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:01:07.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:01:07.784 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T20:01:07.785 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.786 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T20:01:07.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T20:01:07.787 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.788 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.789 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T20:01:07.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T20:01:07.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.790 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T20:01:07.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.791 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.792 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T20:01:07.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T20:01:07.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.793 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T20:01:07.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.794 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T20:01:07.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.795 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T20:01:07.796 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T20:01:07.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T20:01:07.797 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T20:01:07.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T20:01:07.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.798 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T20:01:07.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T20:01:07.799 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.800 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.801 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T20:01:07.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T20:01:07.802 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.803 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.804 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.805 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T20:01:07.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.806 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T20:01:07.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T20:01:07.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.807 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T20:01:07.808 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.809 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.810 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.811 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.812 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.813 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.814 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.815 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.816 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.817 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.818 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.819 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.820 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.821 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.822 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.823 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T20:01:07.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T20:01:07.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.824 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T20:01:07.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.825 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T20:01:07.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.826 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T20:01:07.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T20:01:07.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.827 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T20:01:07.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.828 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T20:01:07.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.829 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T20:01:07.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T20:01:07.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.830 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T20:01:07.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.831 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T20:01:07.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.832 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T20:01:07.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T20:01:07.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.833 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T20:01:07.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T20:01:07.834 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T20:01:07.835 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T20:01:07.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.836 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:07.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T20:01:07.837 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:01:07.838 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:01:07.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:01:07.839 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T20:01:07.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.840 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T20:01:07.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T20:01:07.841 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:07.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T20:01:07.842 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T20:01:07.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.843 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.844 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T20:01:07.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.845 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.846 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.847 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.848 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.849 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.850 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.851 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.852 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.853 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.854 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.855 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.856 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.857 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.858 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T20:01:07.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T20:01:07.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.860 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T20:01:07.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.861 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.862 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T20:01:07.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T20:01:07.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.863 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T20:01:07.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.864 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.865 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:01:07.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:01:07.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.866 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T20:01:07.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.867 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.868 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T20:01:07.869 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T20:01:07.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T20:01:07.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T20:01:07.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T20:01:07.870 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T20:01:07.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.871 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.872 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T20:01:07.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T20:01:07.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.873 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T20:01:07.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.874 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.875 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T20:01:07.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T20:01:07.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.876 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:07.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.877 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.878 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:01:07.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:01:07.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.879 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T20:01:07.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.880 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.881 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.882 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.883 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.884 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.885 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.886 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.887 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.888 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.889 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.890 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.891 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.892 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.893 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.894 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.895 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T20:01:07.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T20:01:07.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.896 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:07.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.897 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.898 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T20:01:07.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T20:01:07.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.899 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T20:01:07.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.900 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.901 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T20:01:07.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T20:01:07.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.902 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T20:01:07.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.903 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.904 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T20:01:07.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T20:01:07.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.905 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:01:07.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.906 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.907 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T20:01:07.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T20:01:07.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.908 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:07.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.909 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T20:01:07.910 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T20:01:07.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T20:01:07.911 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.912 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.913 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T20:01:07.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.914 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.915 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.916 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.917 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.918 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.919 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.920 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.921 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.922 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.923 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.924 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.925 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.926 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.927 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.928 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.929 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T20:01:07.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.930 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.931 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.932 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.933 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.934 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.935 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.936 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.937 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.938 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.939 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.940 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.941 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.942 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.943 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.944 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.945 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T20:01:07.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T20:01:07.946 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T20:01:07.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.947 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T20:01:07.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T20:01:07.948 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T20:01:07.949 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T20:01:07.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:07.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T20:01:07.950 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T20:01:07.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T20:01:07.951 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.952 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.953 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.954 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.955 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.956 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.957 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.958 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.959 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.960 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.961 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.962 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.963 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.964 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.965 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.966 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:07.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:07.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T20:01:07.967 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:07.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:07.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:07.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T20:01:07.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T20:01:07.968 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T20:01:07.969 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T20:01:07.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.970 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:07.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:07.971 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.972 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.973 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.974 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:07.975 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:07.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.976 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.977 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:07.978 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:07.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:07.979 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:07.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:07.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:07.980 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:07.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:07.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:07.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:07.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:07.981 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.982 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:07.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:07.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:07.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.983 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:07.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.984 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:07.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.985 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T20:01:07.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T20:01:07.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.986 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T20:01:07.987 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T20:01:07.988 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T20:01:07.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T20:01:07.989 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T20:01:07.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T20:01:07.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T20:01:07.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:07.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T20:01:07.992 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T20:01:07.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.993 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T20:01:07.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T20:01:07.994 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:07.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.995 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T20:01:07.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.996 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:07.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:07.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T20:01:07.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T20:01:07.997 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:07.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:07.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:07.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T20:01:07.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:07.998 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:07.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:07.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T20:01:07.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:07.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:07.999 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.000 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T20:01:08.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.001 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.002 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.003 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.004 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.005 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.006 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.007 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.008 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.009 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.010 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.011 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.012 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.013 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.014 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.015 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T20:01:08.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T20:01:08.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.016 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.017 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T20:01:08.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T20:01:08.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T20:01:08.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.018 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T20:01:08.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.019 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T20:01:08.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.020 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.021 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.022 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.023 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.024 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.025 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.026 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.027 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.028 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.029 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.030 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.031 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.032 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.033 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.034 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.035 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T20:01:08.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.036 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.037 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.038 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.039 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.040 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.041 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.042 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.043 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.044 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.045 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.046 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.047 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.048 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.049 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.050 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T20:01:08.051 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T20:01:08.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:01:08.052 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.053 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.054 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T20:01:08.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.055 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.056 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.057 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.058 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.059 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.060 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.061 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.062 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.063 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.064 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.065 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.066 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.067 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.068 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.069 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T20:01:08.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T20:01:08.070 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:08.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T20:01:08.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.071 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T20:01:08.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.072 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T20:01:08.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T20:01:08.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:08.073 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T20:01:08.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.074 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T20:01:08.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.075 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.076 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T20:01:08.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.077 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.078 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.079 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.080 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.081 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.082 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.083 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.084 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.085 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.086 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.089 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.090 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.091 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T20:01:08.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T20:01:08.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.092 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.093 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.094 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T20:01:08.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T20:01:08.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.095 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.096 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.097 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T20:01:08.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T20:01:08.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.098 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.099 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:01:08.100 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:01:08.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.101 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.102 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:01:08.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:01:08.103 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.104 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.105 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.106 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T20:01:08.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.107 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.108 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.109 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.110 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.111 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.112 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.113 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.114 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.115 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.116 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.117 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.118 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.119 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.120 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.121 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T20:01:08.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T20:01:08.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.122 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.123 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.124 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T20:01:08.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T20:01:08.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.125 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.126 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.127 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T20:01:08.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.128 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T20:01:08.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T20:01:08.129 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.130 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.131 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.132 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.133 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.134 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.135 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.136 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.137 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.138 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.139 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.140 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.141 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.142 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.143 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.144 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.145 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.146 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T20:01:08.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T20:01:08.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.147 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.148 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.149 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.150 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T20:01:08.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T20:01:08.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.151 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.152 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.153 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T20:01:08.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.154 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.155 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.156 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.157 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.158 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.159 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.160 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.161 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.162 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.163 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.164 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.165 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.166 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.167 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.168 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.169 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T20:01:08.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.170 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.171 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.172 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.173 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.174 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.175 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.176 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.177 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.178 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.179 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.180 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.181 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.182 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.183 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.184 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T20:01:08.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T20:01:08.185 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.186 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.187 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T20:01:08.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T20:01:08.188 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T20:01:08.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.189 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.190 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T20:01:08.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T20:01:08.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.191 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.192 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.193 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T20:01:08.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T20:01:08.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:08.194 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.195 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.196 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T20:01:08.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T20:01:08.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T20:01:08.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.197 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.198 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.199 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T20:01:08.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T20:01:08.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.200 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.201 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.202 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T20:01:08.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T20:01:08.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.203 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.204 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T20:01:08.205 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T20:01:08.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:08.206 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.207 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T20:01:08.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T20:01:08.208 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.209 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.210 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T20:01:08.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T20:01:08.211 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.212 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.213 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T20:01:08.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T20:01:08.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.214 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.215 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.216 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T20:01:08.217 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.218 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.219 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.220 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.221 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.222 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.223 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.224 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.225 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.226 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.227 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.228 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.229 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.230 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.231 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.232 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T20:01:08.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.233 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T20:01:08.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T20:01:08.234 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T20:01:08.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.235 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.236 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:01:08.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:01:08.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:08.237 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T20:01:08.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.238 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.239 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.240 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.241 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.242 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.243 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.244 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.245 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.246 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.247 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.248 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.249 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.250 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.251 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.252 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.253 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.254 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T20:01:08.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.255 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T20:01:08.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T20:01:08.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.256 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:08.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.257 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T20:01:08.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.258 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T20:01:08.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T20:01:08.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.259 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:08.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.260 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.261 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T20:01:08.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T20:01:08.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.262 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T20:01:08.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.263 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T20:01:08.264 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T20:01:08.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.265 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.266 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T20:01:08.267 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T20:01:08.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.268 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.269 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T20:01:08.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T20:01:08.270 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.271 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.272 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T20:01:08.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T20:01:08.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.273 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T20:01:08.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.274 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.275 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T20:01:08.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T20:01:08.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.276 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.277 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.278 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:01:08.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:01:08.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:08.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.279 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T20:01:08.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T20:01:08.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.280 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T20:01:08.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T20:01:08.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:08.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T20:01:08.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.283 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.284 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T20:01:08.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T20:01:08.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.285 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.286 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.287 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.288 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.289 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.290 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.291 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.292 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.293 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.294 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.295 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.296 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.297 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.298 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.299 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.300 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.301 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T20:01:08.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T20:01:08.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.302 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.303 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.304 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T20:01:08.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T20:01:08.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.305 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.306 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.307 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T20:01:08.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T20:01:08.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.308 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T20:01:08.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.309 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.310 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T20:01:08.311 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.312 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.313 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.314 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.315 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.316 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.317 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.318 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.319 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.320 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.321 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.322 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.323 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.324 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.325 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.326 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T20:01:08.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.327 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.328 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.329 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.330 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.331 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.332 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.333 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.334 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.335 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.336 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.337 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.338 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.339 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.340 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.341 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.342 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T20:01:08.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T20:01:08.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T20:01:08.343 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T20:01:08.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T20:01:08.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T20:01:08.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.344 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T20:01:08.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.345 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.346 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T20:01:08.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T20:01:08.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.347 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.348 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.349 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T20:01:08.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T20:01:08.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T20:01:08.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.350 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T20:01:08.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.351 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T20:01:08.352 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T20:01:08.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T20:01:08.353 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.354 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.355 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.356 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T20:01:08.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T20:01:08.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.357 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.358 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.359 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T20:01:08.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T20:01:08.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.360 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T20:01:08.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T20:01:08.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T20:01:08.361 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T20:01:08.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T20:01:08.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T20:01:08.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T20:01:08.362 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T20:01:08.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.363 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T20:01:08.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T20:01:08.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T20:01:08.364 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T20:01:08.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T20:01:08.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.365 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.366 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T20:01:08.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T20:01:08.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.367 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T20:01:08.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.368 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.369 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T20:01:08.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T20:01:08.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T20:01:08.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.370 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T20:01:08.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.371 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.372 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T20:01:08.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T20:01:08.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T20:01:08.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T20:01:08.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T20:01:08.373 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T20:01:08.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T20:01:08.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T20:01:08.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T20:01:08.374 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T20:01:08.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T20:01:08.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T20:01:08.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T20:01:08.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.375 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T20:01:08.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T20:01:08.376 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T20:01:08.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T20:01:08.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T20:01:08.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T20:01:08.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T20:01:08.377 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T20:01:08.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T20:01:08.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T20:01:08.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T20:01:08.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.378 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T20:01:08.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T20:01:08.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T20:01:08.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T20:01:08.379 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T20:01:08.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T20:01:08.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T20:01:08.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T20:01:08.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T20:01:08.380 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T20:01:08.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T20:01:08.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T20:01:08.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T20:01:08.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2021-03-10T20:01:08.381 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T20:01:08.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:01:08.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:01:08.382 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:01:08.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1354718829 2021-03-10T20:01:08.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:01:08.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.383 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:01:08.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:01:08.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:01:08.384 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4047249746 2021-03-10T20:01:08.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:01:08.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T20:01:08.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.385 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T20:01:08.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:08.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T20:01:08.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.104:0", 2021-03-10T20:01:08.386 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 111304768 2021-03-10T20:01:08.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:01:08.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T20:01:08.387 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.388 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:08.388 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:07 gibba004 bash[9777]: audit 2021-03-10T20:01:06.990824+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.2.104:0/188852633' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T20:01:08.389 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T20:01:08.389 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2021-03-10T20:01:08.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T20:01:08.389 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T20:01:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:08 gibba004 bash[9777]: cluster 2021-03-10T20:01:07.881976+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2021-03-10T20:01:08.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:08 gibba004 bash[9777]: cluster 2021-03-10T20:01:07.882500+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2021-03-10T20:01:08.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:08 gibba004 bash[9777]: cluster 2021-03-10T20:01:07.884021+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-03-10T20:01:08.563 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:01:08 gibba004 bash[10014]: Warning: Permanently added 'gibba004,172.21.2.104' (ECDSA) to the list of known hosts. 2021-03-10T20:01:09.281 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T20:01:09.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2021-03-10T20:01:09.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T20:01:09.282 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T20:01:09.538 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: cluster 2021-03-10T20:01:08.267013+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.38454s) 2021-03-10T20:01:09.539 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.271538+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:01:09.539 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.273579+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:01:09.539 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.274010+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:01:09.539 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.274440+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:01:09.540 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.275617+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:01:09.540 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.277898+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:01:09.540 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.278980+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:01:09.541 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.280103+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:01:09.541 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.281167+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:01:09.541 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.282355+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:01:09.541 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.283297+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:01:09.542 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: cluster 2021-03-10T20:01:08.288384+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2021-03-10T20:01:09.542 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.313954+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T20:01:09.542 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.473020+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T20:01:09.543 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.473233+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:09.543 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.761428+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:08.761064\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:09.543 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.763109+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:08.761064\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:09.543 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:09 gibba004 bash[9777]: audit 2021-03-10T20:01:08.763665+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:10.087 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2021-03-10T20:01:10.087 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2021-03-10T20:01:10.088 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2021-03-10T20:01:10.379 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:10 gibba004 bash[9777]: cluster 2021-03-10T20:01:09.271847+0000 mon.a (mon.0) 93 : cluster [DBG] mgrmap e11: y(active, since 1.38941s) 2021-03-10T20:01:11.424 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:11 gibba004 bash[9777]: cluster 2021-03-10T20:01:10.286368+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-03-10T20:01:11.859 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2021-03-10T20:01:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:12 gibba004 bash[9777]: audit 2021-03-10T20:01:11.836802+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:12 gibba004 bash[9777]: audit 2021-03-10T20:01:11.854770+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCte7ep7+tLJJbIDLMrHdPyMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAyMDAx\nMTFaFw0zMTAzMDgyMDAxMTFaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAKhniZAe\nm8fHUyrM6CFfqz8TEAFZO3SvKFjiXf1CnXmoB3m0BdKxdJ1BjKexYa0kn3AbSQKc\nM848IqFOyVgfFOjxS/nlBbhhlbNtVfuMwB1j8KZzcEO3KyXWabUZDgA/ONnFDmw/\n4AOlZU+ClyA+1uskyVQmhzcRkzcFJT+DD5RnlLmRmfCo6A7ZEVYdv3VDCmMWCDMI\nB5lhgKb1Onx99uawb4C0Z62/hFH7m27Mnu/8UW3BOxpyOlQps+sICYltwgZF3e34\ny990Sm8b4V7T+h6xmoQKmteboLozQ1At7JGGeTYcr6Nv66X7eQ7WYKNJ2r0Qx/va\ndsYr0oeQOdVNqnECAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAONZKU+hC2y3XQb4B\nv0p6LCDt4WhU5YUl5NyAZlH5uIQCO6lZOZUOCxaVm9ddPqTPT5kZ2qYfyuD/nb+H\nW1cAI9vqNSdcUAmF+va8Ndg5FbE9vajjCwhOdr5+amdd0whJ/abVqkgSnZk7o9SM\nvALHCDuF9lcNLlJLKjhVR/CqdPQSylQDRm2SZB80IZunOmfVeUOvPIFF7x29LaV7\nhjm5KVMzqw/dta4BD5aKlisa82szDjZSk3VoGj9rayvjVvKz+h2FVv1ox77efaey\n54kBiQF5U36smX/kaiqhD4y7m3dq6V5LqG5geUWGJ0n1QNlKhB8tDkFjAGA94pdl\nqI5y2A==\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:01:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:12 gibba004 bash[9777]: audit 2021-03-10T20:01:11.856494+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCte7ep7+tLJJbIDLMrHdPyMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAyMDAx\nMTFaFw0zMTAzMDgyMDAxMTFaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAKhniZAe\nm8fHUyrM6CFfqz8TEAFZO3SvKFjiXf1CnXmoB3m0BdKxdJ1BjKexYa0kn3AbSQKc\nM848IqFOyVgfFOjxS/nlBbhhlbNtVfuMwB1j8KZzcEO3KyXWabUZDgA/ONnFDmw/\n4AOlZU+ClyA+1uskyVQmhzcRkzcFJT+DD5RnlLmRmfCo6A7ZEVYdv3VDCmMWCDMI\nB5lhgKb1Onx99uawb4C0Z62/hFH7m27Mnu/8UW3BOxpyOlQps+sICYltwgZF3e34\ny990Sm8b4V7T+h6xmoQKmteboLozQ1At7JGGeTYcr6Nv66X7eQ7WYKNJ2r0Qx/va\ndsYr0oeQOdVNqnECAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAONZKU+hC2y3XQb4B\nv0p6LCDt4WhU5YUl5NyAZlH5uIQCO6lZOZUOCxaVm9ddPqTPT5kZ2qYfyuD/nb+H\nW1cAI9vqNSdcUAmF+va8Ndg5FbE9vajjCwhOdr5+amdd0whJ/abVqkgSnZk7o9SM\nvALHCDuF9lcNLlJLKjhVR/CqdPQSylQDRm2SZB80IZunOmfVeUOvPIFF7x29LaV7\nhjm5KVMzqw/dta4BD5aKlisa82szDjZSk3VoGj9rayvjVvKz+h2FVv1ox77efaey\n54kBiQF5U36smX/kaiqhD4y7m3dq6V5LqG5geUWGJ0n1QNlKhB8tDkFjAGA94pdl\nqI5y2A==\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:01:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:12 gibba004 bash[9777]: audit 2021-03-10T20:01:11.856892+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCoZ4mQHpvHx1Mq\nzOghX6s/ExABWTt0ryhY4l39Qp15qAd5tAXSsXSdQYynsWGtJJ9wG0kCnDPOPCKh\nTslYHxTo8Uv55QW4YZWzbVX7jMAdY/Cmc3BDtysl1mm1GQ4APzjZxQ5sP+ADpWVP\ngpcgPtbrJMlUJoc3EZM3BSU/gw+UZ5S5kZnwqOgO2RFWHb91QwpjFggzCAeZYYCm\n9Tp8ffbmsG+AtGetv4RR+5tuzJ7v/FFtwTsacjpUKbPrCAmJbcIGRd3t+MvfdEpv\nG+Fe0/oesZqECprXm6C6M0NQLeyRhnk2HK+jb+ul+3kO1mCjSdq9EMf72nbGK9KH\nkDnVTapxAgMBAAECggEAWrZa7VzvgO+npvh1WfTUo8c66d8NHc90JlzZUCDf/rY6\nQJ5uPI4GSOcUQwhTmxaNI7Au5c8KQN83sDhmUKd9dfT0fgmVyToXj20n0baBjdNV\nv/OS14cFIP6cNkbmuc9UakmxeTH3Ez+2kNvBWEdBMazBHika0NkQuaR16f5JGCDL\n0p3BGipJdFOyb6pjYna9AEEVp7gr/IskHhLbxujCt13FzUQjuscIOTXt5KZK82pN\nhsDRgenE7JCH5TERxdS4/gvjPxMMIlP6HpMHoOsxtUOORpq62TDfsd99nNWLtZCj\nw2XmuI5QJGhepWPye6IpmyKMAZu678R52lVc79h+oQKBgQDRvt7FAsDZ5Ui+GX4Y\nafegqN18IvMsrcJ0wAlRWSfdP90JnkpVN3IhqbpbTkni2HhqOn0DGYfBJj7D1TNw\nLuHrr9yFQyvYk2Csi3epSDM7XeG+Yw4HcydgC25GybWx7bxyvHzCVAsthQk63Kwf\nAAoAuJqWQFHjkN31UGARKUMIjQKBgQDNisOg9tDlZz0OMMwgfVlAzlncteaBHCf0\nPPaZzlPtalBdlLhL3+G4HBQBnO8qTjaMrTzgzb0SUZIz2Oi5CYMSOyrtwWURbOHw\ndAd+W51gM7akShxt4xmdRGSK2FVFmKmZumZCsEEht/APTuCnBQqWB8vfSz/3iDXD\nHjgKHnpKdQKBgEzRzn9zkbR8kJbneVJxxTs3fd9QYaYUgesGxqLft4UGNeum6Oyr\nIQcJRfLZCqClzfyCLXUsLZdlbYmGFY/Z6+7Je0fnoTByUe8AKbR7eCAfM2Xqm6HI\n4DwCE8KjcAOZ4fJX7I20AGAMoKPJXNUBy6gV9LBhIFzrmw+U/4pphV6lAoGBAJ0G\n6jXK2gSoPojc1tXrbYiJHTX08cipTgzVlkAi1ROIKSWVPMcan0MckFw7HKxhXGNU\n5jGIfG3GS7+4cvMKRUxkT4OcQC5z1Jjyy9bI/w5D88DHrbh1y1fOrFE2vM6Stt9u\n/DjulpPABnJrfE2dGF1OT36j6padRRVvvLheWGcRAoGBAL0Uj8QvGuP8psoblr29\nBGJkknlFv6etoWcSF76YJeHypqcotuyp/tMEr4Fph5yzcagegoYo4sb8OoPy4Wxx\nXrC6lefKl1/24JdSysHyYQBzW4yQ+dvE4warBE+kVi4Ur3vTZgnjMaKNnbipOtRK\ntrofmy2/+GAfoVq/soqPFufO\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:01:12.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:12 gibba004 bash[9777]: audit 2021-03-10T20:01:11.858330+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQCoZ4mQHpvHx1Mq\nzOghX6s/ExABWTt0ryhY4l39Qp15qAd5tAXSsXSdQYynsWGtJJ9wG0kCnDPOPCKh\nTslYHxTo8Uv55QW4YZWzbVX7jMAdY/Cmc3BDtysl1mm1GQ4APzjZxQ5sP+ADpWVP\ngpcgPtbrJMlUJoc3EZM3BSU/gw+UZ5S5kZnwqOgO2RFWHb91QwpjFggzCAeZYYCm\n9Tp8ffbmsG+AtGetv4RR+5tuzJ7v/FFtwTsacjpUKbPrCAmJbcIGRd3t+MvfdEpv\nG+Fe0/oesZqECprXm6C6M0NQLeyRhnk2HK+jb+ul+3kO1mCjSdq9EMf72nbGK9KH\nkDnVTapxAgMBAAECggEAWrZa7VzvgO+npvh1WfTUo8c66d8NHc90JlzZUCDf/rY6\nQJ5uPI4GSOcUQwhTmxaNI7Au5c8KQN83sDhmUKd9dfT0fgmVyToXj20n0baBjdNV\nv/OS14cFIP6cNkbmuc9UakmxeTH3Ez+2kNvBWEdBMazBHika0NkQuaR16f5JGCDL\n0p3BGipJdFOyb6pjYna9AEEVp7gr/IskHhLbxujCt13FzUQjuscIOTXt5KZK82pN\nhsDRgenE7JCH5TERxdS4/gvjPxMMIlP6HpMHoOsxtUOORpq62TDfsd99nNWLtZCj\nw2XmuI5QJGhepWPye6IpmyKMAZu678R52lVc79h+oQKBgQDRvt7FAsDZ5Ui+GX4Y\nafegqN18IvMsrcJ0wAlRWSfdP90JnkpVN3IhqbpbTkni2HhqOn0DGYfBJj7D1TNw\nLuHrr9yFQyvYk2Csi3epSDM7XeG+Yw4HcydgC25GybWx7bxyvHzCVAsthQk63Kwf\nAAoAuJqWQFHjkN31UGARKUMIjQKBgQDNisOg9tDlZz0OMMwgfVlAzlncteaBHCf0\nPPaZzlPtalBdlLhL3+G4HBQBnO8qTjaMrTzgzb0SUZIz2Oi5CYMSOyrtwWURbOHw\ndAd+W51gM7akShxt4xmdRGSK2FVFmKmZumZCsEEht/APTuCnBQqWB8vfSz/3iDXD\nHjgKHnpKdQKBgEzRzn9zkbR8kJbneVJxxTs3fd9QYaYUgesGxqLft4UGNeum6Oyr\nIQcJRfLZCqClzfyCLXUsLZdlbYmGFY/Z6+7Je0fnoTByUe8AKbR7eCAfM2Xqm6HI\n4DwCE8KjcAOZ4fJX7I20AGAMoKPJXNUBy6gV9LBhIFzrmw+U/4pphV6lAoGBAJ0G\n6jXK2gSoPojc1tXrbYiJHTX08cipTgzVlkAi1ROIKSWVPMcan0MckFw7HKxhXGNU\n5jGIfG3GS7+4cvMKRUxkT4OcQC5z1Jjyy9bI/w5D88DHrbh1y1fOrFE2vM6Stt9u\n/DjulpPABnJrfE2dGF1OT36j6padRRVvvLheWGcRAoGBAL0Uj8QvGuP8psoblr29\nBGJkknlFv6etoWcSF76YJeHypqcotuyp/tMEr4Fph5yzcagegoYo4sb8OoPy4Wxx\nXrC6lefKl1/24JdSysHyYQBzW4yQ+dvE4warBE+kVi4Ur3vTZgnjMaKNnbipOtRK\ntrofmy2/+GAfoVq/soqPFufO\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:01:12.474 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Creating initial admin user... 2021-03-10T20:01:12.474 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'moiiehlibr', 'administrator', '--force-password', '--pwd-update-required'] 2021-03-10T20:01:12.475 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin moiiehlibr administrator --force-password --pwd-update-required 2021-03-10T20:01:13.761 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$fXMHJuRhmq07guDLTMbU3uM3.cutk0XoeRCKlF3Ck4x5cgBjSuQZe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1615406473, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-03-10T20:01:14.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:13 gibba004 bash[9777]: audit 2021-03-10T20:01:13.758854+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$fXMHJuRhmq07guDLTMbU3uM3.cutk0XoeRCKlF3Ck4x5cgBjSuQZe\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615406473, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2021-03-10T20:01:14.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:13 gibba004 bash[9777]: audit 2021-03-10T20:01:13.760510+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$fXMHJuRhmq07guDLTMbU3uM3.cutk0XoeRCKlF3Ck4x5cgBjSuQZe\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615406473, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2021-03-10T20:01:14.488 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Fetching dashboard port number... 2021-03-10T20:01:14.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba004', '-v', '/var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2021-03-10T20:01:14.488 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba004 -v /var/log/ceph/37a23cfe-81db-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpksyrqg4t:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmptv1aa1r5:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2021-03-10T20:01:15.162 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:14 gibba004 bash[9777]: audit 2021-03-10T20:01:13.591066+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "moiiehlibr", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:15.162 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:14 gibba004 bash[9777]: audit 2021-03-10T20:01:14.157306+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:15.163 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:14 gibba004 bash[9777]: audit 2021-03-10T20:01:14.261637+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:08.761064\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:15.163 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:14 gibba004 bash[9777]: audit 2021-03-10T20:01:14.263884+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:08.761064\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:15.457 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2021-03-10T20:01:15.986 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2021-03-10T20:01:15.986 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.987 INFO:teuthology.orchestra.run.gibba004.stderr: URL: https://gibba004:8443/ 2021-03-10T20:01:15.987 INFO:teuthology.orchestra.run.gibba004.stderr: User: admin 2021-03-10T20:01:15.987 INFO:teuthology.orchestra.run.gibba004.stderr: Password: moiiehlibr 2021-03-10T20:01:15.987 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.988 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:You can access the Ceph CLI with: 2021-03-10T20:01:15.988 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.988 INFO:teuthology.orchestra.run.gibba004.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-03-10T20:01:15.988 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.988 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2021-03-10T20:01:15.989 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.989 INFO:teuthology.orchestra.run.gibba004.stderr: ceph telemetry on 2021-03-10T20:01:15.989 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.989 INFO:teuthology.orchestra.run.gibba004.stderr:For more information see: 2021-03-10T20:01:15.989 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.990 INFO:teuthology.orchestra.run.gibba004.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-03-10T20:01:15.990 INFO:teuthology.orchestra.run.gibba004.stderr: 2021-03-10T20:01:15.990 INFO:teuthology.orchestra.run.gibba004.stderr:INFO:cephadm:Bootstrap complete. 2021-03-10T20:01:15.990 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Releasing lock 140661166014816 on /run/cephadm/37a23cfe-81db-11eb-9080-001a4aab830c.lock 2021-03-10T20:01:15.991 INFO:teuthology.orchestra.run.gibba004.stderr:DEBUG:cephadm:Lock 140661166014816 released on /run/cephadm/37a23cfe-81db-11eb-9080-001a4aab830c.lock 2021-03-10T20:01:15.991 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:15 gibba004 bash[9777]: cluster 2021-03-10T20:01:14.819602+0000 mon.a (mon.0) 104 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-03-10T20:01:15.991 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:15 gibba004 bash[9777]: audit 2021-03-10T20:01:15.456301+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.2.104:0/3077788827' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-03-10T20:01:15.995 INFO:tasks.cephadm:Fetching config... 2021-03-10T20:01:15.995 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:01:15.996 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-03-10T20:01:16.000 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-03-10T20:01:16.001 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:01:16.001 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-03-10T20:01:16.005 INFO:tasks.cephadm:Fetching mon keyring... 2021-03-10T20:01:16.005 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:01:16.006 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/37a23cfe-81db-11eb-9080-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-03-10T20:01:16.012 INFO:tasks.cephadm:Fetching pub ssh key... 2021-03-10T20:01:16.013 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:01:16.013 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-03-10T20:01:16.018 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-03-10T20:01:16.018 DEBUG:teuthology.orchestra.run.gibba004:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T20:01:16.095 INFO:teuthology.orchestra.run.gibba004.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:01:16.104 DEBUG:teuthology.orchestra.run.gibba009:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T20:01:16.121 INFO:teuthology.orchestra.run.gibba009.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ZHbyg3Q4C0UzC2jx39Apy3BjaaW58+KqyIjFG+a0kuR6NG7pjG8ViHzBcrHd4qrMQVjmnegUA4mzX/96CiJw6A9cgfvqKOyo4njRjgi6Nm9qsO0pDywb+6ekeXjiO5X5hEyBxPO3R00d5W5ygiBwLxvvowPx0XE8BTrY8N7DEGRiHtbONbiAu/owIY5og9O5k7O90MqeA24C4VoxVktsudgrqgHStjM/KBKOXEKNa2r1p7SSVg0lCn+wv7kF5Z2YQWEe4Do6Gi0158XniNsZjLig3OIFSz6PXC4bLykKtHkmsvLNHJOgUjfgECuH/PEx+J8surX9V/nCX82t7sMMxjcLBAFflPgv3F6kEOS0W6NTYGziEb14lAZ7KhDqBxWxR5VzTfN8OgQcHFjr/cb3KJUOLz5+VxCH3NO5hlw5QzPoPA5BvEM2q/iWhPx8jBTZx9nO16hn3ih0tnimClcu8rYVVr3V/RyFNHNC5/TvAhe6zknKihwwdzcp/lSFGv0= ceph-37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:01:16.125 INFO:tasks.cephadm:Writing (initial) conf and keyring to gibba009 2021-03-10T20:01:16.125 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:01:16.125 DEBUG:teuthology.orchestra.run.gibba009:> dd of=/etc/ceph/ceph.conf 2021-03-10T20:01:16.129 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:01:16.130 DEBUG:teuthology.orchestra.run.gibba009:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T20:01:16.177 INFO:tasks.cephadm:Adding host gibba009 to orchestrator... 2021-03-10T20:01:16.178 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch host add gibba009 2021-03-10T20:01:29.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:29 gibba004 bash[9777]: cluster 2021-03-10T20:01:28.277076+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:31.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:31 gibba004 bash[9777]: cluster 2021-03-10T20:01:30.277958+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:33.292 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:01:32 gibba004 bash[10014]: Warning: Permanently added 'gibba009,172.21.2.109' (ECDSA) to the list of known hosts. 2021-03-10T20:01:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:33 gibba004 bash[9777]: cluster 2021-03-10T20:01:32.278849+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:33 gibba004 bash[9777]: audit 2021-03-10T20:01:32.958638+0000 mgr.y (mgr.14140) 6 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba009", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:33.965 INFO:teuthology.orchestra.run.gibba009.stdout:Added host 'gibba009' 2021-03-10T20:01:34.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.357441+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba004\": {\"hostname\": \"gibba004\", \"addr\": \"gibba004\", \"labels\": [], \"status\": \"\"}, \"gibba009\": {\"hostname\": \"gibba009\", \"addr\": \"gibba009\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T20:01:34.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.363296+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba004\": {\"hostname\": \"gibba004\", \"addr\": \"gibba004\", \"labels\": [], \"status\": \"\"}, \"gibba009\": {\"hostname\": \"gibba009\", \"addr\": \"gibba009\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T20:01:34.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: cephadm 2021-03-10T20:01:33.364488+0000 mgr.y (mgr.14140) 7 : cephadm [INF] Added host gibba009 2021-03-10T20:01:34.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.488471+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:01:34.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.494501+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:01:34.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.496492+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:34.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.645831+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:33.644868\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:01:34.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.651606+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:33.644868\", \"networks\": {}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:01:34.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:34 gibba004 bash[9777]: audit 2021-03-10T20:01:33.653485+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:34.735 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch host ls --format=json 2021-03-10T20:01:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:35 gibba004 bash[9777]: cluster 2021-03-10T20:01:34.279575+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:37.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:37 gibba004 bash[9777]: cluster 2021-03-10T20:01:36.280188+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:38.072 INFO:teuthology.orchestra.run.gibba009.stdout: 2021-03-10T20:01:38.072 INFO:teuthology.orchestra.run.gibba009.stdout:[{"addr": "gibba004", "hostname": "gibba004", "labels": [], "status": ""}, {"addr": "gibba009", "hostname": "gibba009", "labels": [], "status": ""}] 2021-03-10T20:01:38.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:38 gibba004 bash[9777]: audit 2021-03-10T20:01:38.069005+0000 mgr.y (mgr.14140) 10 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:01:38.681 INFO:tasks.cephadm:Setting crush tunables to default 2021-03-10T20:01:38.682 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd crush tunables default 2021-03-10T20:01:39.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:39 gibba004 bash[9777]: cluster 2021-03-10T20:01:38.280760+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:39.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:39 gibba004 bash[9777]: audit 2021-03-10T20:01:39.138340+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:39.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:39 gibba004 bash[9777]: audit 2021-03-10T20:01:39.246288+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:33.644868\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:01:39.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:39 gibba004 bash[9777]: audit 2021-03-10T20:01:39.252206+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T20:01:33.644868\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:01:41.305 INFO:teuthology.orchestra.run.gibba004.stderr:adjusted tunables profile to default 2021-03-10T20:01:41.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:41 gibba004 bash[9777]: cluster 2021-03-10T20:01:40.281204+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:41.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:41 gibba004 bash[9777]: audit 2021-03-10T20:01:40.963673+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.2.104:0/1037480989' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-03-10T20:01:41.813 INFO:tasks.cephadm:Adding mon.c on gibba004 2021-03-10T20:01:41.813 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add mon 'gibba004:[v2:172.21.2.104:3301,v1:172.21.2.104:6790]=c' 2021-03-10T20:01:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:42 gibba004 bash[9777]: audit 2021-03-10T20:01:41.296322+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.2.104:0/1037480989' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-03-10T20:01:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:42 gibba004 bash[9777]: cluster 2021-03-10T20:01:41.296448+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:01:43.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:43 gibba004 bash[9777]: cluster 2021-03-10T20:01:42.281976+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:45.404 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: cluster 2021-03-10T20:01:44.282319+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:45.404 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: audit 2021-03-10T20:01:44.381224+0000 mgr.y (mgr.14140) 15 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba004:[v2:172.21.2.104:3301,v1:172.21.2.104:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:45.404 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: audit 2021-03-10T20:01:44.382462+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:01:45.405 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: audit 2021-03-10T20:01:44.383453+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:45.405 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: cephadm 2021-03-10T20:01:44.384190+0000 mgr.y (mgr.14140) 16 : cephadm [INF] Deploying daemon mon.c on gibba004 2021-03-10T20:01:45.405 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:45 gibba004 bash[9777]: audit 2021-03-10T20:01:44.384406+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-03-10T20:01:47.387 INFO:teuthology.orchestra.run.gibba004.stdout:Deployed mon.c on host 'gibba004' 2021-03-10T20:01:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:47 gibba004 bash[9777]: cluster 2021-03-10T20:01:46.282773+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:48.212 DEBUG:teuthology.orchestra.run.gibba004:mon.c> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.c.service 2021-03-10T20:01:48.214 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-03-10T20:01:48.215 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T20:01:48.308 INFO:journalctl@ceph.mon.c.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:01:48.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[9777]: audit 2021-03-10T20:01:47.281819+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:48.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[9777]: audit 2021-03-10T20:01:47.282224+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:48.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[9777]: audit 2021-03-10T20:01:47.283389+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:48.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[9777]: audit 2021-03-10T20:01:47.776996+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_daemon_update\": \"2021-03-10T20:01:47.775713\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:48.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[9777]: audit 2021-03-10T20:01:47.781084+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_daemon_update\": \"2021-03-10T20:01:47.775713\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.662+0000 7fce77ea96c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:01:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.662+0000 7fce77ea96c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T20:01:49.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.662+0000 7fce77ea96c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:01:49.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 load: jerasure load: lrc load: isa 2021-03-10T20:01:49.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:01:49.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:01:49.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:01:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option compression = kNoCompression 2021-03-10T20:01:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T20:01:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T20:01:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 1 rocksdb: do_open column families: [default] 2021-03-10T20:01:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T20:01:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:01:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T20:01:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: DB SUMMARY 2021-03-10T20:01:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:01:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:01:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-03-10T20:01:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-03-10T20:01:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 489 ; 2021-03-10T20:01:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:01:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:01:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:01:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.env: 0x5573d88921a0 2021-03-10T20:01:49.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.info_log: 0x5573d94f09a0 2021-03-10T20:01:49.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:01:49.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:01:49.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:01:49.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:01:49.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:01:49.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:01:49.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:01:49.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:01:49.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:01:49.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:01:49.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:01:49.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:01:49.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:01:49.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:01:49.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.db_log_dir: 2021-03-10T20:01:49.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T20:01:49.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:01:49.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:01:49.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:01:49.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:01:49.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:01:49.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:01:49.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:01:49.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:01:49.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:01:49.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.write_buffer_manager: 0x5573da08ab10 2021-03-10T20:01:49.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:01:49.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:01:49.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:01:49.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:01:49.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:01:49.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:01:49.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:01:49.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:01:49.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:01:49.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:01:49.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:01:49.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:01:49.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:01:49.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.row_cache: None 2021-03-10T20:01:49.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.wal_filter: None 2021-03-10T20:01:49.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:01:49.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:01:49.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:01:49.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:01:49.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:01:49.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:01:49.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:01:49.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:01:49.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:01:49.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:01:49.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:01:49.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:01:49.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:01:49.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:01:49.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:01:49.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:01:49.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:01:49.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:01:49.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:01:49.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:01:49.085 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:01:49.085 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Compression algorithms supported: 2021-03-10T20:01:49.085 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:01:49.085 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kZSTD supported: 0 2021-03-10T20:01:49.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:01:49.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:01:49.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:01:49.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:01:49.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:01:49.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:01:49.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:01:49.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-03-10T20:01:49.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T20:01:49.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:01:49.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.merge_operator: 2021-03-10T20:01:49.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:01:49.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:01:49.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:01:49.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:01:49.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5573d9410138) 2021-03-10T20:01:49.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: cache_index_and_filter_blocks: 1 2021-03-10T20:01:49.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T20:01:49.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:01:49.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: pin_top_level_index_and_filter: 1 2021-03-10T20:01:49.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: index_type: 0 2021-03-10T20:01:49.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: data_block_index_type: 0 2021-03-10T20:01:49.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:01:49.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: hash_index_allow_collision: 1 2021-03-10T20:01:49.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: checksum: 1 2021-03-10T20:01:49.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: no_block_cache: 0 2021-03-10T20:01:49.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_cache: 0x5573d9446610 2021-03-10T20:01:49.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_cache_name: BinnedLRUCache 2021-03-10T20:01:49.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_cache_options: 2021-03-10T20:01:49.092 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: capacity : 536870912 2021-03-10T20:01:49.092 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: num_shard_bits : 4 2021-03-10T20:01:49.092 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: strict_capacity_limit : 0 2021-03-10T20:01:49.092 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: high_pri_pool_ratio: 0.000 2021-03-10T20:01:49.092 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_cache_compressed: (nil) 2021-03-10T20:01:49.093 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: persistent_cache: (nil) 2021-03-10T20:01:49.093 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_size: 4096 2021-03-10T20:01:49.093 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_size_deviation: 10 2021-03-10T20:01:49.093 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_restart_interval: 16 2021-03-10T20:01:49.093 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: index_block_restart_interval: 1 2021-03-10T20:01:49.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: metadata_block_size: 4096 2021-03-10T20:01:49.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: partition_filters: 0 2021-03-10T20:01:49.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: use_delta_encoding: 1 2021-03-10T20:01:49.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:01:49.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: whole_key_filtering: 1 2021-03-10T20:01:49.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: verify_compression: 0 2021-03-10T20:01:49.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: read_amp_bytes_per_bit: 0 2021-03-10T20:01:49.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: format_version: 2 2021-03-10T20:01:49.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: enable_index_compression: 1 2021-03-10T20:01:49.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: block_align: 0 2021-03-10T20:01:49.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:01:49.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:01:49.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:01:49.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:01:49.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:01:49.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:01:49.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.num_levels: 7 2021-03-10T20:01:49.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:01:49.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:01:49.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:01:49.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:01:49.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:01:49.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:01:49.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:01:49.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:01:49.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:01:49.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:01:49.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:01:49.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:01:49.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:01:49.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:01:49.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:01:49.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:01:49.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:01:49.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:01:49.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:01:49.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:01:49.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:01:49.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:01:49.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:01:49.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:01:49.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:01:49.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:01:49.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:01:49.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:01:49.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:01:49.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:01:49.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:01:49.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:01:49.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:01:49.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:01:49.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:01:49.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:01:49.107 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:01:49.107 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:01:49.107 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:01:49.107 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:01:49.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:01:49.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:01:49.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:01:49.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:01:49.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:01:49.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:01:49.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:01:49.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:01:49.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:01:49.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:01:49.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:01:49.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:01:49.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:01:49.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:01:49.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:01:49.111 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:01:49.111 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:01:49.111 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:01:49.111 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: Options.ttl: 0 2021-03-10T20:01:49.111 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:01:49.112 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T20:01:49.112 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406508673351, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-03-10T20:01:49.112 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2021-03-10T20:01:49.112 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406508673898, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1403, "table_properties": {"data_size": 501, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T20:01:49.113 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.666+0000 7fce77ea96c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2021-03-10T20:01:49.113 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406508674616, "job": 1, "event": "recovery_finished"} 2021-03-10T20:01:49.113 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 4 rocksdb: DB pointer 0x5573d94e1200 2021-03-10T20:01:49.114 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-03-10T20:01:49.114 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce5eff6700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T20:01:49.114 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce5eff6700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T20:01:49.114 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** DB Stats ** 2021-03-10T20:01:49.115 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:01:49.115 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:01:49.115 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:01:49.115 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:01:49.115 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:01:49.116 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:01:49.116 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:01:49.116 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** Compaction Stats [default] ** 2021-03-10T20:01:49.116 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:01:49.116 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:01:49.117 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.117 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.117 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.117 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** Compaction Stats [default] ** 2021-03-10T20:01:49.117 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:01:49.118 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:01:49.118 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.118 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:01:49.118 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:01:49.118 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:01:49.119 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:01:49.119 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:01:49.119 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:01:49.119 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:01:49.120 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Interval compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:01:49.120 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:01:49.120 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:01:49.120 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** Compaction Stats [default] ** 2021-03-10T20:01:49.121 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:01:49.121 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:01:49.121 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.121 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.121 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:01:49.122 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** Compaction Stats [default] ** 2021-03-10T20:01:49.122 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:01:49.122 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:01:49.122 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 2021-03-10T20:01:49.122 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:01:49.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T20:01:49.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:01:49.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:01:49.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:01:49.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:01:49.124 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:01:49.124 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:01:49.124 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:01:49.124 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:01:49.124 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 0 using public_addrv [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] 2021-03-10T20:01:49.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 0 starting mon.c rank -1 at public addrs [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] at bind addrs [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:01:49.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.670+0000 7fce77ea96c0 1 mon.c@-1(???) e0 preinit fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:01:49.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).mds e1 new map 2021-03-10T20:01:49.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-03-10T20:01:49.126 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: e1 2021-03-10T20:01:49.126 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:01:49.126 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:01:49.126 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: legacy client fscid: -1 2021-03-10T20:01:49.126 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: 2021-03-10T20:01:49.127 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: No filesystems configured 2021-03-10T20:01:49.127 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T20:01:49.127 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T20:01:49.127 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T20:01:49.127 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T20:01:49.128 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T20:01:49.128 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T20:01:49.128 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T20:01:49.128 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T20:01:49.128 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:01:49.129 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:01:49.129 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:01:49.129 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:01:49.129 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: audit 2021-03-10T20:01:47.281819+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:49.129 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: audit 2021-03-10T20:01:47.282224+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:49.130 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: audit 2021-03-10T20:01:47.283389+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760922\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:08.760999\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:49.130 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: audit 2021-03-10T20:01:47.776996+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_daemon_update\": \"2021-03-10T20:01:47.775713\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:01:49.130 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: audit 2021-03-10T20:01:47.781084+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}}, \"last_daemon_update\": \"2021-03-10T20:01:47.775713\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:01:49.130 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-03-10T20:01:49.131 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-03-10T20:01:49.131 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expand map: {default=false} 2021-03-10T20:01:49.131 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T20:01:49.131 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T20:01:49.132 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expand map: {default=info} 2021-03-10T20:01:49.132 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T20:01:49.132 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T20:01:49.132 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T20:01:49.132 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T20:01:49.133 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T20:01:49.133 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T20:01:49.133 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T20:01:49.133 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:48 gibba004 bash[12967]: debug 2021-03-10T20:01:48.682+0000 7fce617fb700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T20:01:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:48.283077+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:48.693203+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T20:01:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:50.283542+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:50.692732+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:01:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:52.284423+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.716790+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T20:01:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.725223+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:01:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.725338+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T20:01:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.725417+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:01:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.725727+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 45s) 2021-03-10T20:01:54.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[9777]: cluster 2021-03-10T20:01:53.728375+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T20:01:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:48.283077+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:48.693203+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T20:01:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:50.283542+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:50.692732+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:01:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:52.284423+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.716790+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T20:01:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.725223+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:01:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.725338+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T20:01:54.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.725417+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:01:54.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.725727+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 45s) 2021-03-10T20:01:54.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:53 gibba004 bash[12967]: cluster 2021-03-10T20:01:53.728375+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T20:01:54.883 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:01:54.883 INFO:teuthology.orchestra.run.gibba004.stdout:{"epoch":2,"fsid":"37a23cfe-81db-11eb-9080-001a4aab830c","modified":"2021-03-10T20:01:48.691591Z","created":"2021-03-10T20:00:32.237586Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:3300","nonce":0},{"type":"v1","addr":"172.21.2.104:6789","nonce":0}]},"addr":"172.21.2.104:6789/0","public_addr":"172.21.2.104:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:3301","nonce":0},{"type":"v1","addr":"172.21.2.104:6790","nonce":0}]},"addr":"172.21.2.104:6790/0","public_addr":"172.21.2.104:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T20:01:54.884 INFO:teuthology.orchestra.run.gibba004.stderr:dumped monmap epoch 2 2021-03-10T20:01:55.417 INFO:tasks.cephadm:Adding mon.b on gibba009 2021-03-10T20:01:55.418 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add mon gibba009:172.21.2.109=b 2021-03-10T20:01:56.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:55 gibba004 bash[9777]: cluster 2021-03-10T20:01:54.285312+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:55 gibba004 bash[9777]: audit 2021-03-10T20:01:54.882016+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.104:0/2451136160' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T20:01:56.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:55 gibba004 bash[12967]: cluster 2021-03-10T20:01:54.285312+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:56.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:55 gibba004 bash[12967]: audit 2021-03-10T20:01:54.882016+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.104:0/2451136160' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T20:01:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:57 gibba004 bash[9777]: cluster 2021-03-10T20:01:56.286043+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:57.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:57 gibba004 bash[12967]: cluster 2021-03-10T20:01:56.286043+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:01:58.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[9777]: audit 2021-03-10T20:01:57.744274+0000 mgr.y (mgr.14140) 23 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba009:172.21.2.109=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[9777]: audit 2021-03-10T20:01:57.747802+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:01:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[9777]: audit 2021-03-10T20:01:57.750878+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[9777]: cephadm 2021-03-10T20:01:57.753385+0000 mgr.y (mgr.14140) 24 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:01:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[9777]: audit 2021-03-10T20:01:57.754354+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T20:01:58.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[12967]: audit 2021-03-10T20:01:57.744274+0000 mgr.y (mgr.14140) 23 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba009:172.21.2.109=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:58.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[12967]: audit 2021-03-10T20:01:57.747802+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:01:58.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[12967]: audit 2021-03-10T20:01:57.750878+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:58.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[12967]: cephadm 2021-03-10T20:01:57.753385+0000 mgr.y (mgr.14140) 24 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:01:58.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:58 gibba004 bash[12967]: audit 2021-03-10T20:01:57.754354+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T20:02:00.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:01:59 gibba004 bash[9777]: cluster 2021-03-10T20:01:58.286600+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:00.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:01:59 gibba004 bash[12967]: cluster 2021-03-10T20:01:58.286600+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:01.755 INFO:teuthology.orchestra.run.gibba009.stdout:Deployed mon.b on host 'gibba009' 2021-03-10T20:02:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: cluster 2021-03-10T20:02:00.287344+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: audit 2021-03-10T20:02:01.056636+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: audit 2021-03-10T20:02:01.057994+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: cluster 2021-03-10T20:02:00.287344+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: audit 2021-03-10T20:02:01.056636+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: audit 2021-03-10T20:02:01.057994+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:02.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: audit 2021-03-10T20:02:01.064388+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:02.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: audit 2021-03-10T20:02:01.064388+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:02.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: audit 2021-03-10T20:02:01.218758+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_daemon_update\": \"2021-03-10T20:02:01.217136\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:02.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[9777]: audit 2021-03-10T20:02:01.226880+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_daemon_update\": \"2021-03-10T20:02:01.217136\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:02.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: audit 2021-03-10T20:02:01.218758+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_daemon_update\": \"2021-03-10T20:02:01.217136\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:02.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:01 gibba004 bash[12967]: audit 2021-03-10T20:02:01.226880+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}}, \"last_daemon_update\": \"2021-03-10T20:02:01.217136\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:02.417 DEBUG:teuthology.orchestra.run.gibba009:mon.b> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.b.service 2021-03-10T20:02:02.420 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-03-10T20:02:02.420 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T20:02:02.429 INFO:journalctl@ceph.mon.b.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:07.213 INFO:teuthology.orchestra.run.gibba009.stdout: 2021-03-10T20:02:07.213 INFO:teuthology.orchestra.run.gibba009.stdout:{"epoch":3,"fsid":"37a23cfe-81db-11eb-9080-001a4aab830c","modified":"2021-03-10T20:02:02.001722Z","created":"2021-03-10T20:00:32.237586Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:3300","nonce":0},{"type":"v1","addr":"172.21.2.104:6789","nonce":0}]},"addr":"172.21.2.104:6789/0","public_addr":"172.21.2.104:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:3301","nonce":0},{"type":"v1","addr":"172.21.2.104:6790","nonce":0}]},"addr":"172.21.2.104:6790/0","public_addr":"172.21.2.104:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:3300","nonce":0},{"type":"v1","addr":"172.21.2.109:6789","nonce":0}]},"addr":"172.21.2.109:6789/0","public_addr":"172.21.2.109:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2021-03-10T20:02:07.214 INFO:teuthology.orchestra.run.gibba009.stderr:dumped monmap epoch 3 2021-03-10T20:02:07.409 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:02.010367+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.409 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:02.012769+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T20:02:07.410 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:02.288064+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.410 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:04.005017+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T20:02:07.410 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:04.288892+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.410 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.017582+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.411 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.043172+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:02:07.411 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.052663+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:02:07.411 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.052704+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T20:02:07.411 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.052717+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:02:07.412 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.052856+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T20:02:07.412 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:07 gibba009 bash[9804]: cluster 2021-03-10T20:02:07.055848+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T20:02:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:02.010367+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:02.012769+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T20:02:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:02.288064+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:04.005017+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T20:02:07.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:04.288892+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.017582+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.043172+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:02:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.052663+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:02:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.052704+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T20:02:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.052717+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:02:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.052856+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T20:02:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[9777]: cluster 2021-03-10T20:02:07.055848+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T20:02:07.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:02.010367+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:02.012769+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T20:02:07.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:02.288064+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:04.005017+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T20:02:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:04.288892+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.017582+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T20:02:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.043172+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:02:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.052663+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:02:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.052704+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T20:02:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.052717+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T20:02:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.052856+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T20:02:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:07 gibba004 bash[12967]: cluster 2021-03-10T20:02:07.055848+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T20:02:07.736 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-03-10T20:02:07.736 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph config generate-minimal-conf 2021-03-10T20:02:08.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:08 gibba004 bash[9777]: cluster 2021-03-10T20:02:06.289610+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:08.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:08 gibba004 bash[9777]: audit 2021-03-10T20:02:07.211178+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.109:0/1649017092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T20:02:08.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:08 gibba004 bash[12967]: cluster 2021-03-10T20:02:06.289610+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:08.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:08 gibba004 bash[12967]: audit 2021-03-10T20:02:07.211178+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.109:0/1649017092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T20:02:08.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:08 gibba009 bash[9804]: cluster 2021-03-10T20:02:06.289610+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:08.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:08 gibba009 bash[9804]: audit 2021-03-10T20:02:07.211178+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.109:0/1649017092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T20:02:09.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:09 gibba004 bash[9777]: cluster 2021-03-10T20:02:08.290258+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:09.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:09 gibba004 bash[9777]: cluster 2021-03-10T20:02:09.114724+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:09.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:09 gibba004 bash[12967]: cluster 2021-03-10T20:02:08.290258+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:09.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:09 gibba004 bash[12967]: cluster 2021-03-10T20:02:09.114724+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:09.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:09 gibba009 bash[9804]: cluster 2021-03-10T20:02:08.290258+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:09.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:09 gibba009 bash[9804]: cluster 2021-03-10T20:02:09.114724+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:10.251 INFO:teuthology.orchestra.run.gibba004.stdout:# minimal ceph.conf for 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:02:10.252 INFO:teuthology.orchestra.run.gibba004.stdout:[global] 2021-03-10T20:02:10.252 INFO:teuthology.orchestra.run.gibba004.stdout: fsid = 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:02:10.252 INFO:teuthology.orchestra.run.gibba004.stdout: mon_host = [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] [v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0] [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] 2021-03-10T20:02:10.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:10 gibba004 bash[9777]: audit 2021-03-10T20:02:10.250974+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.104:0/4211319261' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:10 gibba004 bash[12967]: audit 2021-03-10T20:02:10.250974+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.104:0/4211319261' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:10.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:10 gibba009 bash[9804]: audit 2021-03-10T20:02:10.250974+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.104:0/4211319261' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:10.790 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-03-10T20:02:10.791 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:02:10.791 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T20:02:10.802 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:02:10.802 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T20:02:10.810 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:02:10.810 DEBUG:teuthology.orchestra.run.gibba009:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T20:02:10.822 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:02:10.822 DEBUG:teuthology.orchestra.run.gibba009:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T20:02:10.873 INFO:tasks.cephadm:Adding mgr.y on gibba004 2021-03-10T20:02:10.874 INFO:tasks.cephadm:Adding mgr.x on gibba009 2021-03-10T20:02:10.875 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch apply mgr '3;gibba004=y;gibba009=x' 2021-03-10T20:02:11.633 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:11 gibba009 bash[9804]: cluster 2021-03-10T20:02:10.290538+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:11.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:11 gibba004 bash[9777]: cluster 2021-03-10T20:02:10.290538+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:11.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:11 gibba004 bash[12967]: cluster 2021-03-10T20:02:10.290538+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:13.184 INFO:teuthology.orchestra.run.gibba009.stdout:Scheduled mgr update... 2021-03-10T20:02:14.032 DEBUG:teuthology.orchestra.run.gibba009:mgr.x> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.x.service 2021-03-10T20:02:14.035 INFO:tasks.cephadm:Deploying OSDs... 2021-03-10T20:02:14.035 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:02:14.036 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T20:02:14.045 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T20:02:14.047 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T20:02:14.054 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T20:02:14.054 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.055 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-03-10T20:02:14.055 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.055 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-03-10 19:59:30.842030433 +0000 2021-03-10T20:02:14.055 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-03-10 19:59:30.674030436 +0000 2021-03-10T20:02:14.055 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-03-10 19:59:30.674030436 +0000 2021-03-10T20:02:14.056 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-03-10T20:02:14.057 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-03-10T20:02:14.057 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-03-10T20:02:14.057 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000231364 s, 2.2 MB/s 2021-03-10T20:02:14.058 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T20:02:14.063 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T20:02:14.063 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.063 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-03-10T20:02:14.064 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.064 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-03-10 19:59:31.182030426 +0000 2021-03-10T20:02:14.064 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-03-10 19:59:31.030030429 +0000 2021-03-10T20:02:14.064 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-03-10 19:59:31.030030429 +0000 2021-03-10T20:02:14.065 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-03-10T20:02:14.065 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-03-10T20:02:14.066 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-03-10T20:02:14.066 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000148581 s, 3.4 MB/s 2021-03-10T20:02:14.067 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T20:02:14.070 INFO:journalctl@ceph.mgr.x.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:14.072 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T20:02:14.073 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.073 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-03-10T20:02:14.073 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.074 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-03-10 19:59:31.550030418 +0000 2021-03-10T20:02:14.074 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-03-10 19:59:31.398030421 +0000 2021-03-10T20:02:14.074 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-03-10 19:59:31.398030421 +0000 2021-03-10T20:02:14.074 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-03-10T20:02:14.076 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-03-10T20:02:14.076 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-03-10T20:02:14.077 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000159828 s, 3.2 MB/s 2021-03-10T20:02:14.077 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T20:02:14.082 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T20:02:14.082 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.082 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-03-10T20:02:14.083 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.083 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-03-10 19:59:31.950030410 +0000 2021-03-10T20:02:14.083 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-03-10 19:59:31.814030413 +0000 2021-03-10T20:02:14.084 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-03-10 19:59:31.814030413 +0000 2021-03-10T20:02:14.084 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-03-10T20:02:14.086 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-03-10T20:02:14.087 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-03-10T20:02:14.087 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000204011 s, 2.5 MB/s 2021-03-10T20:02:14.089 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:02:14.089 DEBUG:teuthology.orchestra.run.gibba009:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T20:02:14.099 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T20:02:14.100 DEBUG:teuthology.orchestra.run.gibba009:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T20:02:14.146 INFO:teuthology.orchestra.run.gibba009.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T20:02:14.147 INFO:teuthology.orchestra.run.gibba009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.147 INFO:teuthology.orchestra.run.gibba009.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-03-10T20:02:14.147 INFO:teuthology.orchestra.run.gibba009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.148 INFO:teuthology.orchestra.run.gibba009.stdout:Access: 2021-03-10 19:59:30.703702904 +0000 2021-03-10T20:02:14.148 INFO:teuthology.orchestra.run.gibba009.stdout:Modify: 2021-03-10 19:59:30.567702900 +0000 2021-03-10T20:02:14.148 INFO:teuthology.orchestra.run.gibba009.stdout:Change: 2021-03-10 19:59:30.567702900 +0000 2021-03-10T20:02:14.149 INFO:teuthology.orchestra.run.gibba009.stdout: Birth: - 2021-03-10T20:02:14.152 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records in 2021-03-10T20:02:14.152 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records out 2021-03-10T20:02:14.153 INFO:teuthology.orchestra.run.gibba009.stderr:512 bytes copied, 0.000255585 s, 2.0 MB/s 2021-03-10T20:02:14.156 DEBUG:teuthology.orchestra.run.gibba009:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T20:02:14.162 INFO:teuthology.orchestra.run.gibba009.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T20:02:14.162 INFO:teuthology.orchestra.run.gibba009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.163 INFO:teuthology.orchestra.run.gibba009.stdout:Device: 6h/6d Inode: 373 Links: 1 2021-03-10T20:02:14.163 INFO:teuthology.orchestra.run.gibba009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.163 INFO:teuthology.orchestra.run.gibba009.stdout:Access: 2021-03-10 19:59:30.959702910 +0000 2021-03-10T20:02:14.163 INFO:teuthology.orchestra.run.gibba009.stdout:Modify: 2021-03-10 19:59:30.867702908 +0000 2021-03-10T20:02:14.164 INFO:teuthology.orchestra.run.gibba009.stdout:Change: 2021-03-10 19:59:30.867702908 +0000 2021-03-10T20:02:14.164 INFO:teuthology.orchestra.run.gibba009.stdout: Birth: - 2021-03-10T20:02:14.173 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records in 2021-03-10T20:02:14.174 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records out 2021-03-10T20:02:14.174 INFO:teuthology.orchestra.run.gibba009.stderr:512 bytes copied, 0.000398925 s, 1.3 MB/s 2021-03-10T20:02:14.180 DEBUG:teuthology.orchestra.run.gibba009:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T20:02:14.234 INFO:teuthology.orchestra.run.gibba009.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T20:02:14.235 INFO:teuthology.orchestra.run.gibba009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.235 INFO:teuthology.orchestra.run.gibba009.stdout:Device: 6h/6d Inode: 382 Links: 1 2021-03-10T20:02:14.236 INFO:teuthology.orchestra.run.gibba009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.236 INFO:teuthology.orchestra.run.gibba009.stdout:Access: 2021-03-10 19:59:31.303702919 +0000 2021-03-10T20:02:14.237 INFO:teuthology.orchestra.run.gibba009.stdout:Modify: 2021-03-10 19:59:31.147702915 +0000 2021-03-10T20:02:14.237 INFO:teuthology.orchestra.run.gibba009.stdout:Change: 2021-03-10 19:59:31.147702915 +0000 2021-03-10T20:02:14.238 INFO:teuthology.orchestra.run.gibba009.stdout: Birth: - 2021-03-10T20:02:14.239 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records in 2021-03-10T20:02:14.240 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records out 2021-03-10T20:02:14.240 INFO:teuthology.orchestra.run.gibba009.stderr:512 bytes copied, 0.000211042 s, 2.4 MB/s 2021-03-10T20:02:14.241 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: cluster 2021-03-10T20:02:12.291080+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:14.241 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.173347+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:02:14.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.181143+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:02:14.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.186101+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:14.243 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.194473+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:14.244 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.197337+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:14.244 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:13 gibba009 bash[9804]: audit 2021-03-10T20:02:13.200892+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:02:14.246 DEBUG:teuthology.orchestra.run.gibba009:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T20:02:14.250 INFO:teuthology.orchestra.run.gibba009.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T20:02:14.250 INFO:teuthology.orchestra.run.gibba009.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T20:02:14.251 INFO:teuthology.orchestra.run.gibba009.stdout:Device: 6h/6d Inode: 389 Links: 1 2021-03-10T20:02:14.251 INFO:teuthology.orchestra.run.gibba009.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T20:02:14.252 INFO:teuthology.orchestra.run.gibba009.stdout:Access: 2021-03-10 19:59:31.611702926 +0000 2021-03-10T20:02:14.252 INFO:teuthology.orchestra.run.gibba009.stdout:Modify: 2021-03-10 19:59:31.507702924 +0000 2021-03-10T20:02:14.253 INFO:teuthology.orchestra.run.gibba009.stdout:Change: 2021-03-10 19:59:31.507702924 +0000 2021-03-10T20:02:14.254 INFO:teuthology.orchestra.run.gibba009.stdout: Birth: - 2021-03-10T20:02:14.256 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records in 2021-03-10T20:02:14.257 INFO:teuthology.orchestra.run.gibba009.stderr:1+0 records out 2021-03-10T20:02:14.257 INFO:teuthology.orchestra.run.gibba009.stderr:512 bytes copied, 0.000171886 s, 3.0 MB/s 2021-03-10T20:02:14.258 INFO:tasks.cephadm:Deploying osd.0 on gibba004 with /dev/vg_nvme/lv_4... 2021-03-10T20:02:14.259 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T20:02:14.271 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: cluster 2021-03-10T20:02:12.291080+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:14.272 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.173347+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:02:14.272 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.181143+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:02:14.272 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.186101+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:14.273 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.194473+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:14.273 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.197337+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:14.273 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[9777]: audit 2021-03-10T20:02:13.200892+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:02:14.274 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: cluster 2021-03-10T20:02:12.291080+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:14.274 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.173347+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:02:14.274 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.181143+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:02:13.172342\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:02:14.274 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.186101+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:14.275 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.194473+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:14.275 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.197337+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:14.275 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:13 gibba004 bash[12967]: audit 2021-03-10T20:02:13.200892+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:02:15.251 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:14 gibba009 bash[9804]: audit 2021-03-10T20:02:13.170843+0000 mgr.y (mgr.14140) 33 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba004=y;gibba009=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:15.252 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:14 gibba009 bash[9804]: cephadm 2021-03-10T20:02:13.172303+0000 mgr.y (mgr.14140) 34 : cephadm [INF] Saving service mgr spec with placement count:3 gibba004=y,gibba009=x 2021-03-10T20:02:15.252 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:14 gibba009 bash[9804]: cephadm 2021-03-10T20:02:13.199786+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:02:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[9777]: audit 2021-03-10T20:02:13.170843+0000 mgr.y (mgr.14140) 33 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba004=y;gibba009=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[9777]: cephadm 2021-03-10T20:02:13.172303+0000 mgr.y (mgr.14140) 34 : cephadm [INF] Saving service mgr spec with placement count:3 gibba004=y,gibba009=x 2021-03-10T20:02:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[9777]: cephadm 2021-03-10T20:02:13.199786+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:02:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[12967]: audit 2021-03-10T20:02:13.170843+0000 mgr.y (mgr.14140) 33 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba004=y;gibba009=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[12967]: cephadm 2021-03-10T20:02:13.172303+0000 mgr.y (mgr.14140) 34 : cephadm [INF] Saving service mgr spec with placement count:3 gibba004=y,gibba009=x 2021-03-10T20:02:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:14 gibba004 bash[12967]: cephadm 2021-03-10T20:02:13.199786+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:02:15.589 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:02:15 gibba009 docker[10451]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mgr.x 2021-03-10T20:02:15.589 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:02:15 gibba009 systemd[1]: Started Ceph mgr.x for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:02:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: cluster 2021-03-10T20:02:14.291370+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.283773+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:16.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: cluster 2021-03-10T20:02:14.291370+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.283773+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:16.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.291636+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.292551+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.294674+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.295445+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[9777]: audit 2021-03-10T20:02:15.296005+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:02:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.291636+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.292551+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.294674+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.295445+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:16.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:16 gibba004 bash[12967]: audit 2021-03-10T20:02:15.296005+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:02:16.333 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: cluster 2021-03-10T20:02:14.291370+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:16.333 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.283773+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:16.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.291636+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:16.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.292551+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:02:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.294674+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T20:02:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.295445+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:16 gibba009 bash[9804]: audit 2021-03-10T20:02:15.296005+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:02:17.147 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T20:02:17.147 INFO:teuthology.orchestra.run.gibba004.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T20:02:17.147 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10+0 records in 2021-03-10T20:02:17.148 INFO:teuthology.orchestra.run.gibba004.stderr:10+0 records out 2021-03-10T20:02:17.148 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0289773 s, 362 MB/s 2021-03-10T20:02:17.148 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping successful for: 2021-03-10T20:02:17.287 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:17 gibba009 bash[9804]: cephadm 2021-03-10T20:02:15.295840+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:02:17.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:17 gibba004 bash[9777]: cephadm 2021-03-10T20:02:15.295840+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:02:17.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:17 gibba004 bash[12967]: cephadm 2021-03-10T20:02:15.295840+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:02:17.685 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba004:vg_nvme/lv_4 2021-03-10T20:02:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: cluster 2021-03-10T20:02:16.291912+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.319618+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: cluster 2021-03-10T20:02:16.291912+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.319618+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.327247+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.328802+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.327247+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.328802+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.660673+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.660673+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.668491+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.672873+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T20:02:18.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.675344+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:18.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[9777]: audit 2021-03-10T20:02:17.677243+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T20:02:18.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.668491+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.672873+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T20:02:18.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.675344+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:18.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:18 gibba004 bash[12967]: audit 2021-03-10T20:02:17.677243+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T20:02:18.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: cluster 2021-03-10T20:02:16.291912+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.319618+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.327247+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:01.216802\", \"created\": \"2021-03-10T20:02:01.043621\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.328802+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.660673+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.668491+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658137\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658449\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:17.658616\", \"created\": \"2021-03-10T20:02:17.307621\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:17.658881\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.672873+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T20:02:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.675344+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:18 gibba009 bash[9804]: audit 2021-03-10T20:02:17.677243+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T20:02:19.096 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:19 gibba004 bash[9777]: cephadm 2021-03-10T20:02:17.672171+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T20:02:19.096 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:19 gibba004 bash[9777]: cephadm 2021-03-10T20:02:17.676872+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:02:19.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:19 gibba004 bash[12967]: cephadm 2021-03-10T20:02:17.672171+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T20:02:19.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:19 gibba004 bash[12967]: cephadm 2021-03-10T20:02:17.676872+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:02:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:19 gibba009 bash[9804]: cephadm 2021-03-10T20:02:17.672171+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T20:02:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:19 gibba009 bash[9804]: cephadm 2021-03-10T20:02:17.676872+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:02:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: cluster 2021-03-10T20:02:18.292926+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: audit 2021-03-10T20:02:19.310782+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: audit 2021-03-10T20:02:19.311828+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:20.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: cluster 2021-03-10T20:02:19.312390+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:02:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: cluster 2021-03-10T20:02:18.292926+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: audit 2021-03-10T20:02:19.310782+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:20.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: audit 2021-03-10T20:02:19.311828+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:20.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: cluster 2021-03-10T20:02:19.312390+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:02:20.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: audit 2021-03-10T20:02:19.715859+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: audit 2021-03-10T20:02:19.718375+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[9777]: audit 2021-03-10T20:02:19.718970+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:20.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: audit 2021-03-10T20:02:19.715859+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:20.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: audit 2021-03-10T20:02:19.718375+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:20.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:20 gibba004 bash[12967]: audit 2021-03-10T20:02:19.718970+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:20.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: cluster 2021-03-10T20:02:18.292926+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: audit 2021-03-10T20:02:19.310782+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: audit 2021-03-10T20:02:19.311828+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.109:0/3982324220' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: cluster 2021-03-10T20:02:19.312390+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:02:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: audit 2021-03-10T20:02:19.715859+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: audit 2021-03-10T20:02:19.718375+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775212\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:47.775528\", \"created\": \"2021-03-10T20:01:47.270382\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:20 gibba009 bash[9804]: audit 2021-03-10T20:02:19.718970+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: cluster 2021-03-10T20:02:20.029368+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2021-03-10T20:02:21.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.029462+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:02:21.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: cluster 2021-03-10T20:02:20.029368+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2021-03-10T20:02:21.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.029462+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:02:21.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.130804+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:21.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.130804+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:21.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.133368+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:21.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.133790+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.133368+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:21.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.133790+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.451001+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:21.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.451001+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:21.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.459188+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:21.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: cluster 2021-03-10T20:02:20.891849+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon gibba009.xiladd started 2021-03-10T20:02:21.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.891942+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:21.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.892713+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:21.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.898295+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:21.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.899175+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:21.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[9777]: audit 2021-03-10T20:02:20.899920+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.459188+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:21.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: cluster 2021-03-10T20:02:20.891849+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon gibba009.xiladd started 2021-03-10T20:02:21.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.891942+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:21.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.892713+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:21.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.898295+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:21.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.899175+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:21.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:21 gibba004 bash[12967]: audit 2021-03-10T20:02:20.899920+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: cluster 2021-03-10T20:02:20.029368+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2021-03-10T20:02:21.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.029462+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:02:21.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.130804+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:21.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.133368+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.130330\", \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:21.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.133790+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:21.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.451001+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:02:21.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.459188+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}}, \"last_daemon_update\": \"2021-03-10T20:02:20.448993\", \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:02:21.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: cluster 2021-03-10T20:02:20.891849+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon gibba009.xiladd started 2021-03-10T20:02:21.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.891942+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:02:21.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.892713+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.109:0/3712737170' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:02:21.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.898295+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:21.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.899175+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:21.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:21 gibba009 bash[9804]: audit 2021-03-10T20:02:20.899920+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:22.139 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[9777]: cluster 2021-03-10T20:02:20.293812+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:22.140 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[9777]: audit 2021-03-10T20:02:20.897497+0000 mgr.y (mgr.14140) 43 : audit [DBG] from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:22.140 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[9777]: cephadm 2021-03-10T20:02:20.898099+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:22.140 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[9777]: cluster 2021-03-10T20:02:21.469105+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 73s), standbys: x, gibba009.xiladd 2021-03-10T20:02:22.141 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[9777]: audit 2021-03-10T20:02:21.469259+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:02:22.141 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[12967]: cluster 2021-03-10T20:02:20.293812+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:22.142 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[12967]: audit 2021-03-10T20:02:20.897497+0000 mgr.y (mgr.14140) 43 : audit [DBG] from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:22.142 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[12967]: cephadm 2021-03-10T20:02:20.898099+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:22.142 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[12967]: cluster 2021-03-10T20:02:21.469105+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 73s), standbys: x, gibba009.xiladd 2021-03-10T20:02:22.142 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:22 gibba004 bash[12967]: audit 2021-03-10T20:02:21.469259+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:02:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:22 gibba009 bash[9804]: cluster 2021-03-10T20:02:20.293812+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:22 gibba009 bash[9804]: audit 2021-03-10T20:02:20.897497+0000 mgr.y (mgr.14140) 43 : audit [DBG] from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:22 gibba009 bash[9804]: cephadm 2021-03-10T20:02:20.898099+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:22 gibba009 bash[9804]: cluster 2021-03-10T20:02:21.469105+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 73s), standbys: x, gibba009.xiladd 2021-03-10T20:02:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:22 gibba009 bash[9804]: audit 2021-03-10T20:02:21.469259+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:02:23.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:23 gibba004 bash[9777]: cluster 2021-03-10T20:02:21.919206+0000 mgr.gibba009.xiladd (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:02:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:23 gibba004 bash[12967]: cluster 2021-03-10T20:02:21.919206+0000 mgr.gibba009.xiladd (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:02:23.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:23 gibba009 bash[9804]: cluster 2021-03-10T20:02:21.919206+0000 mgr.gibba009.xiladd (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:02:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: cluster 2021-03-10T20:02:22.294607+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: audit 2021-03-10T20:02:23.904630+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.2.104:0/1338931646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: audit 2021-03-10T20:02:23.904942+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: audit 2021-03-10T20:02:23.909950+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]': finished 2021-03-10T20:02:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: cluster 2021-03-10T20:02:23.909995+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T20:02:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[9777]: audit 2021-03-10T20:02:23.910093+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: cluster 2021-03-10T20:02:22.294607+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: audit 2021-03-10T20:02:23.904630+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.2.104:0/1338931646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: audit 2021-03-10T20:02:23.904942+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: audit 2021-03-10T20:02:23.909950+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]': finished 2021-03-10T20:02:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: cluster 2021-03-10T20:02:23.909995+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T20:02:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:24 gibba004 bash[12967]: audit 2021-03-10T20:02:23.910093+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: cluster 2021-03-10T20:02:22.294607+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: audit 2021-03-10T20:02:23.904630+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.2.104:0/1338931646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: audit 2021-03-10T20:02:23.904942+0000 mon.a (mon.0) 192 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]: dispatch 2021-03-10T20:02:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: audit 2021-03-10T20:02:23.909950+0000 mon.a (mon.0) 193 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5fa3f778-fb57-4629-9998-3af3a89cf491"}]': finished 2021-03-10T20:02:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: cluster 2021-03-10T20:02:23.909995+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T20:02:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:24 gibba009 bash[9804]: audit 2021-03-10T20:02:23.910093+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:26 gibba009 bash[9804]: cluster 2021-03-10T20:02:24.295213+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:26 gibba009 bash[9804]: audit 2021-03-10T20:02:25.909641+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.104:0/1197775671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:26 gibba004 bash[9777]: cluster 2021-03-10T20:02:24.295213+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:26.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:26 gibba004 bash[9777]: audit 2021-03-10T20:02:25.909641+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.104:0/1197775671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:26.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:26 gibba004 bash[12967]: cluster 2021-03-10T20:02:24.295213+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:26.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:26 gibba004 bash[12967]: audit 2021-03-10T20:02:25.909641+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.104:0/1197775671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:27.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:27 gibba004 bash[9777]: cluster 2021-03-10T20:02:26.295821+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:27.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:27 gibba004 bash[12967]: cluster 2021-03-10T20:02:26.295821+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:27.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:27 gibba009 bash[9804]: cluster 2021-03-10T20:02:26.295821+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:29.537 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:29 gibba004 bash[9777]: cluster 2021-03-10T20:02:28.296478+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:29.538 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:29 gibba004 bash[9777]: audit 2021-03-10T20:02:28.485964+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:29.538 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:29 gibba004 bash[12967]: cluster 2021-03-10T20:02:28.296478+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:29.538 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:29 gibba004 bash[12967]: audit 2021-03-10T20:02:28.485964+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:29.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:29 gibba009 bash[9804]: cluster 2021-03-10T20:02:28.296478+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:29.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:29 gibba009 bash[9804]: audit 2021-03-10T20:02:28.485964+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:31.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:31 gibba004 bash[9777]: cluster 2021-03-10T20:02:30.297457+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:31.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:31 gibba004 bash[12967]: cluster 2021-03-10T20:02:30.297457+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:31.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:31 gibba009 bash[9804]: cluster 2021-03-10T20:02:30.297457+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:32.688 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[9777]: audit 2021-03-10T20:02:31.572314+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:02:32.688 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[9777]: audit 2021-03-10T20:02:31.573257+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:32.688 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[9777]: cephadm 2021-03-10T20:02:31.573881+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:02:32.689 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[9777]: audit 2021-03-10T20:02:31.574064+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:02:32.689 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[12967]: audit 2021-03-10T20:02:31.572314+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:02:32.689 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[12967]: audit 2021-03-10T20:02:31.573257+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:32.690 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[12967]: cephadm 2021-03-10T20:02:31.573881+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:02:32.690 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:32 gibba004 bash[12967]: audit 2021-03-10T20:02:31.574064+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:02:32.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:32 gibba009 bash[9804]: audit 2021-03-10T20:02:31.572314+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:02:32.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:32 gibba009 bash[9804]: audit 2021-03-10T20:02:31.573257+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:32.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:32 gibba009 bash[9804]: cephadm 2021-03-10T20:02:31.573881+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:02:32.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:32 gibba009 bash[9804]: audit 2021-03-10T20:02:31.574064+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.338 INFO:teuthology.orchestra.run.gibba004.stdout:Created osd(s) 0 on host 'gibba004' 2021-03-10T20:02:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[9777]: cluster 2021-03-10T20:02:32.298255+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[12967]: cluster 2021-03-10T20:02:32.298255+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[12967]: audit 2021-03-10T20:02:33.333731+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[12967]: audit 2021-03-10T20:02:33.334209+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[12967]: audit 2021-03-10T20:02:33.337224+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[9777]: audit 2021-03-10T20:02:33.333731+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[9777]: audit 2021-03-10T20:02:33.334209+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:33 gibba004 bash[9777]: audit 2021-03-10T20:02:33.337224+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:33.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:33 gibba009 bash[9804]: cluster 2021-03-10T20:02:32.298255+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:33.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:33 gibba009 bash[9804]: audit 2021-03-10T20:02:33.333731+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:33.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:33 gibba009 bash[9804]: audit 2021-03-10T20:02:33.334209+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:33 gibba009 bash[9804]: audit 2021-03-10T20:02:33.337224+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130171\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130239\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.130271\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_device_update\": \"2021-03-10T20:01:14.261184\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:34.554 DEBUG:teuthology.orchestra.run.gibba004:osd.0> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.0.service 2021-03-10T20:02:34.557 INFO:tasks.cephadm:Deploying osd.1 on gibba004 with /dev/vg_nvme/lv_3... 2021-03-10T20:02:34.557 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T20:02:34.604 INFO:journalctl@ceph.osd.0.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:34.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[9777]: audit 2021-03-10T20:02:33.801134+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:34.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[9777]: audit 2021-03-10T20:02:33.807425+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:34.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[9777]: audit 2021-03-10T20:02:33.808701+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:34.656 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[12967]: audit 2021-03-10T20:02:33.801134+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:34.657 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[12967]: audit 2021-03-10T20:02:33.807425+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:34.657 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:34 gibba004 bash[12967]: audit 2021-03-10T20:02:33.808701+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:34.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:34 gibba009 bash[9804]: audit 2021-03-10T20:02:33.801134+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:34.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:34 gibba009 bash[9804]: audit 2021-03-10T20:02:33.807425+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:34.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:34 gibba009 bash[9804]: audit 2021-03-10T20:02:33.808701+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[9777]: cluster 2021-03-10T20:02:34.298887+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[12967]: cluster 2021-03-10T20:02:34.298887+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:36.064 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:02:36.064 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T20:02:36.065 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:02:36.065 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:02:36.065 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:02:36.065 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:02:36.066 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:35 gibba004 bash[14589]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T20:02:36.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:35 gibba009 bash[9804]: cluster 2021-03-10T20:02:34.298887+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:37.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:37 gibba004 bash[9777]: cluster 2021-03-10T20:02:36.299206+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:37.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:37 gibba004 bash[12967]: cluster 2021-03-10T20:02:36.299206+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:37.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:37 gibba009 bash[9804]: cluster 2021-03-10T20:02:36.299206+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:39.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:39 gibba004 bash[9777]: cluster 2021-03-10T20:02:38.299744+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:39.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:39 gibba004 bash[12967]: cluster 2021-03-10T20:02:38.299744+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:39.564 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:39 gibba004 bash[14889]: debug 2021-03-10T20:02:39.302+0000 7efc71e6fec0 -1 Falling back to public interface 2021-03-10T20:02:39.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:39 gibba009 bash[9804]: cluster 2021-03-10T20:02:38.299744+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:40.001 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T20:02:40.001 INFO:teuthology.orchestra.run.gibba004.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T20:02:40.001 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10+0 records in 2021-03-10T20:02:40.002 INFO:teuthology.orchestra.run.gibba004.stderr:10+0 records out 2021-03-10T20:02:40.002 INFO:teuthology.orchestra.run.gibba004.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00766084 s, 1.4 GB/s 2021-03-10T20:02:40.002 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping successful for: 2021-03-10T20:02:40.313 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:39 gibba004 bash[14889]: debug 2021-03-10T20:02:39.986+0000 7efc71e6fec0 -1 osd.0 0 log_to_monitors {default=true} 2021-03-10T20:02:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:40 gibba004 bash[9777]: audit 2021-03-10T20:02:39.994876+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:40 gibba004 bash[9777]: audit 2021-03-10T20:02:39.995084+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:40.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:40 gibba004 bash[12967]: audit 2021-03-10T20:02:39.994876+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:40.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:40 gibba004 bash[12967]: audit 2021-03-10T20:02:39.995084+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:40 gibba009 bash[9804]: audit 2021-03-10T20:02:39.994876+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:40 gibba009 bash[9804]: audit 2021-03-10T20:02:39.995084+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:02:41.038 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba004:vg_nvme/lv_3 2021-03-10T20:02:41.814 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[14889]: debug 2021-03-10T20:02:41.386+0000 7efc56c1c700 -1 osd.0 0 waiting for initial osdmap 2021-03-10T20:02:41.814 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[14889]: debug 2021-03-10T20:02:41.386+0000 7efc61e38700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:02:41.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: cluster 2021-03-10T20:02:40.300478+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:41.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:40.381915+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:02:41.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: cluster 2021-03-10T20:02:40.382113+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:02:41.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:40.382537+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:41.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:40.383749+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:40.384801+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: cluster 2021-03-10T20:02:40.964493+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:41.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: cluster 2021-03-10T20:02:40.964598+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:41.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:41.136544+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:41.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: cluster 2021-03-10T20:02:40.300478+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:41.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:40.381915+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:02:41.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: cluster 2021-03-10T20:02:40.382113+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:02:41.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:40.382537+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:41.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:40.383749+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:40.384801+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: cluster 2021-03-10T20:02:40.964493+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:41.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: cluster 2021-03-10T20:02:40.964598+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:41.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:41.136544+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:41.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:41.232001+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:41.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[9777]: audit 2021-03-10T20:02:41.236112+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:41.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:41.232001+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:41.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:41 gibba004 bash[12967]: audit 2021-03-10T20:02:41.236112+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:41.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: cluster 2021-03-10T20:02:40.300478+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:41.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:40.381915+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:02:41.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: cluster 2021-03-10T20:02:40.382113+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:02:41.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:40.382537+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:41.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:40.383749+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:40.384801+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:02:41.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: cluster 2021-03-10T20:02:40.964493+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:41.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: cluster 2021-03-10T20:02:40.964598+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:41.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:41.136544+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:41.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:41.232001+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:41.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:41 gibba009 bash[9804]: audit 2021-03-10T20:02:41.236112+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}}, \"last_daemon_update\": \"2021-03-10T20:02:33.799996\", \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:42.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[12967]: audit 2021-03-10T20:02:41.386471+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:02:42.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[12967]: cluster 2021-03-10T20:02:41.386591+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:02:42.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[12967]: audit 2021-03-10T20:02:41.387427+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:42.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[9777]: audit 2021-03-10T20:02:41.386471+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:02:42.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[9777]: cluster 2021-03-10T20:02:41.386591+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:02:42.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:42 gibba004 bash[9777]: audit 2021-03-10T20:02:41.387427+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:42.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:42 gibba009 bash[9804]: audit 2021-03-10T20:02:41.386471+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:02:42.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:42 gibba009 bash[9804]: cluster 2021-03-10T20:02:41.386591+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:02:42.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:42 gibba009 bash[9804]: audit 2021-03-10T20:02:41.387427+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:43.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[9777]: cluster 2021-03-10T20:02:42.301255+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:43.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[9777]: cluster 2021-03-10T20:02:42.402101+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850] boot 2021-03-10T20:02:43.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[9777]: cluster 2021-03-10T20:02:42.402124+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:02:43.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[9777]: audit 2021-03-10T20:02:42.402805+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:43.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[9777]: cluster 2021-03-10T20:02:43.399149+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:02:43.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[12967]: cluster 2021-03-10T20:02:42.301255+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:43.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[12967]: cluster 2021-03-10T20:02:42.402101+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850] boot 2021-03-10T20:02:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[12967]: cluster 2021-03-10T20:02:42.402124+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:02:43.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[12967]: audit 2021-03-10T20:02:42.402805+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:43.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:43 gibba004 bash[12967]: cluster 2021-03-10T20:02:43.399149+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:02:43.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:43 gibba009 bash[9804]: cluster 2021-03-10T20:02:42.301255+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:02:43.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:43 gibba009 bash[9804]: cluster 2021-03-10T20:02:42.402101+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.104:6802/4027763850,v1:172.21.2.104:6803/4027763850] boot 2021-03-10T20:02:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:43 gibba009 bash[9804]: cluster 2021-03-10T20:02:42.402124+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:02:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:43 gibba009 bash[9804]: audit 2021-03-10T20:02:42.402805+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:02:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:43 gibba009 bash[9804]: cluster 2021-03-10T20:02:43.399149+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:02:44.696 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: audit 2021-03-10T20:02:43.583089+0000 mgr.y (mgr.14140) 57 : audit [DBG] from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:44.697 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: cephadm 2021-03-10T20:02:43.583683+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:44.697 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: audit 2021-03-10T20:02:43.583924+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:44.697 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: audit 2021-03-10T20:02:43.584859+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:44.697 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: audit 2021-03-10T20:02:43.585877+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:44.697 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[9777]: cluster 2021-03-10T20:02:44.408121+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:02:44.698 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: audit 2021-03-10T20:02:43.583089+0000 mgr.y (mgr.14140) 57 : audit [DBG] from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:44.698 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: cephadm 2021-03-10T20:02:43.583683+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:44.698 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: audit 2021-03-10T20:02:43.583924+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:44.699 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: audit 2021-03-10T20:02:43.584859+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:44.699 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: audit 2021-03-10T20:02:43.585877+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:44.699 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:44 gibba004 bash[12967]: cluster 2021-03-10T20:02:44.408121+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:02:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: audit 2021-03-10T20:02:43.583089+0000 mgr.y (mgr.14140) 57 : audit [DBG] from='client.24130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: cephadm 2021-03-10T20:02:43.583683+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:02:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: audit 2021-03-10T20:02:43.583924+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: audit 2021-03-10T20:02:43.584859+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: audit 2021-03-10T20:02:43.585877+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:44 gibba009 bash[9804]: cluster 2021-03-10T20:02:44.408121+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:02:45.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:45 gibba004 bash[9777]: cluster 2021-03-10T20:02:44.302096+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:45.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:45 gibba004 bash[9777]: cluster 2021-03-10T20:02:44.408892+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:45.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:45 gibba004 bash[12967]: cluster 2021-03-10T20:02:44.302096+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:45.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:45 gibba004 bash[12967]: cluster 2021-03-10T20:02:44.408892+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:45 gibba009 bash[9804]: cluster 2021-03-10T20:02:44.302096+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:45 gibba009 bash[9804]: cluster 2021-03-10T20:02:44.408892+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[9777]: cluster 2021-03-10T20:02:46.302654+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[9777]: audit 2021-03-10T20:02:46.423543+0000 mon.a (mon.0) 227 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]: dispatch 2021-03-10T20:02:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[9777]: audit 2021-03-10T20:02:46.429007+0000 mon.a (mon.0) 228 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]': finished 2021-03-10T20:02:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[9777]: cluster 2021-03-10T20:02:46.429032+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:02:47.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[9777]: audit 2021-03-10T20:02:46.429175+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:02:47.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[12967]: cluster 2021-03-10T20:02:46.302654+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:47.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[12967]: audit 2021-03-10T20:02:46.423543+0000 mon.a (mon.0) 227 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]: dispatch 2021-03-10T20:02:47.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[12967]: audit 2021-03-10T20:02:46.429007+0000 mon.a (mon.0) 228 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]': finished 2021-03-10T20:02:47.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[12967]: cluster 2021-03-10T20:02:46.429032+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:02:47.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:47 gibba004 bash[12967]: audit 2021-03-10T20:02:46.429175+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:02:47.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:47 gibba009 bash[9804]: cluster 2021-03-10T20:02:46.302654+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:47.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:47 gibba009 bash[9804]: audit 2021-03-10T20:02:46.423543+0000 mon.a (mon.0) 227 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]: dispatch 2021-03-10T20:02:47.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:47 gibba009 bash[9804]: audit 2021-03-10T20:02:46.429007+0000 mon.a (mon.0) 228 : audit [INF] from='client.? 172.21.2.104:0/2960091217' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5615c721-c970-4d6c-9e75-6cfca4c38bef"}]': finished 2021-03-10T20:02:47.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:47 gibba009 bash[9804]: cluster 2021-03-10T20:02:46.429032+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:02:47.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:47 gibba009 bash[9804]: audit 2021-03-10T20:02:46.429175+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:02:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:49 gibba004 bash[9777]: cluster 2021-03-10T20:02:48.302888+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:49.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:49 gibba004 bash[9777]: audit 2021-03-10T20:02:48.425345+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.104:0/39548496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:49 gibba004 bash[12967]: cluster 2021-03-10T20:02:48.302888+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:49 gibba004 bash[12967]: audit 2021-03-10T20:02:48.425345+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.104:0/39548496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:49.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:49 gibba009 bash[9804]: cluster 2021-03-10T20:02:48.302888+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:49.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:49 gibba009 bash[9804]: audit 2021-03-10T20:02:48.425345+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.104:0/39548496' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:50 gibba004 bash[9777]: cluster 2021-03-10T20:02:50.361448+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:50 gibba004 bash[12967]: cluster 2021-03-10T20:02:50.361448+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:50.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:50 gibba009 bash[9804]: cluster 2021-03-10T20:02:50.361448+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:02:51.770 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:51 gibba004 bash[9777]: cluster 2021-03-10T20:02:50.303782+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:51.771 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:51 gibba004 bash[9777]: audit 2021-03-10T20:02:50.945220+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:51.771 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:51 gibba004 bash[12967]: cluster 2021-03-10T20:02:50.303782+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:51.772 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:51 gibba004 bash[12967]: audit 2021-03-10T20:02:50.945220+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:51.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:51 gibba009 bash[9804]: cluster 2021-03-10T20:02:50.303782+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:51.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:51 gibba009 bash[9804]: audit 2021-03-10T20:02:50.945220+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:53.685 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:53 gibba004 bash[9777]: cluster 2021-03-10T20:02:52.304618+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:53.685 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:53 gibba004 bash[12967]: cluster 2021-03-10T20:02:52.304618+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:53 gibba009 bash[9804]: cluster 2021-03-10T20:02:52.304618+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:54.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[9777]: audit 2021-03-10T20:02:54.266209+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:02:54.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[9777]: audit 2021-03-10T20:02:54.266815+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:54.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[9777]: audit 2021-03-10T20:02:54.267415+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:02:54.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[12967]: audit 2021-03-10T20:02:54.266209+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:02:54.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[12967]: audit 2021-03-10T20:02:54.266815+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:54.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:54 gibba004 bash[12967]: audit 2021-03-10T20:02:54.267415+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:02:54.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:54 gibba009 bash[9804]: audit 2021-03-10T20:02:54.266209+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:02:54.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:54 gibba009 bash[9804]: audit 2021-03-10T20:02:54.266815+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:54.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:54 gibba009 bash[9804]: audit 2021-03-10T20:02:54.267415+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:02:55.734 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:55 gibba004 bash[9777]: cephadm 2021-03-10T20:02:54.267251+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:02:55.734 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:55 gibba004 bash[9777]: cluster 2021-03-10T20:02:54.304947+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:55.735 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:55 gibba004 bash[12967]: cephadm 2021-03-10T20:02:54.267251+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:02:55.735 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:55 gibba004 bash[12967]: cluster 2021-03-10T20:02:54.304947+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:55 gibba009 bash[9804]: cephadm 2021-03-10T20:02:54.267251+0000 mgr.y (mgr.14140) 64 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:02:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:55 gibba009 bash[9804]: cluster 2021-03-10T20:02:54.304947+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:56.032 INFO:teuthology.orchestra.run.gibba004.stdout:Created osd(s) 1 on host 'gibba004' 2021-03-10T20:02:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[9777]: audit 2021-03-10T20:02:56.025700+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[9777]: audit 2021-03-10T20:02:56.026295+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:56.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[9777]: audit 2021-03-10T20:02:56.029616+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[12967]: audit 2021-03-10T20:02:56.025700+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[12967]: audit 2021-03-10T20:02:56.026295+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:56.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:56 gibba004 bash[12967]: audit 2021-03-10T20:02:56.029616+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:56.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:56 gibba009 bash[9804]: audit 2021-03-10T20:02:56.025700+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:56.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:56 gibba009 bash[9804]: audit 2021-03-10T20:02:56.026295+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:56.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:56 gibba009 bash[9804]: audit 2021-03-10T20:02:56.029616+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799550\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799697\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799784\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:33.799863\", \"created\": \"2021-03-10T20:02:33.318381\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_device_update\": \"2021-03-10T20:02:41.231507\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:57.249 DEBUG:teuthology.orchestra.run.gibba004:osd.1> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.1.service 2021-03-10T20:02:57.252 INFO:tasks.cephadm:Deploying osd.2 on gibba004 with /dev/vg_nvme/lv_2... 2021-03-10T20:02:57.252 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T20:02:57.300 INFO:journalctl@ceph.osd.1.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[9777]: cluster 2021-03-10T20:02:56.305186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[12967]: cluster 2021-03-10T20:02:56.305186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[12967]: audit 2021-03-10T20:02:56.473653+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[9777]: audit 2021-03-10T20:02:56.473653+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[9777]: audit 2021-03-10T20:02:56.477266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[9777]: audit 2021-03-10T20:02:56.477942+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[12967]: audit 2021-03-10T20:02:56.477266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:57 gibba004 bash[12967]: audit 2021-03-10T20:02:56.477942+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:57 gibba009 bash[9804]: cluster 2021-03-10T20:02:56.305186+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:57 gibba009 bash[9804]: audit 2021-03-10T20:02:56.473653+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:02:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:57 gibba009 bash[9804]: audit 2021-03-10T20:02:56.477266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:02:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:57 gibba009 bash[9804]: audit 2021-03-10T20:02:56.477942+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:58.502 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:02:58.503 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T20:02:58.503 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:02:58.503 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:02:58.503 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:02:58.504 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:02:58.504 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:02:58 gibba004 bash[16036]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T20:02:59.618 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:02:59 gibba004 bash[9777]: cluster 2021-03-10T20:02:58.305410+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:59.619 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:02:59 gibba004 bash[12967]: cluster 2021-03-10T20:02:58.305410+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:02:59.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:02:59 gibba009 bash[9804]: cluster 2021-03-10T20:02:58.305410+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:01.731 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:01 gibba004 bash[9777]: cluster 2021-03-10T20:03:00.306193+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:01.732 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:01 gibba004 bash[12967]: cluster 2021-03-10T20:03:00.306193+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:01.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:01 gibba009 bash[9804]: cluster 2021-03-10T20:03:00.306193+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:02.210 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T20:03:02.210 INFO:teuthology.orchestra.run.gibba004.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T20:03:02.211 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10+0 records in 2021-03-10T20:03:02.211 INFO:teuthology.orchestra.run.gibba004.stderr:10+0 records out 2021-03-10T20:03:02.211 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00864304 s, 1.2 GB/s 2021-03-10T20:03:02.211 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping successful for: 2021-03-10T20:03:02.563 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:03:02 gibba004 bash[16413]: debug 2021-03-10T20:03:02.334+0000 7fb6b0a0dec0 -1 Falling back to public interface 2021-03-10T20:03:02.776 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba004:vg_nvme/lv_2 2021-03-10T20:03:03.067 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:03:02 gibba004 bash[16413]: debug 2021-03-10T20:03:02.974+0000 7fb6b0a0dec0 -1 osd.1 0 log_to_monitors {default=true} 2021-03-10T20:03:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[9777]: cluster 2021-03-10T20:03:02.306753+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[9777]: audit 2021-03-10T20:03:02.980180+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[9777]: audit 2021-03-10T20:03:02.980389+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[12967]: cluster 2021-03-10T20:03:02.306753+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[12967]: audit 2021-03-10T20:03:02.980180+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:03 gibba004 bash[12967]: audit 2021-03-10T20:03:02.980389+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:03.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:03 gibba009 bash[9804]: cluster 2021-03-10T20:03:02.306753+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:03.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:03 gibba009 bash[9804]: audit 2021-03-10T20:03:02.980180+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:03 gibba009 bash[9804]: audit 2021-03-10T20:03:02.980389+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:03:04.563 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[16413]: debug 2021-03-10T20:03:04.510+0000 7fb6957ba700 -1 osd.1 0 waiting for initial osdmap 2021-03-10T20:03:04.563 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[16413]: debug 2021-03-10T20:03:04.518+0000 7fb6a09d6700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:03:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:03.494019+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:03:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: cluster 2021-03-10T20:03:03.494170+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:03:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:03.494587+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:04.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:03.495774+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:03.496676+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:04.036672+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:03.494019+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:03:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: cluster 2021-03-10T20:03:03.494170+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:03:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:03.494587+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:03.495774+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:03.496676+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:04.036672+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:04.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:04.140704+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:04.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[12967]: audit 2021-03-10T20:03:04.144680+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:04.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:04.140704+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:04.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:04 gibba004 bash[9777]: audit 2021-03-10T20:03:04.144680+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:04.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:03.494019+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:03:04.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: cluster 2021-03-10T20:03:03.494170+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:03:04.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:03.494587+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:04.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:03.495774+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:03.496676+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:04.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:04.036672+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:04.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:04.140704+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:04.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:04 gibba009 bash[9804]: audit 2021-03-10T20:03:04.144680+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}}, \"last_daemon_update\": \"2021-03-10T20:02:56.473085\", \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: cluster 2021-03-10T20:03:04.000833+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: cluster 2021-03-10T20:03:04.000944+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: cluster 2021-03-10T20:03:04.307312+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: audit 2021-03-10T20:03:04.498685+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: cluster 2021-03-10T20:03:04.498832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:03:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[9777]: audit 2021-03-10T20:03:04.500568+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: cluster 2021-03-10T20:03:04.000833+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: cluster 2021-03-10T20:03:04.000944+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: cluster 2021-03-10T20:03:04.307312+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: audit 2021-03-10T20:03:04.498685+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: cluster 2021-03-10T20:03:04.498832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:03:05.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:05 gibba004 bash[12967]: audit 2021-03-10T20:03:04.500568+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:05.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: cluster 2021-03-10T20:03:04.000833+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:05.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: cluster 2021-03-10T20:03:04.000944+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: cluster 2021-03-10T20:03:04.307312+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: audit 2021-03-10T20:03:04.498685+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: cluster 2021-03-10T20:03:04.498832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:03:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:05 gibba009 bash[9804]: audit 2021-03-10T20:03:04.500568+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:06.810 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: cluster 2021-03-10T20:03:05.509318+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837] boot 2021-03-10T20:03:06.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: cluster 2021-03-10T20:03:05.509342+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:03:06.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: audit 2021-03-10T20:03:05.509780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:06.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: audit 2021-03-10T20:03:05.778087+0000 mgr.y (mgr.14140) 71 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:06.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: cephadm 2021-03-10T20:03:05.778542+0000 mgr.y (mgr.14140) 72 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: audit 2021-03-10T20:03:05.778760+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: audit 2021-03-10T20:03:05.779544+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[9777]: audit 2021-03-10T20:03:05.780516+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:06.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: cluster 2021-03-10T20:03:05.509318+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837] boot 2021-03-10T20:03:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: cluster 2021-03-10T20:03:05.509342+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:03:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: audit 2021-03-10T20:03:05.509780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: audit 2021-03-10T20:03:05.778087+0000 mgr.y (mgr.14140) 71 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: cephadm 2021-03-10T20:03:05.778542+0000 mgr.y (mgr.14140) 72 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: audit 2021-03-10T20:03:05.778760+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: audit 2021-03-10T20:03:05.779544+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:06 gibba004 bash[12967]: audit 2021-03-10T20:03:05.780516+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:06.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: cluster 2021-03-10T20:03:05.509318+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.104:6810/1691648837,v1:172.21.2.104:6811/1691648837] boot 2021-03-10T20:03:06.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: cluster 2021-03-10T20:03:05.509342+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:03:06.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: audit 2021-03-10T20:03:05.509780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:03:06.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: audit 2021-03-10T20:03:05.778087+0000 mgr.y (mgr.14140) 71 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:06.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: cephadm 2021-03-10T20:03:05.778542+0000 mgr.y (mgr.14140) 72 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:06.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: audit 2021-03-10T20:03:05.778760+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:06.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: audit 2021-03-10T20:03:05.779544+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:06.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:06 gibba009 bash[9804]: audit 2021-03-10T20:03:05.780516+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[9777]: cluster 2021-03-10T20:03:06.307787+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[9777]: cluster 2021-03-10T20:03:06.531905+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:03:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[9777]: audit 2021-03-10T20:03:06.982495+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]: dispatch 2021-03-10T20:03:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[9777]: audit 2021-03-10T20:03:06.987593+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]': finished 2021-03-10T20:03:07.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[12967]: cluster 2021-03-10T20:03:06.307787+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[12967]: cluster 2021-03-10T20:03:06.531905+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:03:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[12967]: audit 2021-03-10T20:03:06.982495+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]: dispatch 2021-03-10T20:03:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:07 gibba004 bash[12967]: audit 2021-03-10T20:03:06.987593+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]': finished 2021-03-10T20:03:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:07 gibba009 bash[9804]: cluster 2021-03-10T20:03:06.307787+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:03:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:07 gibba009 bash[9804]: cluster 2021-03-10T20:03:06.531905+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:03:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:07 gibba009 bash[9804]: audit 2021-03-10T20:03:06.982495+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]: dispatch 2021-03-10T20:03:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:07 gibba009 bash[9804]: audit 2021-03-10T20:03:06.987593+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-200108"}]': finished 2021-03-10T20:03:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[9777]: cluster 2021-03-10T20:03:08.308311+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[9777]: audit 2021-03-10T20:03:08.601486+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]: dispatch 2021-03-10T20:03:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[9777]: audit 2021-03-10T20:03:08.605763+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]': finished 2021-03-10T20:03:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[9777]: cluster 2021-03-10T20:03:08.605800+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:03:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[9777]: audit 2021-03-10T20:03:08.605991+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[12967]: cluster 2021-03-10T20:03:08.308311+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[12967]: audit 2021-03-10T20:03:08.601486+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]: dispatch 2021-03-10T20:03:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[12967]: audit 2021-03-10T20:03:08.605763+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]': finished 2021-03-10T20:03:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[12967]: cluster 2021-03-10T20:03:08.605800+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:03:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:09 gibba004 bash[12967]: audit 2021-03-10T20:03:08.605991+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:09.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:09 gibba009 bash[9804]: cluster 2021-03-10T20:03:08.308311+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:09.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:09 gibba009 bash[9804]: audit 2021-03-10T20:03:08.601486+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]: dispatch 2021-03-10T20:03:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:09 gibba009 bash[9804]: audit 2021-03-10T20:03:08.605763+0000 mon.a (mon.0) 264 : audit [INF] from='client.? 172.21.2.104:0/2205750191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2fcc45a-ea77-4424-82b2-630e2c9a2e90"}]': finished 2021-03-10T20:03:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:09 gibba009 bash[9804]: cluster 2021-03-10T20:03:08.605800+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:03:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:09 gibba009 bash[9804]: audit 2021-03-10T20:03:08.605991+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:10 gibba004 bash[9777]: audit 2021-03-10T20:03:10.502473+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.104:0/4026710755' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:10 gibba004 bash[12967]: audit 2021-03-10T20:03:10.502473+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.104:0/4026710755' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:10.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:10 gibba009 bash[9804]: audit 2021-03-10T20:03:10.502473+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.104:0/4026710755' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:11.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:11 gibba004 bash[9777]: cluster 2021-03-10T20:03:10.308551+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:11.973 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:11 gibba004 bash[12967]: cluster 2021-03-10T20:03:10.308551+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:11.974 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:11 gibba009 bash[9804]: cluster 2021-03-10T20:03:10.308551+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:03:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:12 gibba004 bash[9777]: cluster 2021-03-10T20:03:12.560998+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:03:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:12 gibba004 bash[9777]: cluster 2021-03-10T20:03:12.561023+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:03:12.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:12 gibba004 bash[12967]: cluster 2021-03-10T20:03:12.560998+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:03:12.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:12 gibba004 bash[12967]: cluster 2021-03-10T20:03:12.561023+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:03:13.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:12 gibba009 bash[9804]: cluster 2021-03-10T20:03:12.560998+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:03:13.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:12 gibba009 bash[9804]: cluster 2021-03-10T20:03:12.561023+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:03:13.882 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:13 gibba004 bash[9777]: cluster 2021-03-10T20:03:12.309493+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:13.882 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:13 gibba004 bash[9777]: audit 2021-03-10T20:03:13.064642+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:13.883 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:13 gibba004 bash[12967]: cluster 2021-03-10T20:03:12.309493+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:13.883 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:13 gibba004 bash[12967]: audit 2021-03-10T20:03:13.064642+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:14.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:13 gibba009 bash[9804]: cluster 2021-03-10T20:03:12.309493+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:14.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:13 gibba009 bash[9804]: audit 2021-03-10T20:03:13.064642+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:15 gibba004 bash[9777]: cluster 2021-03-10T20:03:14.310481+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:16.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:15 gibba004 bash[12967]: cluster 2021-03-10T20:03:14.310481+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:16.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:15 gibba009 bash[9804]: cluster 2021-03-10T20:03:14.310481+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:16.970 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[12967]: audit 2021-03-10T20:03:16.218874+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:03:16.971 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[12967]: audit 2021-03-10T20:03:16.219694+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:16.971 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[12967]: audit 2021-03-10T20:03:16.220533+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:03:16.971 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[9777]: audit 2021-03-10T20:03:16.218874+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:03:16.972 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[9777]: audit 2021-03-10T20:03:16.219694+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:16.972 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:16 gibba004 bash[9777]: audit 2021-03-10T20:03:16.220533+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:03:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:16 gibba009 bash[9804]: audit 2021-03-10T20:03:16.218874+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:03:17.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:16 gibba009 bash[9804]: audit 2021-03-10T20:03:16.219694+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:17.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:16 gibba009 bash[9804]: audit 2021-03-10T20:03:16.220533+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:03:17.895 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:17 gibba004 bash[9777]: cephadm 2021-03-10T20:03:16.220332+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:03:17.896 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:17 gibba004 bash[9777]: cluster 2021-03-10T20:03:16.310818+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:17.896 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:17 gibba004 bash[12967]: cephadm 2021-03-10T20:03:16.220332+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:03:17.897 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:17 gibba004 bash[12967]: cluster 2021-03-10T20:03:16.310818+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:17.982 INFO:teuthology.orchestra.run.gibba004.stdout:Created osd(s) 2 on host 'gibba004' 2021-03-10T20:03:18.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:17 gibba009 bash[9804]: cephadm 2021-03-10T20:03:16.220332+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:03:18.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:17 gibba009 bash[9804]: cluster 2021-03-10T20:03:16.310818+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:17.975882+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:17.976339+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:17.975882+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:17.976339+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:17.979879+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:17.979879+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:18.539896+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:18.548468+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[9777]: audit 2021-03-10T20:03:18.550341+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:18.539896+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:18.548468+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:18 gibba004 bash[12967]: audit 2021-03-10T20:03:18.550341+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:17.975882+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:17.976339+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:17.979879+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472870\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472936\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.472970\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473001\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:56.473031\", \"created\": \"2021-03-10T20:02:56.010381\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_device_update\": \"2021-03-10T20:03:04.140158\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:18.539896+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:19.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:18.548468+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:19.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:18 gibba009 bash[9804]: audit 2021-03-10T20:03:18.550341+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.351 DEBUG:teuthology.orchestra.run.gibba004:osd.2> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.2.service 2021-03-10T20:03:19.354 INFO:tasks.cephadm:Deploying osd.3 on gibba004 with /dev/vg_nvme/lv_1... 2021-03-10T20:03:19.354 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T20:03:19.431 INFO:journalctl@ceph.osd.2.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:03:20.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:19 gibba004 bash[9777]: cluster 2021-03-10T20:03:18.311533+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:19 gibba004 bash[12967]: cluster 2021-03-10T20:03:18.311533+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:19 gibba009 bash[9804]: cluster 2021-03-10T20:03:18.311533+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:21.069 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:03:21.069 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T20:03:21.070 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:03:21.070 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:03:21.070 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:03:21.070 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:03:21.071 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:20 gibba004 bash[17500]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T20:03:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:21 gibba004 bash[9777]: cluster 2021-03-10T20:03:20.312643+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:22.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:21 gibba004 bash[12967]: cluster 2021-03-10T20:03:20.312643+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:21 gibba009 bash[9804]: cluster 2021-03-10T20:03:20.312643+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:24 gibba004 bash[9777]: cluster 2021-03-10T20:03:22.313341+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:24 gibba004 bash[12967]: cluster 2021-03-10T20:03:22.313341+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:24 gibba009 bash[9804]: cluster 2021-03-10T20:03:22.313341+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:24.626 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T20:03:24.626 INFO:teuthology.orchestra.run.gibba004.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T20:03:24.626 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10+0 records in 2021-03-10T20:03:24.626 INFO:teuthology.orchestra.run.gibba004.stderr:10+0 records out 2021-03-10T20:03:24.627 INFO:teuthology.orchestra.run.gibba004.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00857998 s, 1.2 GB/s 2021-03-10T20:03:24.627 INFO:teuthology.orchestra.run.gibba004.stderr:--> Zapping successful for: 2021-03-10T20:03:24.702 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:24 gibba004 bash[17904]: debug 2021-03-10T20:03:24.430+0000 7f36e6d76ec0 -1 Falling back to public interface 2021-03-10T20:03:25.062 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:25 gibba004 bash[17904]: debug 2021-03-10T20:03:25.050+0000 7f36e6d76ec0 -1 osd.2 0 log_to_monitors {default=true} 2021-03-10T20:03:25.298 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba004:vg_nvme/lv_1 2021-03-10T20:03:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[9777]: cluster 2021-03-10T20:03:24.313817+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[9777]: audit 2021-03-10T20:03:25.056360+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[9777]: audit 2021-03-10T20:03:25.056583+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:26.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[12967]: cluster 2021-03-10T20:03:24.313817+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:26.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[12967]: audit 2021-03-10T20:03:25.056360+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:26.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:26 gibba004 bash[12967]: audit 2021-03-10T20:03:25.056583+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:26 gibba009 bash[9804]: cluster 2021-03-10T20:03:24.313817+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:26 gibba009 bash[9804]: audit 2021-03-10T20:03:25.056360+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:26 gibba009 bash[9804]: audit 2021-03-10T20:03:25.056583+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:03:27.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[17904]: debug 2021-03-10T20:03:27.030+0000 7f36cfb2b700 -1 osd.2 0 waiting for initial osdmap 2021-03-10T20:03:27.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[17904]: debug 2021-03-10T20:03:27.034+0000 7f36dad47700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:03:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: cluster 2021-03-10T20:03:26.009607+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: cluster 2021-03-10T20:03:26.009712+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.022607+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:03:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: cluster 2021-03-10T20:03:26.022643+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:03:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.022742+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.023190+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.023459+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.290682+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: cluster 2021-03-10T20:03:26.009607+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: cluster 2021-03-10T20:03:26.009712+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.022607+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:03:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: cluster 2021-03-10T20:03:26.022643+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:03:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.022742+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.023190+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.023459+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.290682+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.392419+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[9777]: audit 2021-03-10T20:03:26.396004+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.392419+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:27 gibba004 bash[12967]: audit 2021-03-10T20:03:26.396004+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: cluster 2021-03-10T20:03:26.009607+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: cluster 2021-03-10T20:03:26.009712+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.022607+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:03:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: cluster 2021-03-10T20:03:26.022643+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:03:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.022742+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.023190+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.023459+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.290682+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.392419+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:27 gibba009 bash[9804]: audit 2021-03-10T20:03:26.396004+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}}, \"last_daemon_update\": \"2021-03-10T20:03:18.539322\", \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:28.257 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[12967]: cluster 2021-03-10T20:03:26.314055+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:28.257 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[12967]: audit 2021-03-10T20:03:27.032418+0000 mon.a (mon.0) 287 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:28.257 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[12967]: cluster 2021-03-10T20:03:27.032442+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:03:28.257 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[12967]: audit 2021-03-10T20:03:27.033205+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:28.258 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[9777]: cluster 2021-03-10T20:03:26.314055+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:28.258 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[9777]: audit 2021-03-10T20:03:27.032418+0000 mon.a (mon.0) 287 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:28.258 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[9777]: cluster 2021-03-10T20:03:27.032442+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:03:28.259 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:28 gibba004 bash[9777]: audit 2021-03-10T20:03:27.033205+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:28 gibba009 bash[9804]: cluster 2021-03-10T20:03:26.314055+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:28 gibba009 bash[9804]: audit 2021-03-10T20:03:27.032418+0000 mon.a (mon.0) 287 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:28 gibba009 bash[9804]: cluster 2021-03-10T20:03:27.032442+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:03:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:28 gibba009 bash[9804]: audit 2021-03-10T20:03:27.033205+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:29.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: cluster 2021-03-10T20:03:28.039134+0000 mon.a (mon.0) 290 : cluster [INF] osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170] boot 2021-03-10T20:03:29.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: cluster 2021-03-10T20:03:28.039155+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:03:29.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: audit 2021-03-10T20:03:28.039521+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:29.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: audit 2021-03-10T20:03:28.143940+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:29.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: cephadm 2021-03-10T20:03:28.144382+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: audit 2021-03-10T20:03:28.144620+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: audit 2021-03-10T20:03:28.145443+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[9777]: audit 2021-03-10T20:03:28.146386+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:29.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: cluster 2021-03-10T20:03:28.039134+0000 mon.a (mon.0) 290 : cluster [INF] osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170] boot 2021-03-10T20:03:29.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: cluster 2021-03-10T20:03:28.039155+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:03:29.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: audit 2021-03-10T20:03:28.039521+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:29.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: audit 2021-03-10T20:03:28.143940+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:29.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: cephadm 2021-03-10T20:03:28.144382+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:29.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: audit 2021-03-10T20:03:28.144620+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:29.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: audit 2021-03-10T20:03:28.145443+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:29.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:29 gibba004 bash[12967]: audit 2021-03-10T20:03:28.146386+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:29.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: cluster 2021-03-10T20:03:28.039134+0000 mon.a (mon.0) 290 : cluster [INF] osd.2 [v2:172.21.2.104:6818/1243320170,v1:172.21.2.104:6819/1243320170] boot 2021-03-10T20:03:29.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: cluster 2021-03-10T20:03:28.039155+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:03:29.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: audit 2021-03-10T20:03:28.039521+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:03:29.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: audit 2021-03-10T20:03:28.143940+0000 mgr.y (mgr.14140) 85 : audit [DBG] from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba004:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:29.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: cephadm 2021-03-10T20:03:28.144382+0000 mgr.y (mgr.14140) 86 : cephadm [INF] Applying osd on host gibba004... 2021-03-10T20:03:29.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: audit 2021-03-10T20:03:28.144620+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:29.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: audit 2021-03-10T20:03:28.145443+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:29.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:29 gibba009 bash[9804]: audit 2021-03-10T20:03:28.146386+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:30.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:30 gibba009 bash[9804]: cluster 2021-03-10T20:03:28.314564+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:30.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:30 gibba009 bash[9804]: cluster 2021-03-10T20:03:29.063156+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:03:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:30 gibba004 bash[9777]: cluster 2021-03-10T20:03:28.314564+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:30 gibba004 bash[9777]: cluster 2021-03-10T20:03:29.063156+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:03:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:30 gibba004 bash[12967]: cluster 2021-03-10T20:03:28.314564+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:30.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:30 gibba004 bash[12967]: cluster 2021-03-10T20:03:29.063156+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:03:31.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:31 gibba009 bash[9804]: cluster 2021-03-10T20:03:30.067931+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:03:31.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:31 gibba004 bash[9777]: cluster 2021-03-10T20:03:30.067931+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:03:31.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:31 gibba004 bash[12967]: cluster 2021-03-10T20:03:30.067931+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:03:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[9777]: cluster 2021-03-10T20:03:30.315291+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[9777]: audit 2021-03-10T20:03:31.241345+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]: dispatch 2021-03-10T20:03:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[9777]: audit 2021-03-10T20:03:31.246710+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]': finished 2021-03-10T20:03:32.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[9777]: cluster 2021-03-10T20:03:31.246735+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:03:32.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[9777]: audit 2021-03-10T20:03:31.246852+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[12967]: cluster 2021-03-10T20:03:30.315291+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:32.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[12967]: audit 2021-03-10T20:03:31.241345+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]: dispatch 2021-03-10T20:03:32.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[12967]: audit 2021-03-10T20:03:31.246710+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]': finished 2021-03-10T20:03:32.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[12967]: cluster 2021-03-10T20:03:31.246735+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:03:32.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:32 gibba004 bash[12967]: audit 2021-03-10T20:03:31.246852+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:32 gibba009 bash[9804]: cluster 2021-03-10T20:03:30.315291+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:03:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:32 gibba009 bash[9804]: audit 2021-03-10T20:03:31.241345+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]: dispatch 2021-03-10T20:03:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:32 gibba009 bash[9804]: audit 2021-03-10T20:03:31.246710+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.104:0/759436526' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdbc8828-3bd2-4453-bf0e-9f16d052bbe0"}]': finished 2021-03-10T20:03:32.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:32 gibba009 bash[9804]: cluster 2021-03-10T20:03:31.246735+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:03:32.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:32 gibba009 bash[9804]: audit 2021-03-10T20:03:31.246852+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:33 gibba004 bash[9777]: cluster 2021-03-10T20:03:33.088076+0000 mon.a (mon.0) 302 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:03:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:33 gibba004 bash[9777]: cluster 2021-03-10T20:03:33.088177+0000 mon.a (mon.0) 303 : cluster [INF] Cluster is now healthy 2021-03-10T20:03:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:33 gibba004 bash[12967]: cluster 2021-03-10T20:03:33.088076+0000 mon.a (mon.0) 302 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:03:33.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:33 gibba004 bash[12967]: cluster 2021-03-10T20:03:33.088177+0000 mon.a (mon.0) 303 : cluster [INF] Cluster is now healthy 2021-03-10T20:03:33.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:33 gibba009 bash[9804]: cluster 2021-03-10T20:03:33.088076+0000 mon.a (mon.0) 302 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:03:33.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:33 gibba009 bash[9804]: cluster 2021-03-10T20:03:33.088177+0000 mon.a (mon.0) 303 : cluster [INF] Cluster is now healthy 2021-03-10T20:03:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:34 gibba004 bash[9777]: cluster 2021-03-10T20:03:32.315879+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 544 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:34 gibba004 bash[9777]: audit 2021-03-10T20:03:33.410442+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.104:0/1384449996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:34 gibba004 bash[12967]: cluster 2021-03-10T20:03:32.315879+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 544 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:34.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:34 gibba004 bash[12967]: audit 2021-03-10T20:03:33.410442+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.104:0/1384449996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:34 gibba009 bash[9804]: cluster 2021-03-10T20:03:32.315879+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 544 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:34 gibba009 bash[9804]: audit 2021-03-10T20:03:33.410442+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.104:0/1384449996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:35.437 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:35 gibba004 bash[9777]: cluster 2021-03-10T20:03:34.316596+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:35.437 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:35 gibba004 bash[12967]: cluster 2021-03-10T20:03:34.316596+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:35.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:35 gibba009 bash[9804]: cluster 2021-03-10T20:03:34.316596+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:36.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:36 gibba004 bash[9777]: audit 2021-03-10T20:03:35.974034+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:36.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:36 gibba004 bash[12967]: audit 2021-03-10T20:03:35.974034+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:36 gibba009 bash[9804]: audit 2021-03-10T20:03:35.974034+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:37.503 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:37 gibba004 bash[9777]: cluster 2021-03-10T20:03:36.317216+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:37.503 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:37 gibba004 bash[12967]: cluster 2021-03-10T20:03:36.317216+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:37.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:37 gibba009 bash[9804]: cluster 2021-03-10T20:03:36.317216+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:39 gibba004 bash[9777]: cluster 2021-03-10T20:03:38.318066+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:39.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:39 gibba004 bash[12967]: cluster 2021-03-10T20:03:38.318066+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:39 gibba009 bash[9804]: cluster 2021-03-10T20:03:38.318066+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:40.663 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[9777]: audit 2021-03-10T20:03:39.478914+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:03:40.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[9777]: audit 2021-03-10T20:03:39.479928+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:40.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[9777]: cephadm 2021-03-10T20:03:39.480667+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:03:40.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[9777]: audit 2021-03-10T20:03:39.480933+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:03:40.664 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[12967]: audit 2021-03-10T20:03:39.478914+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:03:40.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[12967]: audit 2021-03-10T20:03:39.479928+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:40.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[12967]: cephadm 2021-03-10T20:03:39.480667+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:03:40.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:40 gibba004 bash[12967]: audit 2021-03-10T20:03:39.480933+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:03:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:40 gibba009 bash[9804]: audit 2021-03-10T20:03:39.478914+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:03:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:40 gibba009 bash[9804]: audit 2021-03-10T20:03:39.479928+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:40 gibba009 bash[9804]: cephadm 2021-03-10T20:03:39.480667+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:03:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:40 gibba009 bash[9804]: audit 2021-03-10T20:03:39.480933+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:03:41.364 INFO:teuthology.orchestra.run.gibba004.stdout:Created osd(s) 3 on host 'gibba004' 2021-03-10T20:03:41.587 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[9777]: cluster 2021-03-10T20:03:40.318763+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:41.587 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[12967]: cluster 2021-03-10T20:03:40.318763+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:41.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[9777]: audit 2021-03-10T20:03:41.359507+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:41.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[9777]: audit 2021-03-10T20:03:41.360077+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:41.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[9777]: audit 2021-03-10T20:03:41.362954+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:41.589 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[12967]: audit 2021-03-10T20:03:41.359507+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:41.589 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[12967]: audit 2021-03-10T20:03:41.360077+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:41.590 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:41 gibba004 bash[12967]: audit 2021-03-10T20:03:41.362954+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:41 gibba009 bash[9804]: cluster 2021-03-10T20:03:40.318763+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:41 gibba009 bash[9804]: audit 2021-03-10T20:03:41.359507+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:41 gibba009 bash[9804]: audit 2021-03-10T20:03:41.360077+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:41 gibba009 bash[9804]: audit 2021-03-10T20:03:41.362954+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539102\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539163\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539192\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539219\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539246\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:18.539273\", \"created\": \"2021-03-10T20:03:17.962380\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_device_update\": \"2021-03-10T20:03:26.391836\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:42.657 DEBUG:teuthology.orchestra.run.gibba004:osd.3> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.3.service 2021-03-10T20:03:42.657 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[12967]: audit 2021-03-10T20:03:41.919204+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:42.658 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[12967]: audit 2021-03-10T20:03:41.923357+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:42.658 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[12967]: audit 2021-03-10T20:03:41.923814+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:42.666 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[9777]: audit 2021-03-10T20:03:41.919204+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:42.846 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[9777]: audit 2021-03-10T20:03:41.923357+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:42.847 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:42 gibba004 bash[9777]: audit 2021-03-10T20:03:41.923814+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:42.848 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:42 gibba009 bash[9804]: audit 2021-03-10T20:03:41.919204+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:42.848 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:42 gibba009 bash[9804]: audit 2021-03-10T20:03:41.923357+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:42.849 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:42 gibba009 bash[9804]: audit 2021-03-10T20:03:41.923814+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:42.849 INFO:tasks.cephadm:Deploying osd.4 on gibba009 with /dev/vg_nvme/lv_4... 2021-03-10T20:03:42.850 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T20:03:42.916 INFO:journalctl@ceph.osd.3.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:03:43.753 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:03:43.753 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T20:03:43.753 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:03:43.753 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:03:43.754 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:03:43.754 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:03:43.754 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[18962]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T20:03:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[9777]: cluster 2021-03-10T20:03:42.319403+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:43 gibba004 bash[12967]: cluster 2021-03-10T20:03:42.319403+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:44.272 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:43 gibba009 bash[9804]: cluster 2021-03-10T20:03:42.319403+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:03:45.496 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T20:03:45.497 INFO:teuthology.orchestra.run.gibba009.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T20:03:45.497 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 10+0 records in 2021-03-10T20:03:45.497 INFO:teuthology.orchestra.run.gibba009.stderr:10+0 records out 2021-03-10T20:03:45.498 INFO:teuthology.orchestra.run.gibba009.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0180952 s, 579 MB/s 2021-03-10T20:03:45.498 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping successful for: 2021-03-10T20:03:46.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:45 gibba009 bash[9804]: cluster 2021-03-10T20:03:44.320009+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:46.062 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba009:vg_nvme/lv_4 2021-03-10T20:03:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:45 gibba004 bash[9777]: cluster 2021-03-10T20:03:44.320009+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:46.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:45 gibba004 bash[12967]: cluster 2021-03-10T20:03:44.320009+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:47.063 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:46 gibba004 bash[19295]: debug 2021-03-10T20:03:46.582+0000 7fbfb4f75ec0 -1 Falling back to public interface 2021-03-10T20:03:47.519 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:47 gibba009 bash[9804]: cluster 2021-03-10T20:03:46.320445+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:47.520 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:47 gibba009 bash[9804]: audit 2021-03-10T20:03:47.232547+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:03:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:47 gibba004 bash[9777]: cluster 2021-03-10T20:03:46.320445+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:47 gibba004 bash[9777]: audit 2021-03-10T20:03:47.232547+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:03:47.564 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:47 gibba004 bash[19295]: debug 2021-03-10T20:03:47.222+0000 7fbfb4f75ec0 -1 osd.3 0 log_to_monitors {default=true} 2021-03-10T20:03:47.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:47 gibba004 bash[12967]: cluster 2021-03-10T20:03:46.320445+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:47.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:47 gibba004 bash[12967]: audit 2021-03-10T20:03:47.232547+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:03:48.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:47.322350+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:03:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: cluster 2021-03-10T20:03:47.322383+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:03:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:47.322476+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:47.322764+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:47.961147+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:48.056929+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:48.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:48 gibba009 bash[9804]: audit 2021-03-10T20:03:48.060668+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:48.813 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[19295]: debug 2021-03-10T20:03:48.330+0000 7fbf9dd2a700 -1 osd.3 0 waiting for initial osdmap 2021-03-10T20:03:48.813 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[19295]: debug 2021-03-10T20:03:48.334+0000 7fbfa8f46700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:03:48.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:47.322350+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:03:48.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: cluster 2021-03-10T20:03:47.322383+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:03:48.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:47.322476+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:48.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:47.322764+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:48.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:47.961147+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:47.322350+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:03:48.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: cluster 2021-03-10T20:03:47.322383+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:03:48.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:47.322476+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:48.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:47.322764+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:03:48.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:47.961147+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:48.056929+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:48.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[9777]: audit 2021-03-10T20:03:48.060668+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:48.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:48.056929+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:03:48.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:48 gibba004 bash[12967]: audit 2021-03-10T20:03:48.060668+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}}, \"last_daemon_update\": \"2021-03-10T20:03:41.918600\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:03:49.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: cluster 2021-03-10T20:03:48.264243+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:49.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: cluster 2021-03-10T20:03:48.264345+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: cluster 2021-03-10T20:03:48.320999+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.331276+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: cluster 2021-03-10T20:03:48.331330+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:03:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.332126+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.468110+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:49.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: cephadm 2021-03-10T20:03:48.470584+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:03:49.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.471363+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:49.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.474336+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:49.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:49 gibba009 bash[9804]: audit 2021-03-10T20:03:48.478287+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: cluster 2021-03-10T20:03:48.264243+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: cluster 2021-03-10T20:03:48.264345+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:49.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: cluster 2021-03-10T20:03:48.320999+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:49.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.331276+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:49.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: cluster 2021-03-10T20:03:48.331330+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:03:49.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.332126+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:49.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.468110+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:49.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: cephadm 2021-03-10T20:03:48.470584+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:03:49.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.471363+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:49.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.474336+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:49.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[9777]: audit 2021-03-10T20:03:48.478287+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:49.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: cluster 2021-03-10T20:03:48.264243+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:03:49.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: cluster 2021-03-10T20:03:48.264345+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:03:49.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: cluster 2021-03-10T20:03:48.320999+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:49.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.331276+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]': finished 2021-03-10T20:03:49.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: cluster 2021-03-10T20:03:48.331330+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:03:49.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.332126+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:49.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.468110+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:49.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: cephadm 2021-03-10T20:03:48.470584+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:03:49.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.471363+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:03:49.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.474336+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:49.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:49 gibba004 bash[12967]: audit 2021-03-10T20:03:48.478287+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:50.625 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:50 gibba009 bash[9804]: cluster 2021-03-10T20:03:49.344394+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577] boot 2021-03-10T20:03:50.625 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:50 gibba009 bash[9804]: cluster 2021-03-10T20:03:49.344434+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:03:50.625 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:50 gibba009 bash[9804]: audit 2021-03-10T20:03:49.345235+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[9777]: cluster 2021-03-10T20:03:49.344394+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577] boot 2021-03-10T20:03:50.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[9777]: cluster 2021-03-10T20:03:49.344434+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:03:50.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[9777]: audit 2021-03-10T20:03:49.345235+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[12967]: cluster 2021-03-10T20:03:49.344394+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.104:6826/3361048577,v1:172.21.2.104:6827/3361048577] boot 2021-03-10T20:03:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[12967]: cluster 2021-03-10T20:03:49.344434+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:03:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:50 gibba004 bash[12967]: audit 2021-03-10T20:03:49.345235+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:03:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: cluster 2021-03-10T20:03:50.321890+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: cluster 2021-03-10T20:03:50.365176+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:03:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: audit 2021-03-10T20:03:51.279804+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.109:0/3363235769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: audit 2021-03-10T20:03:51.281552+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: audit 2021-03-10T20:03:51.292865+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]': finished 2021-03-10T20:03:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: cluster 2021-03-10T20:03:51.292939+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:03:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[9777]: audit 2021-03-10T20:03:51.293104+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:03:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: cluster 2021-03-10T20:03:50.321890+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: cluster 2021-03-10T20:03:50.365176+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:03:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: audit 2021-03-10T20:03:51.279804+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.109:0/3363235769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: audit 2021-03-10T20:03:51.281552+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: audit 2021-03-10T20:03:51.292865+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]': finished 2021-03-10T20:03:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: cluster 2021-03-10T20:03:51.292939+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:03:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:51 gibba004 bash[12967]: audit 2021-03-10T20:03:51.293104+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:03:51.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: cluster 2021-03-10T20:03:50.321890+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:03:51.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: cluster 2021-03-10T20:03:50.365176+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:03:51.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: audit 2021-03-10T20:03:51.279804+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.109:0/3363235769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: audit 2021-03-10T20:03:51.281552+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]: dispatch 2021-03-10T20:03:51.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: audit 2021-03-10T20:03:51.292865+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab97246-8453-48ec-94b9-b3cd470e8671"}]': finished 2021-03-10T20:03:51.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: cluster 2021-03-10T20:03:51.292939+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:03:51.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:51 gibba009 bash[9804]: audit 2021-03-10T20:03:51.293104+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:03:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:53 gibba004 bash[9777]: cluster 2021-03-10T20:03:52.322627+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:53 gibba004 bash[9777]: audit 2021-03-10T20:03:53.266227+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.109:0/744217102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:53.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:53 gibba004 bash[12967]: cluster 2021-03-10T20:03:52.322627+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:53.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:53 gibba004 bash[12967]: audit 2021-03-10T20:03:53.266227+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.109:0/744217102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:53 gibba009 bash[9804]: cluster 2021-03-10T20:03:52.322627+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:53 gibba009 bash[9804]: audit 2021-03-10T20:03:53.266227+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.109:0/744217102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:03:55.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:55 gibba009 bash[9804]: cluster 2021-03-10T20:03:54.323666+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 968 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:55 gibba004 bash[9777]: cluster 2021-03-10T20:03:54.323666+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 968 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:55.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:55 gibba004 bash[12967]: cluster 2021-03-10T20:03:54.323666+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 968 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:56.701 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:56 gibba009 bash[9804]: audit 2021-03-10T20:03:55.786114+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:56 gibba004 bash[9777]: audit 2021-03-10T20:03:55.786114+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:56.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:56 gibba004 bash[12967]: audit 2021-03-10T20:03:55.786114+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:03:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:57 gibba009 bash[9804]: cluster 2021-03-10T20:03:56.324206+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:57 gibba004 bash[9777]: cluster 2021-03-10T20:03:56.324206+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:57 gibba004 bash[12967]: cluster 2021-03-10T20:03:56.324206+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:59.754 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:59 gibba009 bash[9804]: cluster 2021-03-10T20:03:58.324937+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:59.755 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:59 gibba009 bash[9804]: audit 2021-03-10T20:03:58.754998+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:03:59.755 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:59 gibba009 bash[9804]: audit 2021-03-10T20:03:58.757738+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:59.755 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:59 gibba009 bash[9804]: cephadm 2021-03-10T20:03:58.759924+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:03:59.756 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:03:59 gibba009 bash[9804]: audit 2021-03-10T20:03:58.760767+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:03:59.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[9777]: cluster 2021-03-10T20:03:58.324937+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:59.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[9777]: audit 2021-03-10T20:03:58.754998+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:03:59.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[9777]: audit 2021-03-10T20:03:58.757738+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:59.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[9777]: cephadm 2021-03-10T20:03:58.759924+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:03:59.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[9777]: audit 2021-03-10T20:03:58.760767+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:03:59.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[12967]: cluster 2021-03-10T20:03:58.324937+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:03:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[12967]: audit 2021-03-10T20:03:58.754998+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:03:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[12967]: audit 2021-03-10T20:03:58.757738+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[12967]: cephadm 2021-03-10T20:03:58.759924+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:03:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:03:59 gibba004 bash[12967]: audit 2021-03-10T20:03:58.760767+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:04:00.400 INFO:teuthology.orchestra.run.gibba009.stdout:Created osd(s) 4 on host 'gibba009' 2021-03-10T20:04:00.726 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:00 gibba009 bash[9804]: audit 2021-03-10T20:04:00.389170+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:00.726 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:00 gibba009 bash[9804]: audit 2021-03-10T20:04:00.390783+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:00.727 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:00 gibba009 bash[9804]: audit 2021-03-10T20:04:00.398130+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:00.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[12967]: audit 2021-03-10T20:04:00.389170+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:00.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[12967]: audit 2021-03-10T20:04:00.390783+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:00.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[12967]: audit 2021-03-10T20:04:00.398130+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:00.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[9777]: audit 2021-03-10T20:04:00.389170+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:00.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[9777]: audit 2021-03-10T20:04:00.390783+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:00.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:00 gibba004 bash[9777]: audit 2021-03-10T20:04:00.398130+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448236\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448500\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:20.448670\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_device_update\": \"2021-03-10T20:01:39.244820\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:01.386 DEBUG:teuthology.orchestra.run.gibba009:osd.4> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.4.service 2021-03-10T20:04:01.389 INFO:tasks.cephadm:Deploying osd.5 on gibba009 with /dev/vg_nvme/lv_3... 2021-03-10T20:04:01.390 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T20:04:01.444 INFO:journalctl@ceph.osd.4.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:04:01.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[9777]: cluster 2021-03-10T20:04:00.325750+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:01.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[12967]: cluster 2021-03-10T20:04:00.325750+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:01.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[9777]: audit 2021-03-10T20:04:00.812744+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:01.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[12967]: audit 2021-03-10T20:04:00.812744+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:01.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[9777]: audit 2021-03-10T20:04:00.821271+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:01.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[9777]: audit 2021-03-10T20:04:00.821927+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:01.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[12967]: audit 2021-03-10T20:04:00.821271+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:01.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:01 gibba004 bash[12967]: audit 2021-03-10T20:04:00.821927+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:01.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:01 gibba009 bash[9804]: cluster 2021-03-10T20:04:00.325750+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:01.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:01 gibba009 bash[9804]: audit 2021-03-10T20:04:00.812744+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:01.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:01 gibba009 bash[9804]: audit 2021-03-10T20:04:00.821271+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:01.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:01 gibba009 bash[9804]: audit 2021-03-10T20:04:00.821927+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:02.645 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:04:02.645 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T20:04:02.646 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:04:02.646 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:04:02.646 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:04:02.646 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:04:02.647 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:02 gibba009 bash[11913]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T20:04:03.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:03 gibba009 bash[9804]: cluster 2021-03-10T20:04:02.326684+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:03 gibba004 bash[9777]: cluster 2021-03-10T20:04:02.326684+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:03.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:03 gibba004 bash[12967]: cluster 2021-03-10T20:04:02.326684+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:05.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:05 gibba009 bash[9804]: cluster 2021-03-10T20:04:04.327698+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:05.588 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:05 gibba009 bash[12211]: debug 2021-03-10T20:04:05.389+0000 7f18ab5f0ec0 -1 Falling back to public interface 2021-03-10T20:04:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:05 gibba004 bash[9777]: cluster 2021-03-10T20:04:04.327698+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:05 gibba004 bash[12967]: cluster 2021-03-10T20:04:04.327698+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:06.264 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T20:04:06.264 INFO:teuthology.orchestra.run.gibba009.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T20:04:06.264 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 10+0 records in 2021-03-10T20:04:06.265 INFO:teuthology.orchestra.run.gibba009.stderr:10+0 records out 2021-03-10T20:04:06.265 INFO:teuthology.orchestra.run.gibba009.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0086577 s, 1.2 GB/s 2021-03-10T20:04:06.265 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping successful for: 2021-03-10T20:04:06.325 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:06 gibba009 bash[12211]: debug 2021-03-10T20:04:06.061+0000 7f18ab5f0ec0 -1 osd.4 0 log_to_monitors {default=true} 2021-03-10T20:04:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:06 gibba009 bash[9804]: audit 2021-03-10T20:04:06.067314+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:06 gibba009 bash[9804]: audit 2021-03-10T20:04:06.068863+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:06 gibba004 bash[9777]: audit 2021-03-10T20:04:06.067314+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:06 gibba004 bash[9777]: audit 2021-03-10T20:04:06.068863+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:06 gibba004 bash[12967]: audit 2021-03-10T20:04:06.067314+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:06 gibba004 bash[12967]: audit 2021-03-10T20:04:06.068863+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:04:06.870 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba009:vg_nvme/lv_3 2021-03-10T20:04:07.732 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[12211]: debug 2021-03-10T20:04:07.453+0000 7f189039d700 -1 osd.4 0 waiting for initial osdmap 2021-03-10T20:04:07.733 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[12211]: debug 2021-03-10T20:04:07.457+0000 7f189b5b9700 -1 osd.4 31 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:04:07.733 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: cluster 2021-03-10T20:04:06.328153+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:07.733 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: audit 2021-03-10T20:04:06.453264+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:04:07.734 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: cluster 2021-03-10T20:04:06.453290+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:04:07.734 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: audit 2021-03-10T20:04:06.453364+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:07.734 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: audit 2021-03-10T20:04:06.454753+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.734 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: audit 2021-03-10T20:04:06.455607+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.735 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: cluster 2021-03-10T20:04:07.018427+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:07.735 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: cluster 2021-03-10T20:04:07.018470+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:07.735 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:07 gibba009 bash[9804]: audit 2021-03-10T20:04:07.397668+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: cluster 2021-03-10T20:04:06.328153+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: audit 2021-03-10T20:04:06.453264+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:04:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: cluster 2021-03-10T20:04:06.453290+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:04:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: audit 2021-03-10T20:04:06.453364+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: audit 2021-03-10T20:04:06.454753+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: audit 2021-03-10T20:04:06.455607+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: cluster 2021-03-10T20:04:07.018427+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: cluster 2021-03-10T20:04:07.018470+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:07.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[9777]: audit 2021-03-10T20:04:07.397668+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: cluster 2021-03-10T20:04:06.328153+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: audit 2021-03-10T20:04:06.453264+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:04:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: cluster 2021-03-10T20:04:06.453290+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:04:07.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: audit 2021-03-10T20:04:06.453364+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: audit 2021-03-10T20:04:06.454753+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: audit 2021-03-10T20:04:06.455607+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: cluster 2021-03-10T20:04:07.018427+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: cluster 2021-03-10T20:04:07.018470+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:07 gibba004 bash[12967]: audit 2021-03-10T20:04:07.397668+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:08.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[9777]: audit 2021-03-10T20:04:07.456462+0000 mon.a (mon.0) 352 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:08.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[9777]: cluster 2021-03-10T20:04:07.456492+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:04:08.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[9777]: audit 2021-03-10T20:04:07.457064+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:08.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[12967]: audit 2021-03-10T20:04:07.456462+0000 mon.a (mon.0) 352 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:08.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[12967]: cluster 2021-03-10T20:04:07.456492+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:04:08.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[12967]: audit 2021-03-10T20:04:07.457064+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:08.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[9777]: audit 2021-03-10T20:04:07.519685+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:08.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[9777]: audit 2021-03-10T20:04:07.528533+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:08.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[12967]: audit 2021-03-10T20:04:07.519685+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:08.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:08 gibba004 bash[12967]: audit 2021-03-10T20:04:07.528533+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:08 gibba009 bash[9804]: audit 2021-03-10T20:04:07.456462+0000 mon.a (mon.0) 352 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:08.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:08 gibba009 bash[9804]: cluster 2021-03-10T20:04:07.456492+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:04:08.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:08 gibba009 bash[9804]: audit 2021-03-10T20:04:07.457064+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:08.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:08 gibba009 bash[9804]: audit 2021-03-10T20:04:07.519685+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:08.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:08 gibba009 bash[9804]: audit 2021-03-10T20:04:07.528533+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}}, \"last_daemon_update\": \"2021-03-10T20:04:00.810734\", \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: cluster 2021-03-10T20:04:08.328606+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: cluster 2021-03-10T20:04:08.469054+0000 mon.a (mon.0) 357 : cluster [INF] osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120] boot 2021-03-10T20:04:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: cluster 2021-03-10T20:04:08.469091+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:04:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: audit 2021-03-10T20:04:08.469790+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: audit 2021-03-10T20:04:09.396781+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: audit 2021-03-10T20:04:09.399638+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[9777]: audit 2021-03-10T20:04:09.403831+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: cluster 2021-03-10T20:04:08.328606+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: cluster 2021-03-10T20:04:08.469054+0000 mon.a (mon.0) 357 : cluster [INF] osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120] boot 2021-03-10T20:04:09.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: cluster 2021-03-10T20:04:08.469091+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:04:09.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: audit 2021-03-10T20:04:08.469790+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:09.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: audit 2021-03-10T20:04:09.396781+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:09.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: audit 2021-03-10T20:04:09.399638+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:09.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:09 gibba004 bash[12967]: audit 2021-03-10T20:04:09.403831+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:09.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: cluster 2021-03-10T20:04:08.328606+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:04:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: cluster 2021-03-10T20:04:08.469054+0000 mon.a (mon.0) 357 : cluster [INF] osd.4 [v2:172.21.2.109:6800/684070120,v1:172.21.2.109:6801/684070120] boot 2021-03-10T20:04:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: cluster 2021-03-10T20:04:08.469091+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:04:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: audit 2021-03-10T20:04:08.469790+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:04:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: audit 2021-03-10T20:04:09.396781+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: audit 2021-03-10T20:04:09.399638+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:09.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:09 gibba009 bash[9804]: audit 2021-03-10T20:04:09.403831+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[9777]: audit 2021-03-10T20:04:09.393969+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:10.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[9777]: cephadm 2021-03-10T20:04:09.396019+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:10.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[9777]: cluster 2021-03-10T20:04:09.479565+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:04:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[12967]: audit 2021-03-10T20:04:09.393969+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[12967]: cephadm 2021-03-10T20:04:09.396019+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:10.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:10 gibba004 bash[12967]: cluster 2021-03-10T20:04:09.479565+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:04:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:10 gibba009 bash[9804]: audit 2021-03-10T20:04:09.393969+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:10 gibba009 bash[9804]: cephadm 2021-03-10T20:04:09.396019+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:10 gibba009 bash[9804]: cluster 2021-03-10T20:04:09.479565+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:04:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:11 gibba004 bash[9777]: cluster 2021-03-10T20:04:10.329303+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:11 gibba004 bash[12967]: cluster 2021-03-10T20:04:10.329303+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:11 gibba009 bash[9804]: cluster 2021-03-10T20:04:10.329303+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[9777]: audit 2021-03-10T20:04:12.131433+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.109:0/2737525362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[9777]: audit 2021-03-10T20:04:12.133445+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[9777]: audit 2021-03-10T20:04:12.144396+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]': finished 2021-03-10T20:04:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[9777]: cluster 2021-03-10T20:04:12.144424+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:04:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[9777]: audit 2021-03-10T20:04:12.144547+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[12967]: audit 2021-03-10T20:04:12.131433+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.109:0/2737525362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[12967]: audit 2021-03-10T20:04:12.133445+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[12967]: audit 2021-03-10T20:04:12.144396+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]': finished 2021-03-10T20:04:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[12967]: cluster 2021-03-10T20:04:12.144424+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:04:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:12 gibba004 bash[12967]: audit 2021-03-10T20:04:12.144547+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:12 gibba009 bash[9804]: audit 2021-03-10T20:04:12.131433+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.109:0/2737525362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:12 gibba009 bash[9804]: audit 2021-03-10T20:04:12.133445+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]: dispatch 2021-03-10T20:04:12.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:12 gibba009 bash[9804]: audit 2021-03-10T20:04:12.144396+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3eea2b0c-0b1d-4976-8a42-a73218a8175b"}]': finished 2021-03-10T20:04:12.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:12 gibba009 bash[9804]: cluster 2021-03-10T20:04:12.144424+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:04:12.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:12 gibba009 bash[9804]: audit 2021-03-10T20:04:12.144547+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:14.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:14 gibba004 bash[9777]: cluster 2021-03-10T20:04:12.330261+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:14.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:14 gibba004 bash[12967]: cluster 2021-03-10T20:04:12.330261+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:14.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:14 gibba009 bash[9804]: cluster 2021-03-10T20:04:12.330261+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:15 gibba004 bash[9777]: audit 2021-03-10T20:04:14.173199+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.109:0/1480296791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:15.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:15 gibba004 bash[12967]: audit 2021-03-10T20:04:14.173199+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.109:0/1480296791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:15.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:15 gibba009 bash[9804]: audit 2021-03-10T20:04:14.173199+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.109:0/1480296791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:16 gibba004 bash[9777]: cluster 2021-03-10T20:04:14.331375+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:16.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:16 gibba004 bash[12967]: cluster 2021-03-10T20:04:14.331375+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:16 gibba009 bash[9804]: cluster 2021-03-10T20:04:14.331375+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:17.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:17 gibba009 bash[9804]: cluster 2021-03-10T20:04:16.331899+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:17.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:17 gibba009 bash[9804]: audit 2021-03-10T20:04:16.707524+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:17 gibba004 bash[9777]: cluster 2021-03-10T20:04:16.331899+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:17 gibba004 bash[9777]: audit 2021-03-10T20:04:16.707524+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:17.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:17 gibba004 bash[12967]: cluster 2021-03-10T20:04:16.331899+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:17.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:17 gibba004 bash[12967]: audit 2021-03-10T20:04:16.707524+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:19.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:19 gibba009 bash[9804]: cluster 2021-03-10T20:04:18.332518+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:19.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:19 gibba004 bash[9777]: cluster 2021-03-10T20:04:18.332518+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:19.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:19 gibba004 bash[12967]: cluster 2021-03-10T20:04:18.332518+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:20.773 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:20 gibba009 bash[9804]: audit 2021-03-10T20:04:19.798458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:04:20.773 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:20 gibba009 bash[9804]: audit 2021-03-10T20:04:19.801360+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:20.773 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:20 gibba009 bash[9804]: cephadm 2021-03-10T20:04:19.803762+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:04:20.774 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:20 gibba009 bash[9804]: audit 2021-03-10T20:04:19.804705+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:04:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[9777]: audit 2021-03-10T20:04:19.798458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:04:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[9777]: audit 2021-03-10T20:04:19.801360+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:20.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[9777]: cephadm 2021-03-10T20:04:19.803762+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:04:20.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[9777]: audit 2021-03-10T20:04:19.804705+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:04:20.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[12967]: audit 2021-03-10T20:04:19.798458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:04:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[12967]: audit 2021-03-10T20:04:19.801360+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[12967]: cephadm 2021-03-10T20:04:19.803762+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:04:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:20 gibba004 bash[12967]: audit 2021-03-10T20:04:19.804705+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:04:21.532 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:21 gibba009 bash[9804]: cluster 2021-03-10T20:04:20.333366+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:21.576 INFO:teuthology.orchestra.run.gibba009.stdout:Created osd(s) 5 on host 'gibba009' 2021-03-10T20:04:21.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:21 gibba004 bash[9777]: cluster 2021-03-10T20:04:20.333366+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:21 gibba004 bash[12967]: cluster 2021-03-10T20:04:20.333366+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:04:22.468 DEBUG:teuthology.orchestra.run.gibba009:osd.5> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.5.service 2021-03-10T20:04:22.470 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:21.565813+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.470 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:21.567367+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:22.470 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:21.574287+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.470 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:22.032435+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.471 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:22.041235+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.471 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:22 gibba009 bash[9804]: audit 2021-03-10T20:04:22.042024+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:22.472 INFO:tasks.cephadm:Deploying osd.6 on gibba009 with /dev/vg_nvme/lv_2... 2021-03-10T20:04:22.473 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T20:04:22.511 INFO:journalctl@ceph.osd.5.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:04:22.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:21.565813+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:21.567367+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:22.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:21.565813+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:21.567367+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:22.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:21.574287+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:21.574287+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.809819\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810089\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810302\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:00.810467\", \"created\": \"2021-03-10T20:04:00.369383\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_device_update\": \"2021-03-10T20:04:07.517560\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:22.032435+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:22.041235+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[9777]: audit 2021-03-10T20:04:22.042024+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:22.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:22.032435+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:22.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:22.041235+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:22.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:22 gibba004 bash[12967]: audit 2021-03-10T20:04:22.042024+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:23.520 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:04:23.520 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T20:04:23.521 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:04:23.521 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:04:23.521 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:04:23.521 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:04:23.521 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:23 gibba009 bash[13371]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T20:04:24.309 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:24 gibba009 bash[9804]: cluster 2021-03-10T20:04:22.334019+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:24.310 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:24 gibba009 bash[9804]: audit 2021-03-10T20:04:23.324405+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:24.310 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:24 gibba009 bash[9804]: audit 2021-03-10T20:04:23.333128+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[9777]: cluster 2021-03-10T20:04:22.334019+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[9777]: audit 2021-03-10T20:04:23.324405+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[9777]: audit 2021-03-10T20:04:23.333128+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[12967]: cluster 2021-03-10T20:04:22.334019+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[12967]: audit 2021-03-10T20:04:23.324405+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:24 gibba004 bash[12967]: audit 2021-03-10T20:04:23.333128+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:26.121 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:26 gibba009 bash[9804]: cluster 2021-03-10T20:04:24.334866+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:26.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:26 gibba004 bash[9777]: cluster 2021-03-10T20:04:24.334866+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:26 gibba004 bash[12967]: cluster 2021-03-10T20:04:24.334866+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:26.868 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:26 gibba009 bash[13705]: debug 2021-03-10T20:04:26.721+0000 7fe506d6fec0 -1 Falling back to public interface 2021-03-10T20:04:27.308 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T20:04:27.308 INFO:teuthology.orchestra.run.gibba009.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T20:04:27.309 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 10+0 records in 2021-03-10T20:04:27.309 INFO:teuthology.orchestra.run.gibba009.stderr:10+0 records out 2021-03-10T20:04:27.309 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00908498 s, 1.2 GB/s 2021-03-10T20:04:27.309 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping successful for: 2021-03-10T20:04:27.797 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:27 gibba009 bash[9804]: cluster 2021-03-10T20:04:26.335348+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:27.798 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:27 gibba009 bash[13705]: debug 2021-03-10T20:04:27.361+0000 7fe506d6fec0 -1 osd.5 0 log_to_monitors {default=true} 2021-03-10T20:04:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:27 gibba004 bash[9777]: cluster 2021-03-10T20:04:26.335348+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:27.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:27 gibba004 bash[12967]: cluster 2021-03-10T20:04:26.335348+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:27.986 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba009:vg_nvme/lv_2 2021-03-10T20:04:28.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:28 gibba004 bash[9777]: audit 2021-03-10T20:04:27.370698+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:28.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:28 gibba004 bash[9777]: audit 2021-03-10T20:04:27.372077+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:28.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:28 gibba004 bash[12967]: audit 2021-03-10T20:04:27.370698+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:28.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:28 gibba004 bash[12967]: audit 2021-03-10T20:04:27.372077+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:28 gibba009 bash[9804]: audit 2021-03-10T20:04:27.370698+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:28 gibba009 bash[9804]: audit 2021-03-10T20:04:27.372077+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:04:29.588 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[13705]: debug 2021-03-10T20:04:29.361+0000 7fe4efb24700 -1 osd.5 0 waiting for initial osdmap 2021-03-10T20:04:29.588 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[13705]: debug 2021-03-10T20:04:29.365+0000 7fe4fad40700 -1 osd.5 36 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:04:29.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: cluster 2021-03-10T20:04:28.336059+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:29.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.354388+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:04:29.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: cluster 2021-03-10T20:04:28.354412+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:04:29.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.354518+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:29.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.360383+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.361709+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.558575+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:29.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.662986+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:29.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:29 gibba009 bash[9804]: audit 2021-03-10T20:04:28.672111+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:29.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: cluster 2021-03-10T20:04:28.336059+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:29.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.354388+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:04:29.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: cluster 2021-03-10T20:04:28.354412+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:04:29.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.354518+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:29.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.360383+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.361709+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.558575+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:29.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: cluster 2021-03-10T20:04:28.336059+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:29.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.354388+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:04:29.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: cluster 2021-03-10T20:04:28.354412+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:04:29.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.354518+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:29.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.360383+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.361709+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:29.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.558575+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:29.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.662986+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:29.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[9777]: audit 2021-03-10T20:04:28.672111+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:29.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.662986+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:29.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:29 gibba004 bash[12967]: audit 2021-03-10T20:04:28.672111+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}}, \"last_daemon_update\": \"2021-03-10T20:04:22.030178\", \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:30 gibba009 bash[9804]: cluster 2021-03-10T20:04:28.381081+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:30 gibba009 bash[9804]: cluster 2021-03-10T20:04:28.381230+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:30 gibba009 bash[9804]: audit 2021-03-10T20:04:29.364134+0000 mon.a (mon.0) 388 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:30.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:30 gibba009 bash[9804]: cluster 2021-03-10T20:04:29.364165+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:04:30.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:30 gibba009 bash[9804]: audit 2021-03-10T20:04:29.364751+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[9777]: cluster 2021-03-10T20:04:28.381081+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[9777]: cluster 2021-03-10T20:04:28.381230+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:30.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[9777]: audit 2021-03-10T20:04:29.364134+0000 mon.a (mon.0) 388 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:30.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[9777]: cluster 2021-03-10T20:04:29.364165+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:04:30.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[9777]: audit 2021-03-10T20:04:29.364751+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:30.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[12967]: cluster 2021-03-10T20:04:28.381081+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[12967]: cluster 2021-03-10T20:04:28.381230+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[12967]: audit 2021-03-10T20:04:29.364134+0000 mon.a (mon.0) 388 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[12967]: cluster 2021-03-10T20:04:29.364165+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:04:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:30 gibba004 bash[12967]: audit 2021-03-10T20:04:29.364751+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:31.695 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: cluster 2021-03-10T20:04:30.337053+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:31.696 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: cluster 2021-03-10T20:04:30.379012+0000 mon.a (mon.0) 391 : cluster [INF] osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340] boot 2021-03-10T20:04:31.696 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: cluster 2021-03-10T20:04:30.379081+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:04:31.697 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: audit 2021-03-10T20:04:30.379284+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:31.697 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: audit 2021-03-10T20:04:30.569329+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:31.697 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: cephadm 2021-03-10T20:04:30.571340+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:31.698 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: audit 2021-03-10T20:04:30.572157+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:31.698 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: audit 2021-03-10T20:04:30.575012+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:31.699 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:31 gibba009 bash[9804]: audit 2021-03-10T20:04:30.579180+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: cluster 2021-03-10T20:04:30.337053+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: cluster 2021-03-10T20:04:30.379012+0000 mon.a (mon.0) 391 : cluster [INF] osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340] boot 2021-03-10T20:04:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: cluster 2021-03-10T20:04:30.379081+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:04:31.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: audit 2021-03-10T20:04:30.379284+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:31.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: audit 2021-03-10T20:04:30.569329+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:31.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: cephadm 2021-03-10T20:04:30.571340+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:31.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: audit 2021-03-10T20:04:30.572157+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:31.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: audit 2021-03-10T20:04:30.575012+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:31.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[9777]: audit 2021-03-10T20:04:30.579180+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: cluster 2021-03-10T20:04:30.337053+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:04:31.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: cluster 2021-03-10T20:04:30.379012+0000 mon.a (mon.0) 391 : cluster [INF] osd.5 [v2:172.21.2.109:6808/4017087340,v1:172.21.2.109:6809/4017087340] boot 2021-03-10T20:04:31.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: cluster 2021-03-10T20:04:30.379081+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:04:31.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: audit 2021-03-10T20:04:30.379284+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:04:31.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: audit 2021-03-10T20:04:30.569329+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:31.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: cephadm 2021-03-10T20:04:30.571340+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:31.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: audit 2021-03-10T20:04:30.572157+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:31.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: audit 2021-03-10T20:04:30.575012+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:31.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:31 gibba004 bash[12967]: audit 2021-03-10T20:04:30.579180+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:32.758 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:32 gibba009 bash[9804]: cluster 2021-03-10T20:04:31.391969+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:04:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:32 gibba004 bash[9777]: cluster 2021-03-10T20:04:31.391969+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:04:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:32 gibba004 bash[12967]: cluster 2021-03-10T20:04:31.391969+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:04:33.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:33 gibba004 bash[9777]: cluster 2021-03-10T20:04:32.338034+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:33.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:33 gibba004 bash[9777]: cluster 2021-03-10T20:04:32.391243+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:04:33.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:33 gibba004 bash[12967]: cluster 2021-03-10T20:04:32.338034+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:33.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:33 gibba004 bash[12967]: cluster 2021-03-10T20:04:32.391243+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:04:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:33 gibba009 bash[9804]: cluster 2021-03-10T20:04:32.338034+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:33 gibba009 bash[9804]: cluster 2021-03-10T20:04:32.391243+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:04:34.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[9777]: audit 2021-03-10T20:04:33.391190+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.109:0/3098368454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[9777]: audit 2021-03-10T20:04:33.392999+0000 mon.a (mon.0) 399 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[9777]: audit 2021-03-10T20:04:33.404308+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]': finished 2021-03-10T20:04:34.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[9777]: cluster 2021-03-10T20:04:33.404353+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:04:34.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[9777]: audit 2021-03-10T20:04:33.405032+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:34.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[12967]: audit 2021-03-10T20:04:33.391190+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.109:0/3098368454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[12967]: audit 2021-03-10T20:04:33.392999+0000 mon.a (mon.0) 399 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[12967]: audit 2021-03-10T20:04:33.404308+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]': finished 2021-03-10T20:04:34.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[12967]: cluster 2021-03-10T20:04:33.404353+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:04:34.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:34 gibba004 bash[12967]: audit 2021-03-10T20:04:33.405032+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:34.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:34 gibba009 bash[9804]: audit 2021-03-10T20:04:33.391190+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.109:0/3098368454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:34 gibba009 bash[9804]: audit 2021-03-10T20:04:33.392999+0000 mon.a (mon.0) 399 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]: dispatch 2021-03-10T20:04:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:34 gibba009 bash[9804]: audit 2021-03-10T20:04:33.404308+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cefd4740-1a5b-4325-96e2-cdbae970ab52"}]': finished 2021-03-10T20:04:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:34 gibba009 bash[9804]: cluster 2021-03-10T20:04:33.404353+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:04:34.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:34 gibba009 bash[9804]: audit 2021-03-10T20:04:33.405032+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:35.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:35 gibba004 bash[9777]: cluster 2021-03-10T20:04:34.338890+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:35.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:35 gibba004 bash[12967]: cluster 2021-03-10T20:04:34.338890+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:35.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:35 gibba009 bash[9804]: cluster 2021-03-10T20:04:34.338890+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:36.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:36 gibba004 bash[9777]: audit 2021-03-10T20:04:35.422746+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.109:0/1558263033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:36.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:36 gibba004 bash[12967]: audit 2021-03-10T20:04:35.422746+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.109:0/1558263033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:36.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:36 gibba009 bash[9804]: audit 2021-03-10T20:04:35.422746+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.109:0/1558263033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:37.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:37 gibba004 bash[9777]: cluster 2021-03-10T20:04:36.339368+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:37.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:37 gibba004 bash[12967]: cluster 2021-03-10T20:04:36.339368+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:37 gibba009 bash[9804]: cluster 2021-03-10T20:04:36.339368+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:38.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:38 gibba004 bash[9777]: audit 2021-03-10T20:04:38.027549+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:38.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:38 gibba004 bash[12967]: audit 2021-03-10T20:04:38.027549+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:38.833 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:38 gibba009 bash[9804]: audit 2021-03-10T20:04:38.027549+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[9777]: cluster 2021-03-10T20:04:38.339999+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[9777]: cluster 2021-03-10T20:04:38.434326+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:04:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[9777]: cluster 2021-03-10T20:04:38.434420+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T20:04:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[12967]: cluster 2021-03-10T20:04:38.339999+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[12967]: cluster 2021-03-10T20:04:38.434326+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:04:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:39 gibba004 bash[12967]: cluster 2021-03-10T20:04:38.434420+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T20:04:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:39 gibba009 bash[9804]: cluster 2021-03-10T20:04:38.339999+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:39 gibba009 bash[9804]: cluster 2021-03-10T20:04:38.434326+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:04:39.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:39 gibba009 bash[9804]: cluster 2021-03-10T20:04:38.434420+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T20:04:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[9777]: cluster 2021-03-10T20:04:40.340976+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[9777]: audit 2021-03-10T20:04:41.225008+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:04:41.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[9777]: audit 2021-03-10T20:04:41.227833+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:41.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[9777]: audit 2021-03-10T20:04:41.231064+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:04:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[12967]: cluster 2021-03-10T20:04:40.340976+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:41.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[12967]: audit 2021-03-10T20:04:41.225008+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:04:41.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[12967]: audit 2021-03-10T20:04:41.227833+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:41.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:41 gibba004 bash[12967]: audit 2021-03-10T20:04:41.231064+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:04:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:41 gibba009 bash[9804]: cluster 2021-03-10T20:04:40.340976+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:41 gibba009 bash[9804]: audit 2021-03-10T20:04:41.225008+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:04:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:41 gibba009 bash[9804]: audit 2021-03-10T20:04:41.227833+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:41.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:41 gibba009 bash[9804]: audit 2021-03-10T20:04:41.231064+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:04:42.753 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:42 gibba009 bash[9804]: cephadm 2021-03-10T20:04:41.230128+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:04:42.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:42 gibba004 bash[9777]: cephadm 2021-03-10T20:04:41.230128+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:04:42.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:42 gibba004 bash[12967]: cephadm 2021-03-10T20:04:41.230128+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:04:43.072 INFO:teuthology.orchestra.run.gibba009.stdout:Created osd(s) 6 on host 'gibba009' 2021-03-10T20:04:43.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: cluster 2021-03-10T20:04:42.341968+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:43.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: cluster 2021-03-10T20:04:42.341968+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:43.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: audit 2021-03-10T20:04:43.061519+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:43.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: audit 2021-03-10T20:04:43.063051+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:43.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: audit 2021-03-10T20:04:43.070845+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:43.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: audit 2021-03-10T20:04:43.061519+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:43.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: audit 2021-03-10T20:04:43.063051+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:43.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: audit 2021-03-10T20:04:43.070845+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:43.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: audit 2021-03-10T20:04:43.335971+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:43.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[9777]: audit 2021-03-10T20:04:43.344582+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:43.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: audit 2021-03-10T20:04:43.335971+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:43.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:43 gibba004 bash[12967]: audit 2021-03-10T20:04:43.344582+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:43.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: cluster 2021-03-10T20:04:42.341968+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:43.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: audit 2021-03-10T20:04:43.061519+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: audit 2021-03-10T20:04:43.063051+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: audit 2021-03-10T20:04:43.070845+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029134\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029412\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029587\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029748\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:22.029902\", \"created\": \"2021-03-10T20:04:21.549383\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_device_update\": \"2021-03-10T20:04:28.660718\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: audit 2021-03-10T20:04:43.335971+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:04:43.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:43 gibba009 bash[9804]: audit 2021-03-10T20:04:43.344582+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:04:44.182 DEBUG:teuthology.orchestra.run.gibba009:osd.6> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.6.service 2021-03-10T20:04:44.184 INFO:tasks.cephadm:Deploying osd.7 on gibba009 with /dev/vg_nvme/lv_1... 2021-03-10T20:04:44.185 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T20:04:44.271 INFO:journalctl@ceph.osd.6.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:44 gibba009 bash[9804]: audit 2021-03-10T20:04:43.484195+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:44 gibba009 bash[9804]: audit 2021-03-10T20:04:43.486783+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:44 gibba009 bash[9804]: audit 2021-03-10T20:04:43.487351+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:44.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[9777]: audit 2021-03-10T20:04:43.484195+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:45.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[9777]: audit 2021-03-10T20:04:43.486783+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:45.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[9777]: audit 2021-03-10T20:04:43.487351+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:45.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[12967]: audit 2021-03-10T20:04:43.484195+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[12967]: audit 2021-03-10T20:04:43.486783+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:44 gibba004 bash[12967]: audit 2021-03-10T20:04:43.487351+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:45.503 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:04:45.503 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T20:04:45.504 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:04:45.504 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:04:45.504 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:04:45.504 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:04:45.505 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[14822]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T20:04:45.800 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:45 gibba009 bash[9804]: cluster 2021-03-10T20:04:44.342811+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:45.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:45 gibba004 bash[9777]: cluster 2021-03-10T20:04:44.342811+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:45.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:45 gibba004 bash[12967]: cluster 2021-03-10T20:04:44.342811+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:47.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:47 gibba009 bash[9804]: cluster 2021-03-10T20:04:46.343286+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:47.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:47 gibba004 bash[9777]: cluster 2021-03-10T20:04:46.343286+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:47 gibba004 bash[12967]: cluster 2021-03-10T20:04:46.343286+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:48.821 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T20:04:48.821 INFO:teuthology.orchestra.run.gibba009.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T20:04:48.822 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 10+0 records in 2021-03-10T20:04:48.822 INFO:teuthology.orchestra.run.gibba009.stderr:10+0 records out 2021-03-10T20:04:48.822 INFO:teuthology.orchestra.run.gibba009.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00805523 s, 1.3 GB/s 2021-03-10T20:04:48.822 INFO:teuthology.orchestra.run.gibba009.stderr: stderr: 2021-03-10T20:04:48.822 INFO:teuthology.orchestra.run.gibba009.stderr:--> Zapping successful for: 2021-03-10T20:04:49.338 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:48 gibba009 bash[15209]: debug 2021-03-10T20:04:48.877+0000 7f41eaee2ec0 -1 Falling back to public interface 2021-03-10T20:04:49.472 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba009:vg_nvme/lv_1 2021-03-10T20:04:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:49 gibba004 bash[9777]: cluster 2021-03-10T20:04:48.343841+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:49.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:49 gibba004 bash[12967]: cluster 2021-03-10T20:04:48.343841+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:49.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:49 gibba009 bash[9804]: cluster 2021-03-10T20:04:48.343841+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:49.839 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:49 gibba009 bash[15209]: debug 2021-03-10T20:04:49.525+0000 7f41eaee2ec0 -1 osd.6 0 log_to_monitors {default=true} 2021-03-10T20:04:50.718 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:50 gibba009 bash[9804]: audit 2021-03-10T20:04:49.533233+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.718 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:50 gibba009 bash[9804]: audit 2021-03-10T20:04:49.535053+0000 mon.a (mon.0) 417 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.719 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:50 gibba009 bash[9804]: audit 2021-03-10T20:04:50.176277+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:50.719 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:50 gibba009 bash[9804]: audit 2021-03-10T20:04:50.290940+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:50.719 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:50 gibba009 bash[9804]: audit 2021-03-10T20:04:50.299720+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[9777]: audit 2021-03-10T20:04:49.533233+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[9777]: audit 2021-03-10T20:04:49.535053+0000 mon.a (mon.0) 417 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[9777]: audit 2021-03-10T20:04:50.176277+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[12967]: audit 2021-03-10T20:04:49.533233+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[12967]: audit 2021-03-10T20:04:49.535053+0000 mon.a (mon.0) 417 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:04:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[12967]: audit 2021-03-10T20:04:50.176277+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:04:50.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[9777]: audit 2021-03-10T20:04:50.290940+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:50.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[9777]: audit 2021-03-10T20:04:50.299720+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[12967]: audit 2021-03-10T20:04:50.290940+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:04:50.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:50 gibba004 bash[12967]: audit 2021-03-10T20:04:50.299720+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476770\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:41.224194\"}}, \"last_daemon_update\": \"2021-03-10T20:04:43.477033\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:04:51.766 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[15209]: debug 2021-03-10T20:04:51.381+0000 7f41cfc8f700 -1 osd.6 0 waiting for initial osdmap 2021-03-10T20:04:51.767 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[15209]: debug 2021-03-10T20:04:51.385+0000 7f41daeab700 -1 osd.6 41 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:04:51.767 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: cluster 2021-03-10T20:04:50.344672+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:51.767 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: audit 2021-03-10T20:04:50.372407+0000 mon.a (mon.0) 421 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:04:51.768 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: cluster 2021-03-10T20:04:50.372439+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:04:51.768 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: audit 2021-03-10T20:04:50.372514+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:51.768 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: audit 2021-03-10T20:04:50.378535+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.768 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: audit 2021-03-10T20:04:50.380253+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.769 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: cluster 2021-03-10T20:04:50.490298+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:51.769 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:51 gibba009 bash[9804]: cluster 2021-03-10T20:04:50.490358+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: cluster 2021-03-10T20:04:50.344672+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: audit 2021-03-10T20:04:50.372407+0000 mon.a (mon.0) 421 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:04:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: cluster 2021-03-10T20:04:50.372439+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:04:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: audit 2021-03-10T20:04:50.372514+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: audit 2021-03-10T20:04:50.378535+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: audit 2021-03-10T20:04:50.380253+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: cluster 2021-03-10T20:04:50.490298+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:51.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[9777]: cluster 2021-03-10T20:04:50.490358+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: cluster 2021-03-10T20:04:50.344672+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: audit 2021-03-10T20:04:50.372407+0000 mon.a (mon.0) 421 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:04:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: cluster 2021-03-10T20:04:50.372439+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:04:51.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: audit 2021-03-10T20:04:50.372514+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: audit 2021-03-10T20:04:50.378535+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: audit 2021-03-10T20:04:50.380253+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:04:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: cluster 2021-03-10T20:04:50.490298+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:04:51.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:51 gibba004 bash[12967]: cluster 2021-03-10T20:04:50.490358+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:04:52.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:51.376533+0000 mon.a (mon.0) 425 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: cluster 2021-03-10T20:04:51.376600+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:04:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:51.377262+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:52.046178+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: cephadm 2021-03-10T20:04:52.048158+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:52.048975+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:52.051893+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: audit 2021-03-10T20:04:52.056193+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:52.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:52 gibba009 bash[9804]: cluster 2021-03-10T20:04:52.385400+0000 mon.a (mon.0) 431 : cluster [INF] osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711] boot 2021-03-10T20:04:52.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:51.376533+0000 mon.a (mon.0) 425 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: cluster 2021-03-10T20:04:51.376600+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:04:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:51.377262+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:52.046178+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: cephadm 2021-03-10T20:04:52.048158+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:52.048975+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:52.051893+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: audit 2021-03-10T20:04:52.056193+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[9777]: cluster 2021-03-10T20:04:52.385400+0000 mon.a (mon.0) 431 : cluster [INF] osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711] boot 2021-03-10T20:04:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:51.376533+0000 mon.a (mon.0) 425 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:04:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: cluster 2021-03-10T20:04:51.376600+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:04:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:51.377262+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:52.046178+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba009:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:04:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: cephadm 2021-03-10T20:04:52.048158+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host gibba009... 2021-03-10T20:04:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:52.048975+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:04:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:52.051893+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:04:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: audit 2021-03-10T20:04:52.056193+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:04:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:52 gibba004 bash[12967]: cluster 2021-03-10T20:04:52.385400+0000 mon.a (mon.0) 431 : cluster [INF] osd.6 [v2:172.21.2.109:6816/3260627711,v1:172.21.2.109:6817/3260627711] boot 2021-03-10T20:04:53.562 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:53 gibba009 bash[9804]: cluster 2021-03-10T20:04:52.345514+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:53.563 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:53 gibba009 bash[9804]: cluster 2021-03-10T20:04:52.385513+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:04:53.563 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:53 gibba009 bash[9804]: audit 2021-03-10T20:04:52.385811+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[9777]: cluster 2021-03-10T20:04:52.345514+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:53.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[9777]: cluster 2021-03-10T20:04:52.385513+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:04:53.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[9777]: audit 2021-03-10T20:04:52.385811+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:53.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[12967]: cluster 2021-03-10T20:04:52.345514+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:04:53.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[12967]: cluster 2021-03-10T20:04:52.385513+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:04:53.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:53 gibba004 bash[12967]: audit 2021-03-10T20:04:52.385811+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:04:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:54 gibba009 bash[9804]: cluster 2021-03-10T20:04:53.403492+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:04:54.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:54 gibba004 bash[9777]: cluster 2021-03-10T20:04:53.403492+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:04:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:54 gibba004 bash[12967]: cluster 2021-03-10T20:04:53.403492+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:04:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: cluster 2021-03-10T20:04:54.346327+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: audit 2021-03-10T20:04:54.933492+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.109:0/4141849635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: audit 2021-03-10T20:04:54.936023+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: audit 2021-03-10T20:04:54.947364+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]': finished 2021-03-10T20:04:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: cluster 2021-03-10T20:04:54.947404+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:04:55.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[9777]: audit 2021-03-10T20:04:54.947525+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:04:55.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: cluster 2021-03-10T20:04:54.346327+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:55.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: audit 2021-03-10T20:04:54.933492+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.109:0/4141849635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: audit 2021-03-10T20:04:54.936023+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: audit 2021-03-10T20:04:54.947364+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]': finished 2021-03-10T20:04:55.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: cluster 2021-03-10T20:04:54.947404+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:04:55.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:55 gibba004 bash[12967]: audit 2021-03-10T20:04:54.947525+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:04:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: cluster 2021-03-10T20:04:54.346327+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: audit 2021-03-10T20:04:54.933492+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.109:0/4141849635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: audit 2021-03-10T20:04:54.936023+0000 mon.a (mon.0) 435 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]: dispatch 2021-03-10T20:04:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: audit 2021-03-10T20:04:54.947364+0000 mon.a (mon.0) 436 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7402873-089f-44c1-b2ae-5feb0f0f7673"}]': finished 2021-03-10T20:04:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: cluster 2021-03-10T20:04:54.947404+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:04:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:55 gibba009 bash[9804]: audit 2021-03-10T20:04:54.947525+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:04:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:57 gibba004 bash[9777]: cluster 2021-03-10T20:04:56.346627+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:57 gibba004 bash[9777]: audit 2021-03-10T20:04:56.994258+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.109:0/2880983405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:57 gibba004 bash[12967]: cluster 2021-03-10T20:04:56.346627+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:57 gibba004 bash[12967]: audit 2021-03-10T20:04:56.994258+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.109:0/2880983405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:57.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:57 gibba009 bash[9804]: cluster 2021-03-10T20:04:56.346627+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:57 gibba009 bash[9804]: audit 2021-03-10T20:04:56.994258+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.109:0/2880983405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:04:59.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:04:59 gibba009 bash[9804]: cluster 2021-03-10T20:04:58.347193+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:59.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:04:59 gibba004 bash[9777]: cluster 2021-03-10T20:04:58.347193+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:04:59.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:04:59 gibba004 bash[12967]: cluster 2021-03-10T20:04:58.347193+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:00 gibba009 bash[9804]: audit 2021-03-10T20:04:59.571698+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:00.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:00 gibba004 bash[9777]: audit 2021-03-10T20:04:59.571698+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:00.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:00 gibba004 bash[12967]: audit 2021-03-10T20:04:59.571698+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:01.724 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:01 gibba009 bash[9804]: cluster 2021-03-10T20:05:00.348049+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:01.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:01 gibba004 bash[9777]: cluster 2021-03-10T20:05:00.348049+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:01.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:01 gibba004 bash[12967]: cluster 2021-03-10T20:05:00.348049+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:03.703 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:03 gibba009 bash[9804]: cluster 2021-03-10T20:05:02.348881+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:03.703 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:03 gibba009 bash[9804]: audit 2021-03-10T20:05:02.857066+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:05:03.703 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:03 gibba009 bash[9804]: audit 2021-03-10T20:05:02.860019+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:03.704 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:03 gibba009 bash[9804]: cephadm 2021-03-10T20:05:02.862455+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:05:03.704 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:03 gibba009 bash[9804]: audit 2021-03-10T20:05:02.863394+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:05:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[9777]: cluster 2021-03-10T20:05:02.348881+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[9777]: audit 2021-03-10T20:05:02.857066+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:05:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[9777]: audit 2021-03-10T20:05:02.860019+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[9777]: cephadm 2021-03-10T20:05:02.862455+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:05:03.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[9777]: audit 2021-03-10T20:05:02.863394+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:05:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[12967]: cluster 2021-03-10T20:05:02.348881+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[12967]: audit 2021-03-10T20:05:02.857066+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:05:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[12967]: audit 2021-03-10T20:05:02.860019+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[12967]: cephadm 2021-03-10T20:05:02.862455+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:05:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:03 gibba004 bash[12967]: audit 2021-03-10T20:05:02.863394+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:05:04.588 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:04 gibba009 systemd[1]: Stopping Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:05:04.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:04 gibba009 bash[15209]: debug 2021-03-10T20:05:04.453+0000 7f41e272a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:05:04.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:04 gibba009 bash[15209]: debug 2021-03-10T20:05:04.453+0000 7f41e272a700 -1 osd.6 44 *** Got signal Terminated *** 2021-03-10T20:05:04.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:04 gibba009 bash[15209]: debug 2021-03-10T20:05:04.453+0000 7f41e272a700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:05:05.588 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:05 gibba009 docker[16244]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.6 2021-03-10T20:05:05.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.349866+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:05.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.564879+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.564976+0000 mon.a (mon.0) 444 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:05:05.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.565455+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.766446+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.766917+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.767566+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.767750+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.768353+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.768523+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.769009+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.769293+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.769778+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.770050+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.770632+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:04.770914+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.164295+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.164654+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.165198+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.165474+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.171168+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.171375+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.171995+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.172289+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.172538+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.172609+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.172800+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.596 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:05 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.172887+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.349866+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.564879+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.564976+0000 mon.a (mon.0) 444 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:05:05.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.565455+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.766446+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.766917+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.767566+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.767750+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.768353+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.768523+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.769009+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.769293+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.769778+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.770050+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.770632+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:04.770914+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.164295+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.164654+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.165198+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.165474+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.171168+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.171375+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.171995+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.172289+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.172538+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.172609+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.172800+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.172887+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.349866+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:05.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.564879+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.564976+0000 mon.a (mon.0) 444 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:05:05.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.565455+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.766446+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.766917+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.767566+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.767750+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.768353+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.768523+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.769009+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.769293+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.769778+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.770050+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.770632+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:04.770914+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.164295+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.164654+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.165198+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:05:05.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.165474+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:05:05.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.171168+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.171375+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:05:05.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.171995+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.172289+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.172538+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:05.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.172609+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:05:05.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.172800+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:05:05.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:05 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.172887+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:05:06.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:06 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.388578+0000 mon.a (mon.0) 470 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:05:06.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:06 gibba009 bash[9804]: cluster 2021-03-10T20:05:05.402666+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e45: 8 total, 6 up, 7 in 2021-03-10T20:05:06.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:06 gibba009 bash[9804]: audit 2021-03-10T20:05:05.411000+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.388578+0000 mon.a (mon.0) 470 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:05:06.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[9777]: cluster 2021-03-10T20:05:05.402666+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e45: 8 total, 6 up, 7 in 2021-03-10T20:05:06.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[9777]: audit 2021-03-10T20:05:05.411000+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:06.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.388578+0000 mon.a (mon.0) 470 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:05:06.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[12967]: cluster 2021-03-10T20:05:05.402666+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e45: 8 total, 6 up, 7 in 2021-03-10T20:05:06.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:06 gibba004 bash[12967]: audit 2021-03-10T20:05:05.411000+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:07.156 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:06 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T20:05:07.157 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:06 gibba009 systemd[1]: Stopped Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:07.157 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:06 gibba009 systemd[1]: Starting Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:05:07.157 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:07 gibba009 docker[16378]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.6 2021-03-10T20:05:07.157 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:07 gibba009 systemd[1]: Started Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: cluster 2021-03-10T20:05:06.350396+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: cluster 2021-03-10T20:05:06.405388+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e46: 8 total, 6 up, 7 in 2021-03-10T20:05:07.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:06.405554+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:07.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: cluster 2021-03-10T20:05:06.350396+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:07.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: cluster 2021-03-10T20:05:06.405388+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e46: 8 total, 6 up, 7 in 2021-03-10T20:05:07.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:06.405554+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:07.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.021905+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:07.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.023446+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.021905+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:07.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.023446+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:07.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.030894+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:07.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.031884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:05:07.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.032981+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:07.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: cephadm 2021-03-10T20:05:07.033645+0000 mgr.y (mgr.14140) 150 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:05:07.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[9777]: audit 2021-03-10T20:05:07.033800+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:05:07.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.030894+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:07.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.031884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:05:07.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.032981+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:07.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: cephadm 2021-03-10T20:05:07.033645+0000 mgr.y (mgr.14140) 150 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:05:07.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:07 gibba004 bash[12967]: audit 2021-03-10T20:05:07.033800+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:05:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: cluster 2021-03-10T20:05:06.350396+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: cluster 2021-03-10T20:05:06.405388+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e46: 8 total, 6 up, 7 in 2021-03-10T20:05:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:06.405554+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.021905+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.023446+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.030894+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.475882\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476149\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476316\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476471\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:04:43.476621\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:07.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.031884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:05:07.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.032981+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:07.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: cephadm 2021-03-10T20:05:07.033645+0000 mgr.y (mgr.14140) 150 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:05:07.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:07 gibba009 bash[9804]: audit 2021-03-10T20:05:07.033800+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:05:08.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:05:08.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T20:05:08.589 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:05:08.590 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:05:08.590 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:05:08.590 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:05:08.590 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[16396]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T20:05:08.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[9804]: audit 2021-03-10T20:05:07.465866+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:08.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:08 gibba009 bash[9804]: audit 2021-03-10T20:05:07.471049+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:08.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:08 gibba004 bash[9777]: audit 2021-03-10T20:05:07.465866+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:08.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:08 gibba004 bash[9777]: audit 2021-03-10T20:05:07.471049+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:08.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:08 gibba004 bash[12967]: audit 2021-03-10T20:05:07.465866+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:08.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:08 gibba004 bash[12967]: audit 2021-03-10T20:05:07.471049+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}}, \"last_daemon_update\": \"2021-03-10T20:05:07.464753\", \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:09.398 INFO:teuthology.orchestra.run.gibba009.stdout:Created osd(s) 6,7 on host 'gibba009' 2021-03-10T20:05:09.753 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:09 gibba009 bash[9804]: cluster 2021-03-10T20:05:08.350889+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:09.754 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:09 gibba009 bash[9804]: audit 2021-03-10T20:05:09.388390+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:09.754 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:09 gibba009 bash[9804]: audit 2021-03-10T20:05:09.389925+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:09.754 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:09 gibba009 bash[9804]: audit 2021-03-10T20:05:09.397162+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[9777]: cluster 2021-03-10T20:05:08.350889+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:09.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[12967]: cluster 2021-03-10T20:05:08.350889+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 stale+active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[9777]: audit 2021-03-10T20:05:09.388390+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[9777]: audit 2021-03-10T20:05:09.389925+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[9777]: audit 2021-03-10T20:05:09.397162+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[12967]: audit 2021-03-10T20:05:09.388390+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[12967]: audit 2021-03-10T20:05:09.389925+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:09 gibba004 bash[12967]: audit 2021-03-10T20:05:09.397162+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464276\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464393\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464461\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464524\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464586\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:07.464647\", \"created\": \"2021-03-10T20:04:43.045384\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_device_update\": \"2021-03-10T20:04:50.288411\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:10.604 DEBUG:teuthology.orchestra.run.gibba009:osd.7> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.7.service 2021-03-10T20:05:10.608 INFO:tasks.cephadm:Adding prometheus.a on gibba009 2021-03-10T20:05:10.608 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch apply prometheus '1;gibba009=a' 2021-03-10T20:05:10.681 INFO:journalctl@ceph.osd.7.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:10.810 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:10 gibba009 bash[9804]: cluster 2021-03-10T20:05:10.475982+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:05:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:10 gibba004 bash[9777]: cluster 2021-03-10T20:05:10.475982+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:05:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:10 gibba004 bash[12967]: cluster 2021-03-10T20:05:10.475982+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:05:11.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[9777]: cluster 2021-03-10T20:05:10.351668+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[12967]: cluster 2021-03-10T20:05:10.351668+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:11.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[9777]: audit 2021-03-10T20:05:10.684597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:11.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[9777]: audit 2021-03-10T20:05:10.693074+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:11.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[9777]: audit 2021-03-10T20:05:10.693768+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:11.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[12967]: audit 2021-03-10T20:05:10.684597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:11.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[12967]: audit 2021-03-10T20:05:10.693074+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:11.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:11 gibba004 bash[12967]: audit 2021-03-10T20:05:10.693768+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:11.838 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16707]: debug 2021-03-10T20:05:11.737+0000 7faaa1238ec0 -1 Falling back to public interface 2021-03-10T20:05:11.839 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:05:11.839 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T20:05:11.839 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:05:11.840 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:05:11.840 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:05:11.840 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:05:11.840 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[16764]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T20:05:11.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[9804]: cluster 2021-03-10T20:05:10.351668+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:11.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[9804]: audit 2021-03-10T20:05:10.684597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:11.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[9804]: audit 2021-03-10T20:05:10.693074+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:11.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:11 gibba009 bash[9804]: audit 2021-03-10T20:05:10.693768+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:05:12.807 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[16707]: debug 2021-03-10T20:05:12.405+0000 7faaa1238ec0 -1 osd.6 44 log_to_monitors {default=true} 2021-03-10T20:05:12.808 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[16707]: debug 2021-03-10T20:05:12.429+0000 7faa95209700 -1 osd.6 44 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:05:12.808 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[9804]: audit 2021-03-10T20:05:12.419563+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.808 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[9804]: audit 2021-03-10T20:05:12.421818+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.809 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[9804]: audit 2021-03-10T20:05:12.422474+0000 mon.b (mon.2) 21 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:12.809 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:12 gibba009 bash[9804]: audit 2021-03-10T20:05:12.424667+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[9777]: audit 2021-03-10T20:05:12.419563+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[9777]: audit 2021-03-10T20:05:12.421818+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[9777]: audit 2021-03-10T20:05:12.422474+0000 mon.b (mon.2) 21 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:12.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[9777]: audit 2021-03-10T20:05:12.424667+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:12.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[12967]: audit 2021-03-10T20:05:12.419563+0000 mon.b (mon.2) 20 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[12967]: audit 2021-03-10T20:05:12.421818+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:05:12.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[12967]: audit 2021-03-10T20:05:12.422474+0000 mon.b (mon.2) 21 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:12.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:12 gibba004 bash[12967]: audit 2021-03-10T20:05:12.424667+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:13.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: cluster 2021-03-10T20:05:12.352691+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:13.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: cluster 2021-03-10T20:05:12.540718+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:05:13.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: cluster 2021-03-10T20:05:12.554326+0000 mon.a (mon.0) 493 : cluster [INF] osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222] boot 2021-03-10T20:05:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: cluster 2021-03-10T20:05:12.554359+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T20:05:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: audit 2021-03-10T20:05:12.554551+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:05:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:13 gibba009 bash[9804]: audit 2021-03-10T20:05:12.554769+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:13.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: cluster 2021-03-10T20:05:12.352691+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:13.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: cluster 2021-03-10T20:05:12.540718+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:05:13.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: cluster 2021-03-10T20:05:12.554326+0000 mon.a (mon.0) 493 : cluster [INF] osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222] boot 2021-03-10T20:05:13.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: cluster 2021-03-10T20:05:12.554359+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T20:05:13.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: audit 2021-03-10T20:05:12.554551+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:05:13.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[9777]: audit 2021-03-10T20:05:12.554769+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:13.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: cluster 2021-03-10T20:05:12.352691+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:13.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: cluster 2021-03-10T20:05:12.540718+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:05:13.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: cluster 2021-03-10T20:05:12.554326+0000 mon.a (mon.0) 493 : cluster [INF] osd.6 [v2:172.21.2.109:6816/1264601222,v1:172.21.2.109:6817/1264601222] boot 2021-03-10T20:05:13.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: cluster 2021-03-10T20:05:12.554359+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-03-10T20:05:13.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: audit 2021-03-10T20:05:12.554551+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:05:13.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:13 gibba004 bash[12967]: audit 2021-03-10T20:05:12.554769+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:14 gibba009 bash[9804]: cluster 2021-03-10T20:05:13.567575+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T20:05:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:14 gibba009 bash[9804]: audit 2021-03-10T20:05:13.567693+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:15.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:14 gibba004 bash[9777]: cluster 2021-03-10T20:05:13.567575+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T20:05:15.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:14 gibba004 bash[9777]: audit 2021-03-10T20:05:13.567693+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:15.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:14 gibba004 bash[12967]: cluster 2021-03-10T20:05:13.567575+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-03-10T20:05:15.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:14 gibba004 bash[12967]: audit 2021-03-10T20:05:13.567693+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:15.243 INFO:teuthology.orchestra.run.gibba009.stdout:Scheduled prometheus update... 2021-03-10T20:05:15.838 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:15 gibba009 bash[17309]: debug 2021-03-10T20:05:15.605+0000 7fe6b3ab3ec0 -1 Falling back to public interface 2021-03-10T20:05:15.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:15 gibba009 bash[9804]: cluster 2021-03-10T20:05:14.353711+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v159: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:15.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:15 gibba009 bash[9804]: audit 2021-03-10T20:05:15.232997+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:05:15.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:15 gibba009 bash[9804]: audit 2021-03-10T20:05:15.241523+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:05:15.853 DEBUG:teuthology.orchestra.run.gibba009:prometheus.a> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@prometheus.a.service 2021-03-10T20:05:16.056 INFO:tasks.cephadm:Adding node-exporter.a on gibba004 2021-03-10T20:05:16.057 INFO:tasks.cephadm:Adding node-exporter.b on gibba009 2021-03-10T20:05:16.058 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch apply node-exporter '2;gibba004=a;gibba009=b' 2021-03-10T20:05:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[9777]: cluster 2021-03-10T20:05:14.353711+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v159: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[9777]: audit 2021-03-10T20:05:15.232997+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:05:16.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[9777]: audit 2021-03-10T20:05:15.241523+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:05:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[12967]: cluster 2021-03-10T20:05:14.353711+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v159: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[12967]: audit 2021-03-10T20:05:15.232997+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:05:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:15 gibba004 bash[12967]: audit 2021-03-10T20:05:15.241523+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:05:15.232061\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:05:16.118 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:16.340 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:16 gibba009 bash[17309]: debug 2021-03-10T20:05:16.265+0000 7fe6b3ab3ec0 -1 osd.7 0 log_to_monitors {default=true} 2021-03-10T20:05:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[9777]: audit 2021-03-10T20:05:15.230725+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[9777]: cephadm 2021-03-10T20:05:15.232025+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba009=a 2021-03-10T20:05:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[9777]: audit 2021-03-10T20:05:16.276614+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[9777]: audit 2021-03-10T20:05:16.278856+0000 mon.a (mon.0) 501 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[12967]: audit 2021-03-10T20:05:15.230725+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:17.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[12967]: cephadm 2021-03-10T20:05:15.232025+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba009=a 2021-03-10T20:05:17.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[12967]: audit 2021-03-10T20:05:16.276614+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:16 gibba004 bash[12967]: audit 2021-03-10T20:05:16.278856+0000 mon.a (mon.0) 501 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:16 gibba009 bash[9804]: audit 2021-03-10T20:05:15.230725+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:16 gibba009 bash[9804]: cephadm 2021-03-10T20:05:15.232025+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba009=a 2021-03-10T20:05:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:16 gibba009 bash[9804]: audit 2021-03-10T20:05:16.276614+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:16 gibba009 bash[9804]: audit 2021-03-10T20:05:16.278856+0000 mon.a (mon.0) 501 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:05:17.838 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[17309]: debug 2021-03-10T20:05:17.605+0000 7fe69c868700 -1 osd.7 0 waiting for initial osdmap 2021-03-10T20:05:17.839 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[17309]: debug 2021-03-10T20:05:17.613+0000 7fe6a7a84700 -1 osd.7 50 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:05:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: cluster 2021-03-10T20:05:16.354517+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v160: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.596683+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:05:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: cluster 2021-03-10T20:05:16.596806+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T20:05:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.597548+0000 mon.b (mon.2) 23 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.597591+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.601240+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.781517+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.899700+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: audit 2021-03-10T20:05:16.908300+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:17 gibba009 bash[9804]: cephadm 2021-03-10T20:05:16.911350+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Deploying daemon prometheus.a on gibba009 2021-03-10T20:05:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: cluster 2021-03-10T20:05:16.354517+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v160: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.596683+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:05:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: cluster 2021-03-10T20:05:16.596806+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T20:05:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.597548+0000 mon.b (mon.2) 23 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.597591+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.601240+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.781517+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: cluster 2021-03-10T20:05:16.354517+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v160: 1 pgs: 1 active+undersized+degraded; 0 B data, 3.0 MiB used, 581 GiB / 588 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:05:18.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.596683+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:05:18.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: cluster 2021-03-10T20:05:16.596806+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2021-03-10T20:05:18.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.597548+0000 mon.b (mon.2) 23 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.597591+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.601240+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:05:18.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.781517+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:18.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.899700+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:18.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: audit 2021-03-10T20:05:16.908300+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:18.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[12967]: cephadm 2021-03-10T20:05:16.911350+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Deploying daemon prometheus.a on gibba009 2021-03-10T20:05:18.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.899700+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:18.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: audit 2021-03-10T20:05:16.908300+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}}, \"last_daemon_update\": \"2021-03-10T20:05:10.681931\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:18.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:17 gibba004 bash[9777]: cephadm 2021-03-10T20:05:16.911350+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Deploying daemon prometheus.a on gibba009 2021-03-10T20:05:19.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: cluster 2021-03-10T20:05:17.318991+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:05:19.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: cluster 2021-03-10T20:05:17.319031+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:05:19.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: audit 2021-03-10T20:05:17.610199+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:05:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: cluster 2021-03-10T20:05:17.610246+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e50: 8 total, 7 up, 7 in 2021-03-10T20:05:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: audit 2021-03-10T20:05:17.610916+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[12967]: cluster 2021-03-10T20:05:18.614786+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023] boot 2021-03-10T20:05:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: cluster 2021-03-10T20:05:17.318991+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:05:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: cluster 2021-03-10T20:05:17.319031+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:05:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: audit 2021-03-10T20:05:17.610199+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:05:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: cluster 2021-03-10T20:05:17.610246+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e50: 8 total, 7 up, 7 in 2021-03-10T20:05:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: audit 2021-03-10T20:05:17.610916+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:18 gibba004 bash[9777]: cluster 2021-03-10T20:05:18.614786+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023] boot 2021-03-10T20:05:19.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: cluster 2021-03-10T20:05:17.318991+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:05:19.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: cluster 2021-03-10T20:05:17.319031+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:05:19.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: audit 2021-03-10T20:05:17.610199+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]': finished 2021-03-10T20:05:19.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: cluster 2021-03-10T20:05:17.610246+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e50: 8 total, 7 up, 7 in 2021-03-10T20:05:19.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: audit 2021-03-10T20:05:17.610916+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:19.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:18 gibba009 bash[9804]: cluster 2021-03-10T20:05:18.614786+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.2.109:6824/1248843023,v1:172.21.2.109:6825/1248843023] boot 2021-03-10T20:05:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[9777]: cluster 2021-03-10T20:05:18.355205+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean+wait; 0 B data, 3.1 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[9777]: cluster 2021-03-10T20:05:18.614910+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:05:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[9777]: audit 2021-03-10T20:05:18.615194+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[9777]: cluster 2021-03-10T20:05:18.615985+0000 mon.a (mon.0) 515 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:05:20.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[9777]: cluster 2021-03-10T20:05:18.615998+0000 mon.a (mon.0) 516 : cluster [INF] Cluster is now healthy 2021-03-10T20:05:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[12967]: cluster 2021-03-10T20:05:18.355205+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean+wait; 0 B data, 3.1 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[12967]: cluster 2021-03-10T20:05:18.614910+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:05:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[12967]: audit 2021-03-10T20:05:18.615194+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:20.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[12967]: cluster 2021-03-10T20:05:18.615985+0000 mon.a (mon.0) 515 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:05:20.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:19 gibba004 bash[12967]: cluster 2021-03-10T20:05:18.615998+0000 mon.a (mon.0) 516 : cluster [INF] Cluster is now healthy 2021-03-10T20:05:20.070 INFO:teuthology.orchestra.run.gibba009.stdout:Scheduled node-exporter update... 2021-03-10T20:05:20.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:19 gibba009 bash[9804]: cluster 2021-03-10T20:05:18.355205+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean+wait; 0 B data, 3.1 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:05:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:19 gibba009 bash[9804]: cluster 2021-03-10T20:05:18.614910+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:05:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:19 gibba009 bash[9804]: audit 2021-03-10T20:05:18.615194+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:05:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:19 gibba009 bash[9804]: cluster 2021-03-10T20:05:18.615985+0000 mon.a (mon.0) 515 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:05:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:19 gibba009 bash[9804]: cluster 2021-03-10T20:05:18.615998+0000 mon.a (mon.0) 516 : cluster [INF] Cluster is now healthy 2021-03-10T20:05:21.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[9777]: cluster 2021-03-10T20:05:19.634067+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:21.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[9777]: audit 2021-03-10T20:05:20.063622+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba004=a;gibba009=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[9777]: cephadm 2021-03-10T20:05:20.064308+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba004=a,gibba009=b 2021-03-10T20:05:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[9777]: audit 2021-03-10T20:05:20.064780+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:05:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[9777]: audit 2021-03-10T20:05:20.069049+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:05:21.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[12967]: cluster 2021-03-10T20:05:19.634067+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:21.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[12967]: audit 2021-03-10T20:05:20.063622+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba004=a;gibba009=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:21.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[12967]: cephadm 2021-03-10T20:05:20.064308+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba004=a,gibba009=b 2021-03-10T20:05:21.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[12967]: audit 2021-03-10T20:05:20.064780+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:05:21.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:20 gibba004 bash[12967]: audit 2021-03-10T20:05:20.069049+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:05:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:20 gibba009 bash[9804]: cluster 2021-03-10T20:05:19.634067+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:20 gibba009 bash[9804]: audit 2021-03-10T20:05:20.063622+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba004=a;gibba009=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:20 gibba009 bash[9804]: cephadm 2021-03-10T20:05:20.064308+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba004=a,gibba009=b 2021-03-10T20:05:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:20 gibba009 bash[9804]: audit 2021-03-10T20:05:20.064780+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:05:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:20 gibba009 bash[9804]: audit 2021-03-10T20:05:20.069049+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:05:20.064325\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba009\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:05:22.059 DEBUG:teuthology.orchestra.run.gibba004:node-exporter.a> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@node-exporter.a.service 2021-03-10T20:05:22.065 DEBUG:teuthology.orchestra.run.gibba009:node-exporter.b> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@node-exporter.b.service 2021-03-10T20:05:22.070 INFO:tasks.cephadm:Adding alertmanager.a on gibba004 2021-03-10T20:05:22.071 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch apply alertmanager '1;gibba004=a' 2021-03-10T20:05:22.089 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:22.105 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:22.366 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:22 gibba009 bash[9804]: cluster 2021-03-10T20:05:20.356225+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:22.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:22 gibba004 bash[9777]: cluster 2021-03-10T20:05:20.356225+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:22 gibba004 bash[12967]: cluster 2021-03-10T20:05:20.356225+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.7 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:24.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:24 gibba009 bash[9804]: cluster 2021-03-10T20:05:22.357095+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:24.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:24 gibba004 bash[9777]: cluster 2021-03-10T20:05:22.357095+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:24 gibba004 bash[12967]: cluster 2021-03-10T20:05:22.357095+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:26.212 INFO:teuthology.orchestra.run.gibba009.stdout:Scheduled alertmanager update... 2021-03-10T20:05:26.218 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:26 gibba009 bash[9804]: cluster 2021-03-10T20:05:24.357891+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:26 gibba004 bash[9777]: cluster 2021-03-10T20:05:24.357891+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:26 gibba004 bash[12967]: cluster 2021-03-10T20:05:24.357891+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:27.113 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:27 gibba009 bash[9804]: audit 2021-03-10T20:05:26.202539+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:05:27.113 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:27 gibba009 bash[9804]: audit 2021-03-10T20:05:26.210893+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:05:27.115 DEBUG:teuthology.orchestra.run.gibba004:alertmanager.a> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@alertmanager.a.service 2021-03-10T20:05:27.117 INFO:tasks.cephadm:Adding grafana.a on gibba009 2021-03-10T20:05:27.118 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph orch apply grafana '1;gibba009=a' 2021-03-10T20:05:27.139 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:27.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:27 gibba004 bash[9777]: audit 2021-03-10T20:05:26.202539+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:05:27.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:27 gibba004 bash[9777]: audit 2021-03-10T20:05:26.210893+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:05:27.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:27 gibba004 bash[12967]: audit 2021-03-10T20:05:26.202539+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:05:27.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:27 gibba004 bash[12967]: audit 2021-03-10T20:05:26.210893+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:05:26.201561\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba004\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:05:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[9777]: audit 2021-03-10T20:05:26.200202+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba004=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[9777]: cephadm 2021-03-10T20:05:26.201523+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba004=a 2021-03-10T20:05:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[9777]: cluster 2021-03-10T20:05:26.358552+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:28.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[12967]: audit 2021-03-10T20:05:26.200202+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba004=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:28.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[12967]: cephadm 2021-03-10T20:05:26.201523+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba004=a 2021-03-10T20:05:28.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:28 gibba004 bash[12967]: cluster 2021-03-10T20:05:26.358552+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:28.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:28 gibba009 bash[9804]: audit 2021-03-10T20:05:26.200202+0000 mgr.y (mgr.14140) 165 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba004=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:28.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:28 gibba009 bash[9804]: cephadm 2021-03-10T20:05:26.201523+0000 mgr.y (mgr.14140) 166 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba004=a 2021-03-10T20:05:28.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:28 gibba009 bash[9804]: cluster 2021-03-10T20:05:26.358552+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:30.325 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:30 gibba009 docker[18481]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:05:30.325 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:30 gibba009 systemd[1]: Started Ceph prometheus.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:30.326 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:30 gibba009 bash[9804]: cluster 2021-03-10T20:05:28.359156+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:30.326 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:30 gibba009 bash[9804]: audit 2021-03-10T20:05:30.037724+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:30.327 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:30 gibba009 bash[9804]: audit 2021-03-10T20:05:30.040964+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:30.327 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:30 gibba009 bash[9804]: audit 2021-03-10T20:05:30.041692+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[9777]: cluster 2021-03-10T20:05:28.359156+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:30.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[12967]: cluster 2021-03-10T20:05:28.359156+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:30.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[9777]: audit 2021-03-10T20:05:30.037724+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:30.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[9777]: audit 2021-03-10T20:05:30.040964+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:30.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[9777]: audit 2021-03-10T20:05:30.041692+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:30.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[12967]: audit 2021-03-10T20:05:30.037724+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:30.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[12967]: audit 2021-03-10T20:05:30.040964+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680610\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.680880\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681051\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681210\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681363\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681513\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:10.681666\", \"created\": \"2021-03-10T20:05:09.369385\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:30.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:30 gibba004 bash[12967]: audit 2021-03-10T20:05:30.041692+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:31.296 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[9777]: audit 2021-03-10T20:05:30.926531+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:31.297 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[9777]: audit 2021-03-10T20:05:30.935434+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:31.297 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[9777]: audit 2021-03-10T20:05:30.937070+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:31.297 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[9777]: audit 2021-03-10T20:05:30.938102+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:31.298 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[12967]: audit 2021-03-10T20:05:30.926531+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:31.299 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[12967]: audit 2021-03-10T20:05:30.935434+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:31.299 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[12967]: audit 2021-03-10T20:05:30.937070+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:31.299 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[12967]: audit 2021-03-10T20:05:30.938102+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:31.388 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[9804]: audit 2021-03-10T20:05:30.926531+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:31.388 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[9804]: audit 2021-03-10T20:05:30.935434+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}}, \"last_daemon_update\": \"2021-03-10T20:05:30.923619\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:31.388 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[9804]: audit 2021-03-10T20:05:30.937070+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:31.389 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[9804]: audit 2021-03-10T20:05:30.938102+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:31.412 INFO:teuthology.orchestra.run.gibba009.stdout:Scheduled grafana update... 2021-03-10T20:05:31.563 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 systemd[1]: Started Ceph node-exporter.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:31.563 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T20:05:31.718 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T20:05:31.718 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T20:05:31.719 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T20:05:31.719 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba009 (none))" 2021-03-10T20:05:31.719 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T20:05:31.719 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.419Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T20:05:31.720 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.420Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T20:05:31.720 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.421Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T20:05:31.720 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.421Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T20:05:31.720 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.423Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T20:05:31.720 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.423Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.395µs 2021-03-10T20:05:31.721 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.423Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T20:05:31.721 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.423Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-03-10T20:05:31.721 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.423Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=11.857µs wal_replay_duration=181.099µs total_replay_duration=208.547µs 2021-03-10T20:05:31.721 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.424Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T20:05:31.722 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.424Z caller=main.go:802 msg="TSDB started" 2021-03-10T20:05:31.722 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.424Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T20:05:31.722 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.424Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=736.363µs remote_storage=727ns web_handler=128ns query_engine=432ns scrape=442.032µs scrape_sd=26.655µs notify=643ns notify_sd=1.814µs rules=25.603µs 2021-03-10T20:05:31.722 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18496]: level=info ts=2021-03-10T20:05:31.424Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T20:05:31.930 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: latest: Pulling from prom/node-exporter 2021-03-10T20:05:31.931 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: dc6dd4561653: Pulling fs layer 2021-03-10T20:05:31.931 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: 613f88646930: Pulling fs layer 2021-03-10T20:05:31.931 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: edad907fb257: Pulling fs layer 2021-03-10T20:05:31.931 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: 613f88646930: Verifying Checksum 2021-03-10T20:05:31.931 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: 613f88646930: Download complete 2021-03-10T20:05:31.932 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: dc6dd4561653: Verifying Checksum 2021-03-10T20:05:31.932 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: dc6dd4561653: Download complete 2021-03-10T20:05:31.932 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: edad907fb257: Verifying Checksum 2021-03-10T20:05:31.932 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: edad907fb257: Download complete 2021-03-10T20:05:31.932 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:31 gibba004 bash[19679]: dc6dd4561653: Pull complete 2021-03-10T20:05:31.996 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:31 gibba009 systemd[1]: Started Ceph node-exporter.b for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:31.997 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:31 gibba009 docker[18872]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-node-exporter.b 2021-03-10T20:05:31.997 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18890]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T20:05:31.997 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:31 gibba009 bash[18890]: latest: Pulling from prom/node-exporter 2021-03-10T20:05:32.164 DEBUG:teuthology.orchestra.run.gibba009:grafana.a> sudo journalctl -f -n 0 -u ceph-37a23cfe-81db-11eb-9080-001a4aab830c@grafana.a.service 2021-03-10T20:05:32.166 INFO:tasks.cephadm:Setting up client nodes... 2021-03-10T20:05:32.166 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T20:05:32.182 INFO:journalctl@ceph.grafana.a.gibba009.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:05:32.184 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: cluster 2021-03-10T20:05:30.359897+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:32.184 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: cephadm 2021-03-10T20:05:30.938824+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.a on gibba004 2021-03-10T20:05:32.184 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.324332+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:32.185 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: cluster 2021-03-10T20:05:30.359897+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:32.185 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: cephadm 2021-03-10T20:05:30.938824+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.a on gibba004 2021-03-10T20:05:32.186 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.327111+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:32.186 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.327742+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:32.187 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.328470+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:32.187 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.401643+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:05:32.187 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.409758+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:05:32.188 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.324332+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:32.188 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.754978+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:32.189 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[9777]: audit 2021-03-10T20:05:31.765134+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:32.189 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.327111+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:32.190 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.327742+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:32.190 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.328470+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:32.190 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.401643+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:05:32.190 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.409758+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:05:32.191 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.754978+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:32.191 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[12967]: audit 2021-03-10T20:05:31.765134+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:32.297 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: dc6dd4561653: Pulling fs layer 2021-03-10T20:05:32.297 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: 613f88646930: Pulling fs layer 2021-03-10T20:05:32.298 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: edad907fb257: Pulling fs layer 2021-03-10T20:05:32.298 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: 613f88646930: Download complete 2021-03-10T20:05:32.298 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: dc6dd4561653: Verifying Checksum 2021-03-10T20:05:32.299 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: dc6dd4561653: Download complete 2021-03-10T20:05:32.299 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: edad907fb257: Verifying Checksum 2021-03-10T20:05:32.299 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: edad907fb257: Download complete 2021-03-10T20:05:32.299 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: dc6dd4561653: Pull complete 2021-03-10T20:05:32.300 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: cluster 2021-03-10T20:05:30.359897+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:32.301 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: cephadm 2021-03-10T20:05:30.938824+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.a on gibba004 2021-03-10T20:05:32.301 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.324332+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:32.301 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.327111+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:32.302 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.327742+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:05:32.302 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.328470+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:32.302 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.401643+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:05:32.302 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.409758+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:05:31.400777\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba009\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:05:32.303 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.754978+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:32.303 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[9804]: audit 2021-03-10T20:05:31.765134+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922081\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922390\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922563\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922722\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.922878\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923030\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923182\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:30.923334\", \"created\": \"2021-03-10T20:05:30.021385\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:32.563 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:32 gibba004 bash[19679]: 613f88646930: Pull complete 2021-03-10T20:05:32.893 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: 613f88646930: Pull complete 2021-03-10T20:05:33.339 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: edad907fb257: Pull complete 2021-03-10T20:05:33.339 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:32 gibba009 bash[18890]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T20:05:33.339 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:33 gibba009 bash[18890]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T20:05:33.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:33 gibba009 bash[9804]: cephadm 2021-03-10T20:05:31.329016+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.b on gibba009 2021-03-10T20:05:33.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:33 gibba009 bash[9804]: audit 2021-03-10T20:05:31.399434+0000 mgr.y (mgr.14140) 172 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:33.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:33 gibba009 bash[9804]: cephadm 2021-03-10T20:05:31.400739+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Saving service grafana spec with placement count:1 gibba009=a 2021-03-10T20:05:33.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:33 gibba009 bash[9804]: cephadm 2021-03-10T20:05:31.768293+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon alertmanager.a on gibba004 2021-03-10T20:05:33.452 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[9777]: cephadm 2021-03-10T20:05:31.329016+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.b on gibba009 2021-03-10T20:05:33.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[9777]: audit 2021-03-10T20:05:31.399434+0000 mgr.y (mgr.14140) 172 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:33.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[9777]: cephadm 2021-03-10T20:05:31.400739+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Saving service grafana spec with placement count:1 gibba009=a 2021-03-10T20:05:33.453 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[9777]: cephadm 2021-03-10T20:05:31.768293+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon alertmanager.a on gibba004 2021-03-10T20:05:33.453 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[12967]: cephadm 2021-03-10T20:05:31.329016+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.b on gibba009 2021-03-10T20:05:33.454 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[12967]: audit 2021-03-10T20:05:31.399434+0000 mgr.y (mgr.14140) 172 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba009=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:33.454 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[12967]: cephadm 2021-03-10T20:05:31.400739+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Saving service grafana spec with placement count:1 gibba009=a 2021-03-10T20:05:33.454 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[12967]: cephadm 2021-03-10T20:05:31.768293+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon alertmanager.a on gibba004 2021-03-10T20:05:33.813 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[19679]: edad907fb257: Pull complete 2021-03-10T20:05:33.813 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[19679]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T20:05:34.313 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:33 gibba004 bash[19679]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T20:05:34.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[9777]: cluster 2021-03-10T20:05:32.360237+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:34.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[9777]: audit 2021-03-10T20:05:33.357098+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:05:34.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[9777]: audit 2021-03-10T20:05:33.363968+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:05:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[12967]: cluster 2021-03-10T20:05:32.360237+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[12967]: audit 2021-03-10T20:05:33.357098+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:05:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:34 gibba004 bash[12967]: audit 2021-03-10T20:05:33.363968+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:05:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[9804]: cluster 2021-03-10T20:05:32.360237+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[9804]: audit 2021-03-10T20:05:33.357098+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:05:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[9804]: audit 2021-03-10T20:05:33.363968+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"a905d61f-0d03-4bf1-8138-4202b03c275d\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406648.4685416, \"finished_at\": 1615406661.5796633}, {\"id\": \"da61feac-fa6c-4e18-807d-34e6081a9e1e\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406670.378847, \"finished_at\": 1615406683.0748737}, {\"id\": \"8452b080-056b-4759-9962-93ff8cffb70b\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406718.6151917, \"finished_at\": 1615406728.6260707}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:05:34.340 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.169Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T20:05:34.340 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.169Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T20:05:34.340 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.169Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T20:05:34.341 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.169Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T20:05:34.341 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T20:05:34.341 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=arp 2021-03-10T20:05:34.341 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=bcache 2021-03-10T20:05:34.342 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=bonding 2021-03-10T20:05:34.342 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T20:05:34.342 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T20:05:34.342 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=cpu 2021-03-10T20:05:34.343 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T20:05:34.344 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T20:05:34.344 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=edac 2021-03-10T20:05:34.344 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=entropy 2021-03-10T20:05:34.344 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T20:05:34.344 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=filefd 2021-03-10T20:05:34.345 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T20:05:34.345 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T20:05:34.345 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T20:05:34.345 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T20:05:34.346 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T20:05:34.346 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T20:05:34.346 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T20:05:34.346 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=netclass 2021-03-10T20:05:34.347 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=netdev 2021-03-10T20:05:34.347 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=netstat 2021-03-10T20:05:34.347 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=nfs 2021-03-10T20:05:34.347 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T20:05:34.348 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T20:05:34.348 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=pressure 2021-03-10T20:05:34.348 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=rapl 2021-03-10T20:05:34.348 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T20:05:34.348 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T20:05:34.349 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=softnet 2021-03-10T20:05:34.349 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=stat 2021-03-10T20:05:34.349 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=textfile 2021-03-10T20:05:34.349 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T20:05:34.350 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=time 2021-03-10T20:05:34.350 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T20:05:34.350 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=uname 2021-03-10T20:05:34.350 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T20:05:34.351 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=xfs 2021-03-10T20:05:34.351 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:113 collector=zfs 2021-03-10T20:05:34.351 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T20:05:34.352 INFO:journalctl@ceph.node-exporter.b.gibba009.stdout:Mar 10 20:05:34 gibba009 bash[18890]: level=info ts=2021-03-10T20:05:34.170Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T20:05:36.478 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[12967]: cluster 2021-03-10T20:05:34.360850+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:36.479 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[9777]: cluster 2021-03-10T20:05:34.360850+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:36.479 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T20:05:36.480 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T20:05:36.480 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T20:05:36.480 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T20:05:36.480 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T20:05:36.480 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=arp 2021-03-10T20:05:36.481 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=bcache 2021-03-10T20:05:36.481 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=bonding 2021-03-10T20:05:36.481 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T20:05:36.481 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T20:05:36.481 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=cpu 2021-03-10T20:05:36.482 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T20:05:36.482 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T20:05:36.482 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=edac 2021-03-10T20:05:36.483 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=entropy 2021-03-10T20:05:36.483 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T20:05:36.483 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=filefd 2021-03-10T20:05:36.483 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T20:05:36.483 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T20:05:36.484 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T20:05:36.484 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T20:05:36.484 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T20:05:36.485 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T20:05:36.485 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T20:05:36.485 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=netclass 2021-03-10T20:05:36.485 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=netdev 2021-03-10T20:05:36.486 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=netstat 2021-03-10T20:05:36.486 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=nfs 2021-03-10T20:05:36.486 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T20:05:36.486 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T20:05:36.486 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=pressure 2021-03-10T20:05:36.487 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=rapl 2021-03-10T20:05:36.487 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T20:05:36.487 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T20:05:36.487 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=softnet 2021-03-10T20:05:36.487 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=stat 2021-03-10T20:05:36.488 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=textfile 2021-03-10T20:05:36.488 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T20:05:36.488 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=time 2021-03-10T20:05:36.488 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T20:05:36.488 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=uname 2021-03-10T20:05:36.489 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.189Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T20:05:36.489 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.190Z caller=node_exporter.go:113 collector=xfs 2021-03-10T20:05:36.489 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.190Z caller=node_exporter.go:113 collector=zfs 2021-03-10T20:05:36.489 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.190Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T20:05:36.489 INFO:journalctl@ceph.node-exporter.a.gibba004.stdout:Mar 10 20:05:36 gibba004 bash[19679]: level=info ts=2021-03-10T20:05:36.190Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T20:05:36.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:36 gibba009 bash[9804]: cluster 2021-03-10T20:05:34.360850+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:05:37.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:37 gibba004 bash[9777]: cluster 2021-03-10T20:05:36.361228+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:37.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:37 gibba004 bash[12967]: cluster 2021-03-10T20:05:36.361228+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:37 gibba009 bash[9804]: cluster 2021-03-10T20:05:36.361228+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:38.454 INFO:teuthology.orchestra.run.gibba004.stdout:[client.0] 2021-03-10T20:05:38.455 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCSJklgXZTVGhAAoot5TsDbiNxyF7OyPdge5w== 2021-03-10T20:05:39.271 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-03-10T20:05:39.272 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-03-10T20:05:39.272 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-10T20:05:39.287 DEBUG:teuthology.orchestra.run.gibba009:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T20:05:39.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[9777]: cluster 2021-03-10T20:05:38.361456+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:39.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[9777]: audit 2021-03-10T20:05:38.450114+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:39.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[9777]: audit 2021-03-10T20:05:38.454188+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:39.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[12967]: cluster 2021-03-10T20:05:38.361456+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:39.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[12967]: audit 2021-03-10T20:05:38.450114+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:39.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:39 gibba004 bash[12967]: audit 2021-03-10T20:05:38.454188+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:39.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:39 gibba009 bash[9804]: cluster 2021-03-10T20:05:38.361456+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:39.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:39 gibba009 bash[9804]: audit 2021-03-10T20:05:38.450114+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:39.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:39 gibba009 bash[9804]: audit 2021-03-10T20:05:38.454188+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.2.104:0/606424288' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:41.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:41 gibba004 bash[9777]: cluster 2021-03-10T20:05:40.362060+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:41.590 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:41 gibba004 bash[12967]: cluster 2021-03-10T20:05:40.362060+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:41.725 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:41 gibba009 bash[9804]: cluster 2021-03-10T20:05:40.362060+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:41.953 INFO:teuthology.orchestra.run.gibba009.stdout:[client.1] 2021-03-10T20:05:41.954 INFO:teuthology.orchestra.run.gibba009.stdout: key = AQCVJklg2waPOBAA1UrY+I2XclJgUsgq2XL0nA== 2021-03-10T20:05:42.062 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:41 gibba004 docker[20283]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:05:42.063 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:41 gibba004 systemd[1]: Started Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:42.548 DEBUG:teuthology.orchestra.run.gibba009:> set -ex 2021-03-10T20:05:42.549 DEBUG:teuthology.orchestra.run.gibba009:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-03-10T20:05:42.549 DEBUG:teuthology.orchestra.run.gibba009:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-10T20:05:42.559 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:05:42.660 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.611Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:05:42.660 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.611Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:05:42.661 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.612Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.104 port=9094 2021-03-10T20:05:42.661 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.613Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:05:42.661 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.629Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:05:42.661 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.629Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:05:42.662 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:42.631Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:05:42.663 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.619839+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:42.663 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.623606+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:42.663 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.624213+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:42.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.946950+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.2.109:0/4170873247' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.948805+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.664 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[9777]: audit 2021-03-10T20:05:41.952390+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:42.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.619839+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:42.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.623606+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:42.665 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.624213+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:42.666 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.946950+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.2.109:0/4170873247' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.666 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.948805+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.666 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:42 gibba004 bash[12967]: audit 2021-03-10T20:05:41.952390+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:42.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.619839+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:42.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.623606+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918353\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918412\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918442\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918470\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918497\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918523\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:41.918550\", \"created\": \"2021-03-10T20:03:41.346689\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:42.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.624213+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:42.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.946950+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.2.109:0/4170873247' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.948805+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:05:42.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:42 gibba009 bash[9804]: audit 2021-03-10T20:05:41.952390+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:05:44.250 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: cluster 2021-03-10T20:05:42.362801+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:44.251 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: cluster 2021-03-10T20:05:42.362801+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:44.251 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.017019+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:44.252 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.017019+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:44.252 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.020617+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:44.253 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.021159+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:44.253 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.020617+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:44.254 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.021159+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:44.254 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.877460+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:44.255 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.877460+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:44.255 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.880350+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:44.256 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[9777]: audit 2021-03-10T20:05:43.952591+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:05:44.256 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.880350+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:44.257 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:43 gibba004 bash[12967]: audit 2021-03-10T20:05:43.952591+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:05:44.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: cluster 2021-03-10T20:05:42.362801+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.017019+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.020617+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016101\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016160\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016190\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016218\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016245\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016271\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016297\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016323\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.016349\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.016409\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.021159+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:44.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.877460+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:44.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.880350+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}}, \"last_daemon_update\": \"2021-03-10T20:05:43.876336\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:44.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:43 gibba009 bash[9804]: audit 2021-03-10T20:05:43.952591+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:05:44.970 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:44.613Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00017655s 2021-03-10T20:05:45.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[12967]: audit 2021-03-10T20:05:43.956341+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:05:45.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[12967]: audit 2021-03-10T20:05:43.957115+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:05:45.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[12967]: audit 2021-03-10T20:05:43.966796+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:05:45.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[12967]: cephadm 2021-03-10T20:05:43.967177+0000 mgr.y (mgr.14140) 181 : cephadm [INF] Deploying daemon grafana.a on gibba009 2021-03-10T20:05:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[9777]: audit 2021-03-10T20:05:43.956341+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:05:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[9777]: audit 2021-03-10T20:05:43.957115+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:05:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[9777]: audit 2021-03-10T20:05:43.966796+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:05:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:44 gibba004 bash[9777]: cephadm 2021-03-10T20:05:43.967177+0000 mgr.y (mgr.14140) 181 : cephadm [INF] Deploying daemon grafana.a on gibba009 2021-03-10T20:05:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:44 gibba009 bash[9804]: audit 2021-03-10T20:05:43.956341+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEAvzZKiZrUaiszYSp5ZEmKkwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yMTAzMTAyMDA1NDNaFw0z\nMTAzMDgyMDA1NDNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDF2FnQoka8gaRgTnRI0vrq\n7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4xAZmc6bY+\nI7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1rz2MCorrI\nLwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY150Ux0W3o\nKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpyVcJKi6yV\nhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGMeotBooKH\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAB4EMXSMBf6mPeiyLcKXNPktD4daXaDb\np/LpS7Yn5AcMm3rOIopHVAWEblcYf+mPGsjIW6b3EaZtXpcJxes3Xy96/wpON1B1\nselQibdmYp2xCL4L5qNjvHT1Kp9TPnhgS3YIEiie659dFTZynrintP137iEMxFYO\nR73faytO8G13aHahPftXk/6m4cTgF6erjJWYZaoFx0LbJeKt+vKqZ1ggtrw398SH\n6v1EA5OVtMUkucJdS/GEx9KqTgwEWL8G7yj/XrBbwGIvEm5CW7WpzIdAQlW/VQ8Z\nB2nElC9owyumpwuk7alXyo4QiKHrioPgO6DeAZSVw1ZfVf1ibSBsu0c=\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:05:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:44 gibba009 bash[9804]: audit 2021-03-10T20:05:43.957115+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:05:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:44 gibba009 bash[9804]: audit 2021-03-10T20:05:43.966796+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDF2FnQoka8gaRg\nTnRI0vrq7hpeIGfkWyo79UJ16ozO6ydUzPjowQwt8lDHeZdwz6lwN0XDp+Me6Z4x\nAZmc6bY+I7JmHqd4LcibWxPrR32sH+RQ8IuaHOA1oBY3rg0jNUjKVnZNU1gsBu1r\nz2MCorrILwsFUKuRRUaDgdN9CAkC1OWUX5P9A2QqQFf1iVzEu5dZ0fdkuvC/kXY1\n50Ux0W3oKM3800r8Ulbz2S1xK2yn5LDwLmQQ9pIp1Rz2x5axG4Oc5GP5edl/kjpy\nVcJKi6yVhgWI3S1y1LyXfW5vY5hkTH4HcZdc7q6O9jWBCRvX7gR/7WmKDVVqPJGM\neotBooKHAgMBAAECggEAP/gSIjk18eFhCpqTUrCU3L0b3W9Q6C7p2vUUBhhOauDx\nmKOln2w7yeddYwHXi2w5dsUIU5jHAMm8kk/YIToX6MOV/RrQPzVedYzfReWZprux\nENKV8MCBZhVa2an3KXkjDfkiyyG1kpay0Xb+pm2DQxKi15cbwh7KC99ASF7+uuEV\nfmT6870T/ovut9EefJTbArtK2+AV6yzFyE9w7iUFbY7/Ot1K9vIni9h/4AW3cbT7\nf12K0d4wTMSx+TxJ3G1IvqNylRgIV81porv+Ap9LBM82Q8IQu1Hwl7zRXYDiLfdh\nOn1ZSRa07QRGmZ4fagQ6JPqWcZ1PsAkEXfHo4EAbAQKBgQDvyikD8GekJtzJqd06\nGBncQDhbWAqEToHeYyRprklimbR67SmV3qRWk+zQKGaCgQ6oNbU3J3Zx1cEAMLU7\n/p0fmhzA090argQBIPr14e+TmQC8ySB5U75+fsT2JsPLZZP7oXQiAt97zxKWegUv\nVB8sV6cJeO7kmj/uwFAVhi1AwQKBgQDTOEqBKBSjMS1qu03sPX4xZ1/8wd8C1kTD\nRzuneR434QScyDuT3Zyfb3WJkUkKcIaroHAcwS9+mSu79MALSoiSsYUByMXswNBj\nHerkx/BIlcFjGS6fhLSgtPxN7FhhdlqTbzaOhg8gJd0me5cDAiIOubktcb8/3hCj\nMlhVkfvNRwKBgFfgzNtGtZTxMSUu/YaW4pNXbc/8Gg6W/v1TdDrOxtI95mjOldj4\n+V1JZRZ8V+UoCwkWdc06xyu83LiHIURVcZvtTPBWNMfcUldfkNmf7b836Y9GXoJY\ncI3HQ8O6PTNDjNJBP2BfkSu8neFL4q6Ps8T6cpsEGPjqlteW30KkI92BAoGAG3Pn\nix3wgL11j7fEiv37FuS+vxVbrPy4d0Ec6cl+OfkPJmmIBNH692X/OuAdRDQX7Nqv\nd61MRQIXgxhulYkccySLiw3TW9A7xYYv74hlHKoKNp0hSC5xY6niWSZs3k4Ju7vq\ntV+LO7xwH/5URFnUn2FYRiXQm7Z7Jxr2DDkrJyUCgYBNISTctTUch/H9xCQz2UbB\nokdIjGQUWbCoeS+73hxvXmXoxueVcB6J2RU0DzdocWNCIb/QgnrIFHJBnXb+GzWr\nx6zDJIrTo4g8GHicYInuIcxLj/iWfCYqbiVQ2E53nrCftysiUX1FMeV+HwFYUTE7\n9kNuJ4C2XFJ3dLL2pVX8CQ==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:05:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:44 gibba009 bash[9804]: cephadm 2021-03-10T20:05:43.967177+0000 mgr.y (mgr.14140) 181 : cephadm [INF] Deploying daemon grafana.a on gibba009 2021-03-10T20:05:45.366 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:05:45.367 INFO:teuthology.orchestra.run.gibba004.stdout:{"epoch":52,"fsid":"37a23cfe-81db-11eb-9080-001a4aab830c","created":"2021-03-10T20:00:35.875030+0000","modified":"2021-03-10T20:05:19.620319+0000","last_up_change":"2021-03-10T20:05:18.603804+0000","last_in_change":"2021-03-10T20:05:18.603804+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T20:00:46.238874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"5fa3f778-fb57-4629-9998-3af3a89cf491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6802","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6803","nonce":4027763850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6805","nonce":4027763850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6809","nonce":4027763850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6806","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6807","nonce":4027763850}]},"public_addr":"172.21.2.104:6803/4027763850","cluster_addr":"172.21.2.104:6805/4027763850","heartbeat_back_addr":"172.21.2.104:6809/4027763850","heartbeat_front_addr":"172.21.2.104:6807/4027763850","state":["exists","up"]},{"osd":1,"uuid":"5615c721-c970-4d6c-9e75-6cfca4c38bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6810","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6811","nonce":1691648837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6813","nonce":1691648837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6817","nonce":1691648837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6814","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6815","nonce":1691648837}]},"public_addr":"172.21.2.104:6811/1691648837","cluster_addr":"172.21.2.104:6813/1691648837","heartbeat_back_addr":"172.21.2.104:6817/1691648837","heartbeat_front_addr":"172.21.2.104:6815/1691648837","state":["exists","up"]},{"osd":2,"uuid":"d2fcc45a-ea77-4424-82b2-630e2c9a2e90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6819","nonce":1243320170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6821","nonce":1243320170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6825","nonce":1243320170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6823","nonce":1243320170}]},"public_addr":"172.21.2.104:6819/1243320170","cluster_addr":"172.21.2.104:6821/1243320170","heartbeat_back_addr":"172.21.2.104:6825/1243320170","heartbeat_front_addr":"172.21.2.104:6823/1243320170","state":["exists","up"]},{"osd":3,"uuid":"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6827","nonce":3361048577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6829","nonce":3361048577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6833","nonce":3361048577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6831","nonce":3361048577}]},"public_addr":"172.21.2.104:6827/3361048577","cluster_addr":"172.21.2.104:6829/3361048577","heartbeat_back_addr":"172.21.2.104:6833/3361048577","heartbeat_front_addr":"172.21.2.104:6831/3361048577","state":["exists","up"]},{"osd":4,"uuid":"aab97246-8453-48ec-94b9-b3cd470e8671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6800","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6801","nonce":684070120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6802","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6803","nonce":684070120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6806","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6807","nonce":684070120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6804","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6805","nonce":684070120}]},"public_addr":"172.21.2.109:6801/684070120","cluster_addr":"172.21.2.109:6803/684070120","heartbeat_back_addr":"172.21.2.109:6807/684070120","heartbeat_front_addr":"172.21.2.109:6805/684070120","state":["exists","up"]},{"osd":5,"uuid":"3eea2b0c-0b1d-4976-8a42-a73218a8175b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6808","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6809","nonce":4017087340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6810","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6811","nonce":4017087340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6814","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6815","nonce":4017087340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6812","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6813","nonce":4017087340}]},"public_addr":"172.21.2.109:6809/4017087340","cluster_addr":"172.21.2.109:6811/4017087340","heartbeat_back_addr":"172.21.2.109:6815/4017087340","heartbeat_front_addr":"172.21.2.109:6813/4017087340","state":["exists","up"]},{"osd":6,"uuid":"cefd4740-1a5b-4325-96e2-cdbae970ab52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":42,"last_clean_end":44,"up_from":47,"up_thru":47,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6816","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6817","nonce":1264601222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6818","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6819","nonce":1264601222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6822","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6823","nonce":1264601222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6820","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6821","nonce":1264601222}]},"public_addr":"172.21.2.109:6817/1264601222","cluster_addr":"172.21.2.109:6819/1264601222","heartbeat_back_addr":"172.21.2.109:6823/1264601222","heartbeat_front_addr":"172.21.2.109:6821/1264601222","state":["exists","up"]},{"osd":7,"uuid":"f7402873-089f-44c1-b2ae-5feb0f0f7673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6824","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6825","nonce":1248843023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6826","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6827","nonce":1248843023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6830","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6831","nonce":1248843023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6828","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6829","nonce":1248843023}]},"public_addr":"172.21.2.109:6825/1248843023","cluster_addr":"172.21.2.109:6827/1248843023","heartbeat_back_addr":"172.21.2.109:6831/1248843023","heartbeat_front_addr":"172.21.2.109:6829/1248843023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:40.964606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:04.000951+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:26.009720+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:48.264352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:07.018473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:28.381238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:50.490362+0000","dead_epoch":45},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:05:17.319034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.104:0/1354718829":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/4047249746":"2021-03-11T20:01:07.881988+0000","172.21.2.104:6800/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/111304768":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/2575069528":"2021-03-11T20:00:53.459351+0000","172.21.2.104:0/2571685211":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/460307678":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6800/1513196736":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/1513196736":"2021-03-11T20:00:53.459351+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:05:46.030 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-10T20:00:46.238874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-03-10T20:05:46.031 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-03-10T20:05:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:45 gibba004 bash[9777]: cluster 2021-03-10T20:05:44.363649+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:45 gibba004 bash[9777]: audit 2021-03-10T20:05:45.363559+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.104:0/186907610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:46.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:45 gibba004 bash[12967]: cluster 2021-03-10T20:05:44.363649+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:46.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:45 gibba004 bash[12967]: audit 2021-03-10T20:05:45.363559+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.104:0/186907610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:45 gibba009 bash[9804]: cluster 2021-03-10T20:05:44.363649+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:45 gibba009 bash[9804]: audit 2021-03-10T20:05:45.363559+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.104:0/186907610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:47.714 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:47 gibba009 bash[9804]: cluster 2021-03-10T20:05:46.364329+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:47.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:47 gibba004 bash[9777]: cluster 2021-03-10T20:05:46.364329+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:47 gibba004 bash[12967]: cluster 2021-03-10T20:05:46.364329+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:48.849 INFO:teuthology.orchestra.run.gibba004.stdout:pg_num: 1 2021-03-10T20:05:49.433 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-10T20:05:49.434 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-03-10T20:05:49.435 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph mgr dump --format=json 2021-03-10T20:05:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:49 gibba004 bash[9777]: cluster 2021-03-10T20:05:48.364794+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:49 gibba004 bash[9777]: audit 2021-03-10T20:05:48.848422+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.104:0/2533508689' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:05:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:49 gibba004 bash[12967]: cluster 2021-03-10T20:05:48.364794+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:49 gibba004 bash[12967]: audit 2021-03-10T20:05:48.848422+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.104:0/2533508689' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:05:49.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:49 gibba009 bash[9804]: cluster 2021-03-10T20:05:48.364794+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:49.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:49 gibba009 bash[9804]: audit 2021-03-10T20:05:48.848422+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.104:0/2533508689' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:05:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:51 gibba004 bash[9777]: cluster 2021-03-10T20:05:50.365411+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:51.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:51 gibba004 bash[12967]: cluster 2021-03-10T20:05:50.365411+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:51.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:51 gibba009 bash[9804]: cluster 2021-03-10T20:05:50.365411+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:52.138 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:05:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:52 gibba004 bash[9777]: audit 2021-03-10T20:05:52.132440+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.2.104:0/2105691702' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:05:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:52 gibba004 bash[12967]: audit 2021-03-10T20:05:52.132440+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.2.104:0/2105691702' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:05:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:52 gibba009 bash[9804]: audit 2021-03-10T20:05:52.132440+0000 mon.a (mon.0) 555 : audit [DBG] from='client.? 172.21.2.104:0/2105691702' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:05:52.813 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:05:52 gibba004 bash[20300]: level=info ts=2021-03-10T20:05:52.614Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001207608s 2021-03-10T20:05:52.841 INFO:teuthology.orchestra.run.gibba004.stdout:{"epoch":15,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":403003256},{"type":"v1","addr":"172.21.2.104:6801","nonce":403003256}]},"active_addr":"172.21.2.104:6801/403003256","active_change":"2021-03-10T20:01:07.882435+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34115,"name":"gibba009.xiladd","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba004:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.104:0","nonce":1972490731}]},{"addrvec":[{"type":"v2","addr":"172.21.2.104:0","nonce":3666991501}]},{"addrvec":[{"type":"v2","addr":"172.21.2.104:0","nonce":2281051986}]}]}} 2021-03-10T20:05:52.850 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-03-10T20:05:52.851 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-03-10T20:05:52.852 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:05:53.745 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:53 gibba009 bash[9804]: cluster 2021-03-10T20:05:52.365755+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:53.746 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:53 gibba004 bash[9777]: cluster 2021-03-10T20:05:52.365755+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:53.747 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:53 gibba004 bash[12967]: cluster 2021-03-10T20:05:52.365755+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:54.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:54 gibba009 docker[19709]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-grafana.a 2021-03-10T20:05:54.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:54 gibba009 systemd[1]: Started Ceph grafana.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:05:55.474 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: cluster 2021-03-10T20:05:54.366431+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:55.475 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2021-03-10T20:05:55.475 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-03-10T20:05:55.475 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-03-10T20:05:55.475 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-03-10T20:05:55.476 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-03-10T20:05:55.476 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-03-10T20:05:55.476 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-03-10T20:05:55.476 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-03-10T20:05:55.477 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-03-10T20:05:55.477 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-03-10T20:05:55.477 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-03-10T20:05:55.477 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-03-10T20:05:55.477 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="App mode production" logger=settings 2021-03-10T20:05:55.478 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-03-10T20:05:55.478 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-03-10T20:05:55.478 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-03-10T20:05:55.479 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-03-10T20:05:55.480 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-03-10T20:05:55.480 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-03-10T20:05:55.480 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-03-10T20:05:55.481 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:54.415489+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:55.482 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:54.417887+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:55.482 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:54.418554+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.482 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:55.155517+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:55.482 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:55.159383+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:55.483 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[9804]: audit 2021-03-10T20:05:55.159895+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.521 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:05:55.521 INFO:teuthology.orchestra.run.gibba004.stdout:{"epoch":52,"fsid":"37a23cfe-81db-11eb-9080-001a4aab830c","created":"2021-03-10T20:00:35.875030+0000","modified":"2021-03-10T20:05:19.620319+0000","last_up_change":"2021-03-10T20:05:18.603804+0000","last_in_change":"2021-03-10T20:05:18.603804+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T20:00:46.238874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"5fa3f778-fb57-4629-9998-3af3a89cf491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6802","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6803","nonce":4027763850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6805","nonce":4027763850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6809","nonce":4027763850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6806","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6807","nonce":4027763850}]},"public_addr":"172.21.2.104:6803/4027763850","cluster_addr":"172.21.2.104:6805/4027763850","heartbeat_back_addr":"172.21.2.104:6809/4027763850","heartbeat_front_addr":"172.21.2.104:6807/4027763850","state":["exists","up"]},{"osd":1,"uuid":"5615c721-c970-4d6c-9e75-6cfca4c38bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6810","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6811","nonce":1691648837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6813","nonce":1691648837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6817","nonce":1691648837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6814","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6815","nonce":1691648837}]},"public_addr":"172.21.2.104:6811/1691648837","cluster_addr":"172.21.2.104:6813/1691648837","heartbeat_back_addr":"172.21.2.104:6817/1691648837","heartbeat_front_addr":"172.21.2.104:6815/1691648837","state":["exists","up"]},{"osd":2,"uuid":"d2fcc45a-ea77-4424-82b2-630e2c9a2e90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6819","nonce":1243320170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6821","nonce":1243320170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6825","nonce":1243320170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6823","nonce":1243320170}]},"public_addr":"172.21.2.104:6819/1243320170","cluster_addr":"172.21.2.104:6821/1243320170","heartbeat_back_addr":"172.21.2.104:6825/1243320170","heartbeat_front_addr":"172.21.2.104:6823/1243320170","state":["exists","up"]},{"osd":3,"uuid":"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6827","nonce":3361048577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6829","nonce":3361048577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6833","nonce":3361048577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6831","nonce":3361048577}]},"public_addr":"172.21.2.104:6827/3361048577","cluster_addr":"172.21.2.104:6829/3361048577","heartbeat_back_addr":"172.21.2.104:6833/3361048577","heartbeat_front_addr":"172.21.2.104:6831/3361048577","state":["exists","up"]},{"osd":4,"uuid":"aab97246-8453-48ec-94b9-b3cd470e8671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6800","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6801","nonce":684070120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6802","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6803","nonce":684070120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6806","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6807","nonce":684070120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6804","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6805","nonce":684070120}]},"public_addr":"172.21.2.109:6801/684070120","cluster_addr":"172.21.2.109:6803/684070120","heartbeat_back_addr":"172.21.2.109:6807/684070120","heartbeat_front_addr":"172.21.2.109:6805/684070120","state":["exists","up"]},{"osd":5,"uuid":"3eea2b0c-0b1d-4976-8a42-a73218a8175b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6808","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6809","nonce":4017087340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6810","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6811","nonce":4017087340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6814","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6815","nonce":4017087340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6812","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6813","nonce":4017087340}]},"public_addr":"172.21.2.109:6809/4017087340","cluster_addr":"172.21.2.109:6811/4017087340","heartbeat_back_addr":"172.21.2.109:6815/4017087340","heartbeat_front_addr":"172.21.2.109:6813/4017087340","state":["exists","up"]},{"osd":6,"uuid":"cefd4740-1a5b-4325-96e2-cdbae970ab52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":42,"last_clean_end":44,"up_from":47,"up_thru":47,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6816","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6817","nonce":1264601222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6818","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6819","nonce":1264601222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6822","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6823","nonce":1264601222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6820","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6821","nonce":1264601222}]},"public_addr":"172.21.2.109:6817/1264601222","cluster_addr":"172.21.2.109:6819/1264601222","heartbeat_back_addr":"172.21.2.109:6823/1264601222","heartbeat_front_addr":"172.21.2.109:6821/1264601222","state":["exists","up"]},{"osd":7,"uuid":"f7402873-089f-44c1-b2ae-5feb0f0f7673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6824","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6825","nonce":1248843023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6826","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6827","nonce":1248843023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6830","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6831","nonce":1248843023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6828","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6829","nonce":1248843023}]},"public_addr":"172.21.2.109:6825/1248843023","cluster_addr":"172.21.2.109:6827/1248843023","heartbeat_back_addr":"172.21.2.109:6831/1248843023","heartbeat_front_addr":"172.21.2.109:6829/1248843023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:40.964606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:04.000951+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:26.009720+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:48.264352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:07.018473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:28.381238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:50.490362+0000","dead_epoch":45},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:05:17.319034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.104:0/1354718829":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/4047249746":"2021-03-11T20:01:07.881988+0000","172.21.2.104:6800/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/111304768":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/2575069528":"2021-03-11T20:00:53.459351+0000","172.21.2.104:0/2571685211":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/460307678":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6800/1513196736":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/1513196736":"2021-03-11T20:00:53.459351+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:05:55.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: cluster 2021-03-10T20:05:54.366431+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:55.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: cluster 2021-03-10T20:05:54.366431+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:55.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:54.415489+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:55.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:54.415489+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:55.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:54.417887+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:55.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:54.418554+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:54.417887+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874642\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.874910\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875080\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875241\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875397\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875550\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875703\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.875853\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:43.876005\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:55.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:54.418554+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:55.155517+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:55.159383+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[9777]: audit 2021-03-10T20:05:55.159895+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:55.155517+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:05:55.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:55.159383+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"296090a7ff82\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154808\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:05:41.633408\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.765653\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.154871\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:05:55.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:55 gibba004 bash[12967]: audit 2021-03-10T20:05:55.159895+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:55.734 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-03-10T20:05:55.734 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-03-10T20:05:55.735 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-03-10T20:05:55.735 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-03-10T20:05:56.019 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-03-10T20:05:56.020 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-03-10T20:05:56.020 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T20:05:56.020 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:55 gibba009 bash[19725]: t=2021-03-10T20:05:55+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-03-10T20:05:56.305 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-03-10T20:05:56.306 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-03-10T20:05:56.306 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-03-10T20:05:56.306 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-03-10T20:05:56.307 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-03-10T20:05:56.441 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-03-10T20:05:56.442 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:05:56.589 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-03-10T20:05:56.589 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-03-10T20:05:56.590 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-03-10T20:05:56.590 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-03-10T20:05:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[9804]: audit 2021-03-10T20:05:55.519884+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.104:0/2833570952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[9804]: audit 2021-03-10T20:05:55.986662+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[9804]: audit 2021-03-10T20:05:55.990171+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[9804]: cephadm 2021-03-10T20:05:55.991588+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:05:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[9804]: cephadm 2021-03-10T20:05:55.993421+0000 mgr.y (mgr.14140) 189 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:05:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[9777]: audit 2021-03-10T20:05:55.519884+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.104:0/2833570952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[12967]: audit 2021-03-10T20:05:55.519884+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.2.104:0/2833570952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:05:56.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[9777]: audit 2021-03-10T20:05:55.986662+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:56.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[9777]: audit 2021-03-10T20:05:55.990171+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:56.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[9777]: cephadm 2021-03-10T20:05:55.991588+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:05:56.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[9777]: cephadm 2021-03-10T20:05:55.993421+0000 mgr.y (mgr.14140) 189 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:05:56.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[12967]: audit 2021-03-10T20:05:55.986662+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:05:56.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[12967]: audit 2021-03-10T20:05:55.990171+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"ac72d1c82bc6\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985272\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:05:30.048024\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:05:16.909396\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:05:55.985897\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:05:56.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[12967]: cephadm 2021-03-10T20:05:55.991588+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:05:56.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:56 gibba004 bash[12967]: cephadm 2021-03-10T20:05:55.993421+0000 mgr.y (mgr.14140) 189 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:05:56.910 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-03-10T20:05:56.910 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-03-10T20:05:56.910 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-03-10T20:05:56.911 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-03-10T20:05:56.911 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-03-10T20:05:56.911 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-03-10T20:05:57.161 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:56 gibba009 bash[19725]: t=2021-03-10T20:05:56+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-03-10T20:05:57.161 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-03-10T20:05:57.423 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-03-10T20:05:57.424 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-03-10T20:05:57.424 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-03-10T20:05:57.424 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-03-10T20:05:57.747 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[9804]: cluster 2021-03-10T20:05:56.367080+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:57.747 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-03-10T20:05:57.748 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-03-10T20:05:57.748 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-03-10T20:05:57.782 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:57 gibba004 bash[9777]: cluster 2021-03-10T20:05:56.367080+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:57.782 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:57 gibba004 bash[12967]: cluster 2021-03-10T20:05:56.367080+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:58.049 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-03-10T20:05:58.049 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-03-10T20:05:58.049 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-03-10T20:05:58.049 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:57 gibba009 bash[19725]: t=2021-03-10T20:05:57+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-03-10T20:05:58.050 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-03-10T20:05:58.300 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-03-10T20:05:58.301 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-03-10T20:05:58.301 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-03-10T20:05:58.301 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-03-10T20:05:58.552 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-03-10T20:05:58.552 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-03-10T20:05:58.836 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-03-10T20:05:58.837 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-03-10T20:05:58.837 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-03-10T20:05:58.837 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-03-10T20:05:58.837 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-03-10T20:05:59.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-03-10T20:05:59.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:58 gibba009 bash[19725]: t=2021-03-10T20:05:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-03-10T20:05:59.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-03-10T20:05:59.422 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-03-10T20:05:59.423 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-03-10T20:05:59.423 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-03-10T20:05:59.423 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-03-10T20:05:59.424 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-03-10T20:05:59.740 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[9804]: cluster 2021-03-10T20:05:58.367743+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:59.741 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-03-10T20:05:59.741 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-03-10T20:05:59.742 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-03-10T20:05:59.742 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-03-10T20:05:59.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:05:59 gibba004 bash[9777]: cluster 2021-03-10T20:05:58.367743+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:05:59 gibba004 bash[12967]: cluster 2021-03-10T20:05:58.367743+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:00.009 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-03-10T20:06:00.010 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-03-10T20:06:00.010 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-03-10T20:06:00.010 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:05:59 gibba009 bash[19725]: t=2021-03-10T20:05:59+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-03-10T20:06:00.278 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-03-10T20:06:00.279 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-03-10T20:06:00.279 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-03-10T20:06:00.572 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-03-10T20:06:00.572 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-03-10T20:06:00.572 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-03-10T20:06:00.573 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-03-10T20:06:00.831 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-03-10T20:06:00.831 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-03-10T20:06:00.832 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-03-10T20:06:00.832 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-03-10T20:06:00.961 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:06:00.962 INFO:teuthology.orchestra.run.gibba004.stdout:{"epoch":52,"fsid":"37a23cfe-81db-11eb-9080-001a4aab830c","created":"2021-03-10T20:00:35.875030+0000","modified":"2021-03-10T20:05:19.620319+0000","last_up_change":"2021-03-10T20:05:18.603804+0000","last_in_change":"2021-03-10T20:05:18.603804+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T20:00:46.238874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"5fa3f778-fb57-4629-9998-3af3a89cf491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6802","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6803","nonce":4027763850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6805","nonce":4027763850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6809","nonce":4027763850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6806","nonce":4027763850},{"type":"v1","addr":"172.21.2.104:6807","nonce":4027763850}]},"public_addr":"172.21.2.104:6803/4027763850","cluster_addr":"172.21.2.104:6805/4027763850","heartbeat_back_addr":"172.21.2.104:6809/4027763850","heartbeat_front_addr":"172.21.2.104:6807/4027763850","state":["exists","up"]},{"osd":1,"uuid":"5615c721-c970-4d6c-9e75-6cfca4c38bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6810","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6811","nonce":1691648837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6813","nonce":1691648837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6817","nonce":1691648837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6814","nonce":1691648837},{"type":"v1","addr":"172.21.2.104:6815","nonce":1691648837}]},"public_addr":"172.21.2.104:6811/1691648837","cluster_addr":"172.21.2.104:6813/1691648837","heartbeat_back_addr":"172.21.2.104:6817/1691648837","heartbeat_front_addr":"172.21.2.104:6815/1691648837","state":["exists","up"]},{"osd":2,"uuid":"d2fcc45a-ea77-4424-82b2-630e2c9a2e90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6819","nonce":1243320170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6821","nonce":1243320170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6825","nonce":1243320170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":1243320170},{"type":"v1","addr":"172.21.2.104:6823","nonce":1243320170}]},"public_addr":"172.21.2.104:6819/1243320170","cluster_addr":"172.21.2.104:6821/1243320170","heartbeat_back_addr":"172.21.2.104:6825/1243320170","heartbeat_front_addr":"172.21.2.104:6823/1243320170","state":["exists","up"]},{"osd":3,"uuid":"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6827","nonce":3361048577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6829","nonce":3361048577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6833","nonce":3361048577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":3361048577},{"type":"v1","addr":"172.21.2.104:6831","nonce":3361048577}]},"public_addr":"172.21.2.104:6827/3361048577","cluster_addr":"172.21.2.104:6829/3361048577","heartbeat_back_addr":"172.21.2.104:6833/3361048577","heartbeat_front_addr":"172.21.2.104:6831/3361048577","state":["exists","up"]},{"osd":4,"uuid":"aab97246-8453-48ec-94b9-b3cd470e8671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6800","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6801","nonce":684070120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6802","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6803","nonce":684070120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6806","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6807","nonce":684070120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6804","nonce":684070120},{"type":"v1","addr":"172.21.2.109:6805","nonce":684070120}]},"public_addr":"172.21.2.109:6801/684070120","cluster_addr":"172.21.2.109:6803/684070120","heartbeat_back_addr":"172.21.2.109:6807/684070120","heartbeat_front_addr":"172.21.2.109:6805/684070120","state":["exists","up"]},{"osd":5,"uuid":"3eea2b0c-0b1d-4976-8a42-a73218a8175b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6808","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6809","nonce":4017087340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6810","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6811","nonce":4017087340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6814","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6815","nonce":4017087340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6812","nonce":4017087340},{"type":"v1","addr":"172.21.2.109:6813","nonce":4017087340}]},"public_addr":"172.21.2.109:6809/4017087340","cluster_addr":"172.21.2.109:6811/4017087340","heartbeat_back_addr":"172.21.2.109:6815/4017087340","heartbeat_front_addr":"172.21.2.109:6813/4017087340","state":["exists","up"]},{"osd":6,"uuid":"cefd4740-1a5b-4325-96e2-cdbae970ab52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":42,"last_clean_end":44,"up_from":47,"up_thru":47,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6816","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6817","nonce":1264601222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6818","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6819","nonce":1264601222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6822","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6823","nonce":1264601222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6820","nonce":1264601222},{"type":"v1","addr":"172.21.2.109:6821","nonce":1264601222}]},"public_addr":"172.21.2.109:6817/1264601222","cluster_addr":"172.21.2.109:6819/1264601222","heartbeat_back_addr":"172.21.2.109:6823/1264601222","heartbeat_front_addr":"172.21.2.109:6821/1264601222","state":["exists","up"]},{"osd":7,"uuid":"f7402873-089f-44c1-b2ae-5feb0f0f7673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6824","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6825","nonce":1248843023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6826","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6827","nonce":1248843023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6830","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6831","nonce":1248843023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.109:6828","nonce":1248843023},{"type":"v1","addr":"172.21.2.109:6829","nonce":1248843023}]},"public_addr":"172.21.2.109:6825/1248843023","cluster_addr":"172.21.2.109:6827/1248843023","heartbeat_back_addr":"172.21.2.109:6831/1248843023","heartbeat_front_addr":"172.21.2.109:6829/1248843023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:40.964606+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:04.000951+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:26.009720+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:03:48.264352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:07.018473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:28.381238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:04:50.490362+0000","dead_epoch":45},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:05:17.319034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.104:0/1354718829":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/4047249746":"2021-03-11T20:01:07.881988+0000","172.21.2.104:6800/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/111304768":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/2575069528":"2021-03-11T20:00:53.459351+0000","172.21.2.104:0/2571685211":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/2454854716":"2021-03-11T20:01:07.881988+0000","172.21.2.104:0/460307678":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6800/1513196736":"2021-03-11T20:00:53.459351+0000","172.21.2.104:6801/1513196736":"2021-03-11T20:00:53.459351+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:06:01.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-03-10T20:06:01.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:00 gibba009 bash[19725]: t=2021-03-10T20:06:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-03-10T20:06:01.090 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T20:06:01.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:01 gibba004 systemd[1]: Stopping Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:06:01.351 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-03-10T20:06:01.351 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-03-10T20:06:01.352 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-03-10T20:06:01.352 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-03-10T20:06:01.352 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-03-10T20:06:01.560 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:01 gibba004 bash[9777]: cluster 2021-03-10T20:06:00.368466+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:01.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:01 gibba004 bash[9777]: audit 2021-03-10T20:06:00.960603+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.104:0/383434767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:06:01.561 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:01 gibba004 bash[12967]: cluster 2021-03-10T20:06:00.368466+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:01.561 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:01 gibba004 bash[12967]: audit 2021-03-10T20:06:00.960603+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.104:0/383434767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:06:01.628 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[9804]: cluster 2021-03-10T20:06:00.368466+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:01.628 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[9804]: audit 2021-03-10T20:06:00.960603+0000 mon.a (mon.0) 565 : audit [DBG] from='client.? 172.21.2.104:0/383434767' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:06:01.629 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-03-10T20:06:01.629 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-03-10T20:06:01.629 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-03-10T20:06:01.665 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-03-10T20:06:01.752 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:01 gibba004 bash[20300]: level=info ts=2021-03-10T20:06:01.559Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:06:01.921 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-03-10T20:06:01.921 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-03-10T20:06:01.921 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-03-10T20:06:01.922 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-03-10T20:06:01.922 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-03-10T20:06:02.222 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:01 gibba009 bash[19725]: t=2021-03-10T20:06:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-03-10T20:06:02.223 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-03-10T20:06:02.223 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-03-10T20:06:02.223 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-03-10T20:06:02.523 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-03-10T20:06:02.524 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-03-10T20:06:02.524 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-03-10T20:06:02.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-03-10T20:06:02.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-03-10T20:06:02.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-03-10T20:06:02.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-03-10T20:06:02.840 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-03-10T20:06:03.063 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 docker[21847]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:06:03.064 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T20:06:03.064 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 systemd[1]: Stopped Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:06:03.064 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 systemd[1]: Starting Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:06:03.064 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 docker[21901]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:06:03.065 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:02 gibba004 systemd[1]: Started Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:06:03.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:02 gibba009 bash[19725]: t=2021-03-10T20:06:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-03-10T20:06:03.551 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[19725]: t=2021-03-10T20:06:03+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-03-10T20:06:03.551 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[19725]: t=2021-03-10T20:06:03+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-03-10T20:06:03.552 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[9804]: cluster 2021-03-10T20:06:02.368937+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:03.553 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[9804]: audit 2021-03-10T20:06:02.639146+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:03.553 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[9804]: audit 2021-03-10T20:06:02.642897+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:03.553 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[9804]: cephadm 2021-03-10T20:06:02.643340+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:06:03.554 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[9804]: cephadm 2021-03-10T20:06:02.645786+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba009 2021-03-10T20:06:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[9777]: cluster 2021-03-10T20:06:02.368937+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:03.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[12967]: cluster 2021-03-10T20:06:02.368937+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:03.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[9777]: audit 2021-03-10T20:06:02.639146+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[12967]: audit 2021-03-10T20:06:02.639146+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[12967]: audit 2021-03-10T20:06:02.642897+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[12967]: cephadm 2021-03-10T20:06:02.643340+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:06:03.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[12967]: cephadm 2021-03-10T20:06:02.645786+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba009 2021-03-10T20:06:03.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[9777]: audit 2021-03-10T20:06:02.642897+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154547\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154620\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154650\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154676\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154703\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154729\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154755\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.154782\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:03.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[9777]: cephadm 2021-03-10T20:06:02.643340+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:06:03.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:03 gibba004 bash[9777]: cephadm 2021-03-10T20:06:02.645786+0000 mgr.y (mgr.14140) 195 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba009 2021-03-10T20:06:04.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[19725]: t=2021-03-10T20:06:03+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-03-10T20:06:04.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:03 gibba009 bash[19725]: t=2021-03-10T20:06:03+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-03-10T20:06:04.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-03-10T20:06:04.421 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-03-10T20:06:04.422 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-03-10T20:06:04.422 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-03-10T20:06:04.563 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.354Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:06:04.563 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.354Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:06:04.564 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.354Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.104 port=9094 2021-03-10T20:06:04.564 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.355Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:06:04.564 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.369Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:06:04.565 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.369Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:06:04.565 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:04.371Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:06:04.719 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-03-10T20:06:04.720 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-03-10T20:06:04.720 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-03-10T20:06:04.720 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-03-10T20:06:05.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:04 gibba009 bash[19725]: t=2021-03-10T20:06:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-03-10T20:06:05.531 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:05 gibba004 bash[9777]: cluster 2021-03-10T20:06:04.369152+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:05.531 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:05 gibba004 bash[12967]: cluster 2021-03-10T20:06:04.369152+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:05.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[9804]: cluster 2021-03-10T20:06:04.369152+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:05.589 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[19725]: t=2021-03-10T20:06:05+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-03-10T20:06:05.590 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[19725]: t=2021-03-10T20:06:05+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-03-10T20:06:05.590 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[19725]: t=2021-03-10T20:06:05+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-03-10T20:06:05.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[19725]: t=2021-03-10T20:06:05+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-03-10T20:06:06.011 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:05 gibba009 bash[19725]: t=2021-03-10T20:06:05+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-03-10T20:06:06.092 INFO:teuthology.orchestra.run.gibba004.stdout:42949673003 2021-03-10T20:06:06.093 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-03-10T20:06:06.339 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-03-10T20:06:06.339 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-03-10T20:06:06.572 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:06 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:06.355Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000316503s 2021-03-10T20:06:06.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-03-10T20:06:06.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-03-10T20:06:06.840 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-03-10T20:06:07.178 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:06 gibba009 bash[19725]: t=2021-03-10T20:06:06+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-03-10T20:06:07.179 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-03-10T20:06:07.179 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-03-10T20:06:07.179 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-03-10T20:06:07.179 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-03-10T20:06:07.558 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-03-10T20:06:07.558 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-03-10T20:06:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:07 gibba004 bash[9777]: cluster 2021-03-10T20:06:06.369784+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:07 gibba004 bash[12967]: cluster 2021-03-10T20:06:06.369784+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:07.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[9804]: cluster 2021-03-10T20:06:06.369784+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:07.845 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-03-10T20:06:08.170 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 systemd[1]: Stopping Ceph prometheus.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:06:08.170 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-03-10T20:06:08.171 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:07 gibba009 bash[19725]: t=2021-03-10T20:06:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-03-10T20:06:08.171 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-03-10T20:06:08.171 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-03-10T20:06:08.502 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-03-10T20:06:08.502 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-03-10T20:06:08.502 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=warn ts=2021-03-10T20:06:08.242Z caller=main.go:629 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:06:08.503 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:652 msg="Stopping scrape discovery manager..." 2021-03-10T20:06:08.503 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:666 msg="Stopping notify discovery manager..." 2021-03-10T20:06:08.503 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:688 msg="Stopping scrape manager..." 2021-03-10T20:06:08.503 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=manager.go:924 component="rule manager" msg="Stopping rule manager..." 2021-03-10T20:06:08.504 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=manager.go:934 component="rule manager" msg="Rule manager stopped" 2021-03-10T20:06:08.504 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:662 msg="Notify discovery manager stopped" 2021-03-10T20:06:08.504 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-03-10T20:06:08.504 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:682 msg="Scrape manager stopped" 2021-03-10T20:06:08.504 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:856 msg="Notifier manager stopped" 2021-03-10T20:06:08.505 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:648 msg="Scrape discovery manager stopped" 2021-03-10T20:06:08.505 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[18496]: level=info ts=2021-03-10T20:06:08.242Z caller=main.go:868 msg="See you next time!" 2021-03-10T20:06:08.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-03-10T20:06:09.182 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-03-10T20:06:09.182 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:08 gibba009 bash[19725]: t=2021-03-10T20:06:08+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-03-10T20:06:09.183 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[19725]: t=2021-03-10T20:06:09+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-03-10T20:06:09.440 INFO:teuthology.orchestra.run.gibba004.stdout:68719476776 2021-03-10T20:06:09.441 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-03-10T20:06:09.482 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[19725]: t=2021-03-10T20:06:09+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-03-10T20:06:09.482 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[19725]: t=2021-03-10T20:06:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-03-10T20:06:09.483 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 docker[20302]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:06:09.483 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@prometheus.a.service: Succeeded. 2021-03-10T20:06:09.483 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 systemd[1]: Stopped Ceph prometheus.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:06:09.483 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 systemd[1]: Starting Ceph prometheus.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:06:09.484 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 docker[20341]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:06:09.484 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:09 gibba009 systemd[1]: Started Ceph prometheus.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:06:09.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: cluster 2021-03-10T20:06:08.370377+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:09.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: audit 2021-03-10T20:06:09.223772+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:09.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: audit 2021-03-10T20:06:09.232795+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:09.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: audit 2021-03-10T20:06:09.233580+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:06:09.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: audit 2021-03-10T20:06:09.236322+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:06:09.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[9804]: audit 2021-03-10T20:06:09.237671+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:09.761 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[19725]: t=2021-03-10T20:06:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-03-10T20:06:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: cluster 2021-03-10T20:06:08.370377+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:09.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: cluster 2021-03-10T20:06:08.370377+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: audit 2021-03-10T20:06:09.223772+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:09.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: audit 2021-03-10T20:06:09.223772+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: audit 2021-03-10T20:06:09.232795+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: audit 2021-03-10T20:06:09.233580+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:06:09.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: audit 2021-03-10T20:06:09.236322+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:06:09.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[9777]: audit 2021-03-10T20:06:09.237671+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: audit 2021-03-10T20:06:09.232795+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984053\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984324\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984499\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984663\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984819\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.984970\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985122\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985421\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:55.985569\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: audit 2021-03-10T20:06:09.233580+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:06:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: audit 2021-03-10T20:06:09.236322+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba009:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:06:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:09 gibba004 bash[12967]: audit 2021-03-10T20:06:09.237671+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:10.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:09 gibba009 bash[19725]: t=2021-03-10T20:06:09+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-03-10T20:06:10.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-03-10T20:06:10.442 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-03-10T20:06:10.442 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-03-10T20:06:10.443 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-03-10T20:06:10.443 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-03-10T20:06:10.632 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[12967]: cephadm 2021-03-10T20:06:09.233341+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Setting dashboard grafana config to https://gibba009:3000 2021-03-10T20:06:10.632 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[9777]: cephadm 2021-03-10T20:06:09.233341+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Setting dashboard grafana config to https://gibba009:3000 2021-03-10T20:06:10.633 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[12967]: audit 2021-03-10T20:06:09.977926+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:10.633 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[12967]: audit 2021-03-10T20:06:09.982159+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:10.634 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[12967]: audit 2021-03-10T20:06:09.982832+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:10.634 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[9777]: audit 2021-03-10T20:06:09.977926+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:10.635 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[9777]: audit 2021-03-10T20:06:09.982159+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:10.635 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:10 gibba004 bash[9777]: audit 2021-03-10T20:06:09.982832+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:10.703 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-03-10T20:06:10.703 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-03-10T20:06:10.703 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-03-10T20:06:10.704 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[9804]: cephadm 2021-03-10T20:06:09.233341+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Setting dashboard grafana config to https://gibba009:3000 2021-03-10T20:06:10.704 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[9804]: audit 2021-03-10T20:06:09.977926+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:06:10.704 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[9804]: audit 2021-03-10T20:06:09.982159+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}}, \"last_daemon_update\": \"2021-03-10T20:06:09.976991\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:06:10.705 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[9804]: audit 2021-03-10T20:06:09.982832+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:06:10.985 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-03-10T20:06:10.986 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-03-10T20:06:10.986 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-03-10T20:06:10.986 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-03-10T20:06:10.987 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T20:06:10.987 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T20:06:10.987 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T20:06:10.987 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba009 (none))" 2021-03-10T20:06:10.988 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T20:06:10.988 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.700Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T20:06:10.988 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.702Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T20:06:10.988 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.702Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T20:06:10.988 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.702Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T20:06:10.989 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.704Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T20:06:10.989 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.704Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.389µs 2021-03-10T20:06:10.989 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.704Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T20:06:10.989 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.704Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-03-10T20:06:10.990 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.704Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-03-10T20:06:10.990 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.705Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=16.365µs wal_replay_duration=810.46µs total_replay_duration=841.185µs 2021-03-10T20:06:10.990 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.705Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T20:06:10.990 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.705Z caller=main.go:802 msg="TSDB started" 2021-03-10T20:06:10.990 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.705Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T20:06:10.991 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.706Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=456.165µs remote_storage=833ns web_handler=122ns query_engine=369ns scrape=189.313µs scrape_sd=19.112µs notify=10.736µs notify_sd=5.216µs rules=17.875µs 2021-03-10T20:06:10.991 INFO:journalctl@ceph.prometheus.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[20359]: level=info ts=2021-03-10T20:06:10.706Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T20:06:11.314 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:10 gibba009 bash[19725]: t=2021-03-10T20:06:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-03-10T20:06:11.315 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-03-10T20:06:11.315 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-03-10T20:06:11.315 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-03-10T20:06:11.573 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-03-10T20:06:11.574 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-03-10T20:06:11.574 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-03-10T20:06:11.574 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-03-10T20:06:11.574 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-03-10T20:06:11.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-03-10T20:06:11.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-03-10T20:06:11.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-03-10T20:06:11.840 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-03-10T20:06:12.123 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[9777]: cluster 2021-03-10T20:06:10.370600+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:12.123 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[12967]: cluster 2021-03-10T20:06:10.370600+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:12.124 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[9777]: audit 2021-03-10T20:06:11.302872+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:12.124 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[9777]: audit 2021-03-10T20:06:11.311640+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:12.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[12967]: audit 2021-03-10T20:06:11.302872+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:12.125 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:11 gibba004 bash[12967]: audit 2021-03-10T20:06:11.311640+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:12.136 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-03-10T20:06:12.136 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-03-10T20:06:12.136 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[19725]: t=2021-03-10T20:06:11+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-03-10T20:06:12.137 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-03-10T20:06:12.137 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-03-10T20:06:12.137 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[9804]: cluster 2021-03-10T20:06:10.370600+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:12.138 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[9804]: audit 2021-03-10T20:06:11.302872+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:06:12.138 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:11 gibba009 bash[9804]: audit 2021-03-10T20:06:11.311640+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}}, \"last_daemon_update\": \"2021-03-10T20:06:11.299819\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:06:12.406 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-03-10T20:06:12.406 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-03-10T20:06:12.407 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-03-10T20:06:12.407 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-03-10T20:06:12.407 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-03-10T20:06:12.634 INFO:teuthology.orchestra.run.gibba004.stdout:90194313250 2021-03-10T20:06:12.635 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-03-10T20:06:12.714 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-03-10T20:06:12.714 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-03-10T20:06:12.714 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-03-10T20:06:12.715 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-03-10T20:06:12.715 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-03-10T20:06:12.965 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-03-10T20:06:12.965 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-03-10T20:06:12.966 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-03-10T20:06:13.259 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:12 gibba009 bash[19725]: t=2021-03-10T20:06:12+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-03-10T20:06:13.260 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-03-10T20:06:13.261 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-03-10T20:06:13.262 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-03-10T20:06:13.263 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-03-10T20:06:13.264 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-03-10T20:06:13.561 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-03-10T20:06:13.562 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-03-10T20:06:13.562 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-03-10T20:06:13.563 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-03-10T20:06:13.563 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-03-10T20:06:13.812 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-03-10T20:06:13.814 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-03-10T20:06:13.815 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-03-10T20:06:13.815 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-03-10T20:06:14.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[9804]: cluster 2021-03-10T20:06:12.371152+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:14.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-03-10T20:06:14.089 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-03-10T20:06:14.090 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:13 gibba009 bash[19725]: t=2021-03-10T20:06:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-03-10T20:06:14.090 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-03-10T20:06:14.286 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:13 gibba004 bash[9777]: cluster 2021-03-10T20:06:12.371152+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:14.286 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:14 gibba004 bash[12967]: cluster 2021-03-10T20:06:12.371152+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:14.339 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-03-10T20:06:14.339 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-03-10T20:06:14.340 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-03-10T20:06:14.563 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:06:14 gibba004 bash[21918]: level=info ts=2021-03-10T20:06:14.357Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001648057s 2021-03-10T20:06:14.624 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-03-10T20:06:14.625 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-03-10T20:06:14.625 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-03-10T20:06:14.625 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-03-10T20:06:14.626 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-03-10T20:06:14.901 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-03-10T20:06:14.902 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-03-10T20:06:14.902 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-03-10T20:06:14.902 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-03-10T20:06:14.902 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-03-10T20:06:15.162 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-03-10T20:06:15.162 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:14 gibba009 bash[19725]: t=2021-03-10T20:06:14+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-03-10T20:06:15.162 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-03-10T20:06:15.163 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-03-10T20:06:15.449 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-03-10T20:06:15.449 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-03-10T20:06:15.449 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-03-10T20:06:15.449 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-03-10T20:06:15.450 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-03-10T20:06:15.450 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-03-10T20:06:15.450 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-03-10T20:06:15.450 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-03-10T20:06:15.451 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing HooksService" logger=server 2021-03-10T20:06:15.451 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-03-10T20:06:15.451 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-03-10T20:06:15.451 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-03-10T20:06:15.451 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-03-10T20:06:15.452 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-03-10T20:06:15.453 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-03-10T20:06:15.453 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-03-10T20:06:15.453 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-03-10T20:06:15.454 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-03-10T20:06:15.454 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing LoginService" logger=server 2021-03-10T20:06:15.454 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing SearchService" logger=server 2021-03-10T20:06:15.454 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing TracingService" logger=server 2021-03-10T20:06:15.455 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-03-10T20:06:15.455 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-03-10T20:06:15.455 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-03-10T20:06:15.455 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-03-10T20:06:15.456 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-03-10T20:06:15.456 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2021-03-10T20:06:15.456 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-03-10T20:06:15.457 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2021-03-10T20:06:15.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="Initializing Stream Manager" 2021-03-10T20:06:15.839 INFO:journalctl@ceph.grafana.a.gibba009.stdout:Mar 10 20:06:15 gibba009 bash[19725]: t=2021-03-10T20:06:15+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2021-03-10T20:06:15.863 INFO:teuthology.orchestra.run.gibba004.stdout:115964117023 2021-03-10T20:06:15.864 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-03-10T20:06:16.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:16 gibba004 bash[9777]: cluster 2021-03-10T20:06:14.372007+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:16.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:16 gibba004 bash[12967]: cluster 2021-03-10T20:06:14.372007+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:16.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:16 gibba009 bash[9804]: cluster 2021-03-10T20:06:14.372007+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:18 gibba004 bash[9777]: cluster 2021-03-10T20:06:16.372827+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:18 gibba004 bash[12967]: cluster 2021-03-10T20:06:16.372827+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:18 gibba009 bash[9804]: cluster 2021-03-10T20:06:16.372827+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:19.192 INFO:teuthology.orchestra.run.gibba004.stdout:137438953501 2021-03-10T20:06:19.193 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-03-10T20:06:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:20 gibba004 bash[9777]: cluster 2021-03-10T20:06:18.373703+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:20 gibba004 bash[12967]: cluster 2021-03-10T20:06:18.373703+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:20 gibba009 bash[9804]: cluster 2021-03-10T20:06:18.373703+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:22 gibba004 bash[9777]: cluster 2021-03-10T20:06:20.374646+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:22 gibba004 bash[12967]: cluster 2021-03-10T20:06:20.374646+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:22 gibba009 bash[9804]: cluster 2021-03-10T20:06:20.374646+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:22.390 INFO:teuthology.orchestra.run.gibba004.stdout:158913789977 2021-03-10T20:06:22.390 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-03-10T20:06:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:24 gibba004 bash[9777]: cluster 2021-03-10T20:06:22.375541+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:24.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:24 gibba004 bash[12967]: cluster 2021-03-10T20:06:22.375541+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:24 gibba009 bash[9804]: cluster 2021-03-10T20:06:22.375541+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:25.762 INFO:teuthology.orchestra.run.gibba004.stdout:201863462928 2021-03-10T20:06:25.763 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-03-10T20:06:26.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:26 gibba004 bash[9777]: cluster 2021-03-10T20:06:24.376450+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:26 gibba004 bash[12967]: cluster 2021-03-10T20:06:24.376450+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:26 gibba009 bash[9804]: cluster 2021-03-10T20:06:24.376450+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:28 gibba009 bash[9804]: cluster 2021-03-10T20:06:26.377205+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:28.352 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:28 gibba004 bash[9777]: cluster 2021-03-10T20:06:26.377205+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:28.352 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:28 gibba004 bash[12967]: cluster 2021-03-10T20:06:26.377205+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:29.201 INFO:teuthology.orchestra.run.gibba004.stdout:219043332112 2021-03-10T20:06:29.202 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-03-10T20:06:30.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:30 gibba009 bash[9804]: cluster 2021-03-10T20:06:28.377802+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:30.389 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:30 gibba004 bash[9777]: cluster 2021-03-10T20:06:28.377802+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:30.390 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:30 gibba004 bash[12967]: cluster 2021-03-10T20:06:28.377802+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:32.030 INFO:teuthology.orchestra.run.gibba004.stdout:42949673008 2021-03-10T20:06:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:32 gibba004 bash[9777]: cluster 2021-03-10T20:06:30.378667+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:32 gibba004 bash[9777]: audit 2021-03-10T20:06:32.029391+0000 mon.a (mon.0) 578 : audit [DBG] from='client.? 172.21.2.104:0/684309159' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:06:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:32 gibba004 bash[12967]: cluster 2021-03-10T20:06:30.378667+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:32 gibba004 bash[12967]: audit 2021-03-10T20:06:32.029391+0000 mon.a (mon.0) 578 : audit [DBG] from='client.? 172.21.2.104:0/684309159' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:06:32.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:32 gibba009 bash[9804]: cluster 2021-03-10T20:06:30.378667+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:32.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:32 gibba009 bash[9804]: audit 2021-03-10T20:06:32.029391+0000 mon.a (mon.0) 578 : audit [DBG] from='client.? 172.21.2.104:0/684309159' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:06:32.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673003 got 42949673008 for osd.0 2021-03-10T20:06:32.724 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-03-10T20:06:34.302 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:34 gibba004 bash[12967]: cluster 2021-03-10T20:06:32.379560+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:34.302 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:34 gibba004 bash[9777]: cluster 2021-03-10T20:06:32.379560+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:34.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:34 gibba009 bash[9804]: cluster 2021-03-10T20:06:32.379560+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:35.413 INFO:teuthology.orchestra.run.gibba004.stdout:68719476781 2021-03-10T20:06:36.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476776 got 68719476781 for osd.1 2021-03-10T20:06:36.027 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-03-10T20:06:36.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:36 gibba004 bash[9777]: cluster 2021-03-10T20:06:34.380448+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:36.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:36 gibba004 bash[9777]: audit 2021-03-10T20:06:35.413209+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.104:0/3529596797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:06:36.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:36 gibba004 bash[12967]: cluster 2021-03-10T20:06:34.380448+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:36.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:36 gibba004 bash[12967]: audit 2021-03-10T20:06:35.413209+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.104:0/3529596797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:06:36.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:36 gibba009 bash[9804]: cluster 2021-03-10T20:06:34.380448+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:36.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:36 gibba009 bash[9804]: audit 2021-03-10T20:06:35.413209+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.104:0/3529596797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:06:38.547 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:38 gibba004 bash[9777]: cluster 2021-03-10T20:06:36.381133+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:38.548 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:38 gibba004 bash[12967]: cluster 2021-03-10T20:06:36.381133+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:38.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:38 gibba009 bash[9804]: cluster 2021-03-10T20:06:36.381133+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:38.770 INFO:teuthology.orchestra.run.gibba004.stdout:90194313255 2021-03-10T20:06:39.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:39 gibba004 bash[9777]: audit 2021-03-10T20:06:38.768981+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.104:0/1270260889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:06:39.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:39 gibba004 bash[12967]: audit 2021-03-10T20:06:38.768981+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.104:0/1270260889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:06:39.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313250 got 90194313255 for osd.2 2021-03-10T20:06:39.417 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-03-10T20:06:39.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:39 gibba009 bash[9804]: audit 2021-03-10T20:06:38.768981+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.104:0/1270260889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:06:40.425 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:40 gibba004 bash[9777]: cluster 2021-03-10T20:06:38.381842+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:40.426 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:40 gibba004 bash[12967]: cluster 2021-03-10T20:06:38.381842+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:40 gibba009 bash[9804]: cluster 2021-03-10T20:06:38.381842+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:42.284 INFO:teuthology.orchestra.run.gibba004.stdout:115964117029 2021-03-10T20:06:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:42 gibba004 bash[9777]: cluster 2021-03-10T20:06:40.382453+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:42.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:42 gibba004 bash[12967]: cluster 2021-03-10T20:06:40.382453+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:42.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:42 gibba009 bash[9804]: cluster 2021-03-10T20:06:40.382453+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:42.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117023 got 115964117029 for osd.3 2021-03-10T20:06:42.880 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-03-10T20:06:43.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:43 gibba004 bash[9777]: audit 2021-03-10T20:06:42.283675+0000 mon.a (mon.0) 579 : audit [DBG] from='client.? 172.21.2.104:0/2826968438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:06:43.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:43 gibba004 bash[12967]: audit 2021-03-10T20:06:42.283675+0000 mon.a (mon.0) 579 : audit [DBG] from='client.? 172.21.2.104:0/2826968438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:06:43.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:43 gibba009 bash[9804]: audit 2021-03-10T20:06:42.283675+0000 mon.a (mon.0) 579 : audit [DBG] from='client.? 172.21.2.104:0/2826968438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:06:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:44 gibba004 bash[9777]: cluster 2021-03-10T20:06:42.382762+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:44 gibba004 bash[12967]: cluster 2021-03-10T20:06:42.382762+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:44.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:44 gibba009 bash[9804]: cluster 2021-03-10T20:06:42.382762+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:45.678 INFO:teuthology.orchestra.run.gibba004.stdout:137438953506 2021-03-10T20:06:46.244 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953501 got 137438953506 for osd.4 2021-03-10T20:06:46.244 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-03-10T20:06:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:46 gibba004 bash[9777]: cluster 2021-03-10T20:06:44.383546+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:46.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:46 gibba004 bash[9777]: audit 2021-03-10T20:06:45.677762+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.104:0/865014734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:06:46.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:46 gibba004 bash[12967]: cluster 2021-03-10T20:06:44.383546+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:46.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:46 gibba004 bash[12967]: audit 2021-03-10T20:06:45.677762+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.104:0/865014734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:06:46.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:46 gibba009 bash[9804]: cluster 2021-03-10T20:06:44.383546+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:46.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:46 gibba009 bash[9804]: audit 2021-03-10T20:06:45.677762+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.104:0/865014734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:06:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:48 gibba004 bash[9777]: cluster 2021-03-10T20:06:46.384660+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:48 gibba004 bash[12967]: cluster 2021-03-10T20:06:46.384660+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:48.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:48 gibba009 bash[9804]: cluster 2021-03-10T20:06:46.384660+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:48.849 INFO:teuthology.orchestra.run.gibba004.stdout:158913789981 2021-03-10T20:06:49.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:49 gibba004 bash[9777]: audit 2021-03-10T20:06:48.848517+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.104:0/3705480074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:06:49.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:49 gibba004 bash[12967]: audit 2021-03-10T20:06:48.848517+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.104:0/3705480074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:06:49.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789977 got 158913789981 for osd.5 2021-03-10T20:06:49.498 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-03-10T20:06:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:49 gibba009 bash[9804]: audit 2021-03-10T20:06:48.848517+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.104:0/3705480074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:06:50.480 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:50 gibba004 bash[9777]: cluster 2021-03-10T20:06:48.385555+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:50.481 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:50 gibba004 bash[12967]: cluster 2021-03-10T20:06:48.385555+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:50.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:50 gibba009 bash[9804]: cluster 2021-03-10T20:06:48.385555+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:52.139 INFO:teuthology.orchestra.run.gibba004.stdout:201863462933 2021-03-10T20:06:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:52 gibba004 bash[9777]: cluster 2021-03-10T20:06:50.386606+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:52 gibba004 bash[9777]: audit 2021-03-10T20:06:52.138960+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.104:0/1902388425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:06:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:52 gibba004 bash[12967]: cluster 2021-03-10T20:06:50.386606+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:52 gibba004 bash[12967]: audit 2021-03-10T20:06:52.138960+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.104:0/1902388425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:06:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:52 gibba009 bash[9804]: cluster 2021-03-10T20:06:50.386606+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:52.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:52 gibba009 bash[9804]: audit 2021-03-10T20:06:52.138960+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.104:0/1902388425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:06:52.797 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462928 got 201863462933 for osd.6 2021-03-10T20:06:52.798 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-03-10T20:06:53.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:53 gibba004 bash[9777]: cluster 2021-03-10T20:06:52.387376+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:53.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:53 gibba004 bash[12967]: cluster 2021-03-10T20:06:52.387376+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:53.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:53 gibba009 bash[9804]: cluster 2021-03-10T20:06:52.387376+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:55.412 INFO:teuthology.orchestra.run.gibba004.stdout:219043332118 2021-03-10T20:06:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:55 gibba004 bash[9777]: cluster 2021-03-10T20:06:54.387731+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:55 gibba004 bash[9777]: audit 2021-03-10T20:06:55.411969+0000 mon.a (mon.0) 580 : audit [DBG] from='client.? 172.21.2.104:0/3455702772' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:06:55.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:55 gibba004 bash[12967]: cluster 2021-03-10T20:06:54.387731+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:55.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:55 gibba004 bash[12967]: audit 2021-03-10T20:06:55.411969+0000 mon.a (mon.0) 580 : audit [DBG] from='client.? 172.21.2.104:0/3455702772' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:06:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:55 gibba009 bash[9804]: cluster 2021-03-10T20:06:54.387731+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:55 gibba009 bash[9804]: audit 2021-03-10T20:06:55.411969+0000 mon.a (mon.0) 580 : audit [DBG] from='client.? 172.21.2.104:0/3455702772' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:06:55.994 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332112 got 219043332118 for osd.7 2021-03-10T20:06:55.995 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-03-10T20:06:55.995 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T20:06:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:57 gibba004 bash[9777]: cluster 2021-03-10T20:06:56.388323+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:57.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:57 gibba004 bash[12967]: cluster 2021-03-10T20:06:56.388323+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:57 gibba009 bash[9804]: cluster 2021-03-10T20:06:56.388323+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:58.628 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:06:58.629 INFO:teuthology.orchestra.run.gibba004.stderr:dumped all 2021-03-10T20:06:59.228 INFO:teuthology.orchestra.run.gibba004.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2021-03-10T20:06:58.388670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392672,"kb_used_data":4000,"kb_used_omap":9,"kb_used_meta":8388598,"kb_avail":696250400,"statfs":{"total":721554505728,"available":712960409600,"internally_reserved":8589934592,"allocated":4096000,"data_stored":1639056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":8589925188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004451"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"52","state":"active+clean","last_fresh":"2021-03-10T20:05:19.656333+0000","last_change":"2021-03-10T20:05:19.656333+0000","last_active":"2021-03-10T20:05:19.656333+0000","last_peered":"2021-03-10T20:05:19.656333+0000","last_clean":"2021-03-10T20:05:19.656333+0000","last_became_active":"2021-03-10T20:05:19.646976+0000","last_became_peered":"2021-03-10T20:05:19.646976+0000","last_unstale":"2021-03-10T20:05:19.656333+0000","last_undegraded":"2021-03-10T20:05:19.656333+0000","last_fullsized":"2021-03-10T20:05:19.656333+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T20:00:46.238892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T20:00:46.238892+0000","last_clean_scrub_stamp":"2021-03-10T20:00:46.238892+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332118,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":2.149},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1950000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.8400000000000001}]},{"osd":2,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":2.2349999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.573},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.2809999999999999}]},{"osd":4,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.108,"5min":0.108,"15min":0.108},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.425},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.234}]},{"osd":5,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.9690000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.94399999999999995}]},{"osd":6,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.143}]}]},{"osd":6,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":9,"kb_used_meta":1048566,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":1073732420},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.7},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":2.2839999999999998}]},{"osd":1,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":2.0150000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2829999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":2.1480000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.8460000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":2.589}]},{"osd":4,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":2.4830000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.6000000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:24 2021","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":2.8250000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":2.7210000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.63400000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.86499999999999999,"15min":0.79300000000000004},"min":{"1min":0.27600000000000002,"5min":0.216,"15min":0.216},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Mar 10 20:06:37 2021","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.036,"15min":1.0049999999999999},"min":{"1min":0.32700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.878,"15min":0.80200000000000005},"min":{"1min":0.27000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.222}]},{"osd":3,"last update":"Wed Mar 10 20:06:53 2021","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.206,"15min":1.214},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.308},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.1319999999999999,"15min":1.1639999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":2.0529999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.248}]},{"osd":4,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.431,"15min":1.421},"min":{"1min":0.501,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.105},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:34 2021","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.643,"15min":1.653},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.242,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.327,"15min":1.325},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.151},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.246}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.224},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.91300000000000003}]}]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 20:06:08 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.71899999999999997,"15min":0.68000000000000005},"min":{"1min":0.25700000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.2170000000000001,"5min":0.96899999999999997,"15min":0.876},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Mar 10 20:06:38 2021","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.0780000000000001,"15min":1.028},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Mar 10 20:05:54 2021","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.99299999999999999,"15min":0.97299999999999998},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.49,"5min":1.276,"15min":1.24},"min":{"1min":0.51400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.5109999999999999,"15min":1.4750000000000001},"min":{"1min":0.80600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.2470000000000001,"15min":1.2350000000000001},"min":{"1min":0.61099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.103}]},{"osd":5,"last update":"Wed Mar 10 20:06:38 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.405,"15min":1.415},"min":{"1min":0.83299999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.22},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7110000000000001,"15min":1.698},"min":{"1min":0.72499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.02},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":1.371}]}]},{"osd":2,"up_from":21,"seq":90194313259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:30 2021","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.861,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92400000000000004,"15min":0.89900000000000002},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.84199999999999997}]},{"osd":1,"last update":"Wed Mar 10 20:06:30 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.665,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0069999999999999,"15min":0.98699999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.635,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.274}]},{"osd":3,"last update":"Wed Mar 10 20:05:57 2021","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1160000000000001,"15min":1.1279999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.179}]},{"osd":4,"last update":"Wed Mar 10 20:06:12 2021","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.2729999999999999,"15min":1.258},"min":{"1min":0.59099999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.008,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.76},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.341,"15min":1.3140000000000001},"min":{"1min":0.60799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":2.085}]},{"osd":5,"last update":"Wed Mar 10 20:06:32 2021","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.57399999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":2.351},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.325,"15min":1.2849999999999999},"min":{"1min":0.69999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.2250000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.548},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.6619999999999999}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.829},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.9419999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:05:52 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.999,"15min":1.0149999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.113,"15min":1.1040000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.2709999999999999}]},{"osd":1,"last update":"Wed Mar 10 20:05:52 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.95099999999999996}]},{"osd":2,"last update":"Wed Mar 10 20:05:52 2021","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.321,"15min":1.333},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.167,"15min":1.173},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.1040000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.502,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":2.0819999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.5449999999999999,"15min":1.5269999999999999},"min":{"1min":0.90300000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.5620000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:35 2021","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.466,"15min":1.444},"min":{"1min":0.97699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0790000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.702,"15min":1.6739999999999999},"min":{"1min":1.0449999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.4319999999999999,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.673}]},{"osd":6,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.948},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.409}]},{"osd":7,"last update":"Wed Mar 10 20:06:22 2021","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":2.331},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":2.2149999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.3400000000000001,"15min":1.3240000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.448,"15min":1.4339999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.4039999999999999}]},{"osd":1,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.143,"15min":1.131},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.101},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2480000000000002,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.242}]},{"osd":2,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.335,"15min":1.325},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.157,"15min":1.143},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.997},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.194,"15min":1.2},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.7310000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.755}]},{"osd":5,"last update":"Wed Mar 10 20:06:34 2021","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":0.78800000000000003,"15min":0.72599999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.776},{"interface":"front","average":{"1min":1.4430000000000001,"5min":0.93500000000000005,"15min":0.84999999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":2.0409999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.55},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.8480000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:21 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.96},{"interface":"front","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.917}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.534,"15min":1.591},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.327,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.3939999999999999,"15min":1.423},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3330000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.361,"15min":1.403},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.7969999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.296},{"interface":"front","average":{"1min":1.276,"5min":1.556,"15min":1.603},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.2290000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.93300000000000005}]},{"osd":2,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.655,"15min":1.712},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.444,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.3899999999999999,"15min":1.4350000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.0489999999999999,"5min":2.073,"15min":2.073},"last":1.0600000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.401,"15min":1.403},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.367},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.6240000000000001,"15min":1.6759999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.4700000000000002,"5min":2.488,"15min":2.488},"last":1.8260000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":0.93100000000000005,"15min":0.89900000000000002},"min":{"1min":0.20699999999999999,"5min":0.189,"15min":0.189},"max":{"1min":2.3490000000000002,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0409999999999999,"15min":1.0289999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.9330000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:06:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.409}]},{"osd":7,"last update":"Wed Mar 10 20:06:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.728},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":2.016}]}]}]}} 2021-03-10T20:06:59.231 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T20:06:59.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:59 gibba004 bash[9777]: cluster 2021-03-10T20:06:58.389037+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:59.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:06:59 gibba004 bash[9777]: audit 2021-03-10T20:06:58.625693+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:06:59.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:59 gibba004 bash[12967]: cluster 2021-03-10T20:06:58.389037+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:59.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:06:59 gibba004 bash[12967]: audit 2021-03-10T20:06:58.625693+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:06:59.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:59 gibba009 bash[9804]: cluster 2021-03-10T20:06:58.389037+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:06:59.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:06:59 gibba009 bash[9804]: audit 2021-03-10T20:06:58.625693+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24355 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:07:01.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:01 gibba004 bash[9777]: cluster 2021-03-10T20:07:00.389788+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:01.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:01 gibba004 bash[12967]: cluster 2021-03-10T20:07:00.389788+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:01.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:01 gibba009 bash[9804]: cluster 2021-03-10T20:07:00.389788+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:01.890 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:07:01.891 INFO:teuthology.orchestra.run.gibba004.stderr:dumped all 2021-03-10T20:07:02.433 INFO:teuthology.orchestra.run.gibba004.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2021-03-10T20:07:00.389418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392672,"kb_used_data":4000,"kb_used_omap":9,"kb_used_meta":8388598,"kb_avail":696250400,"statfs":{"total":721554505728,"available":712960409600,"internally_reserved":8589934592,"allocated":4096000,"data_stored":1639056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":8589925188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004315"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"52","state":"active+clean","last_fresh":"2021-03-10T20:05:19.656333+0000","last_change":"2021-03-10T20:05:19.656333+0000","last_active":"2021-03-10T20:05:19.656333+0000","last_peered":"2021-03-10T20:05:19.656333+0000","last_clean":"2021-03-10T20:05:19.656333+0000","last_became_active":"2021-03-10T20:05:19.646976+0000","last_became_peered":"2021-03-10T20:05:19.646976+0000","last_unstale":"2021-03-10T20:05:19.656333+0000","last_undegraded":"2021-03-10T20:05:19.656333+0000","last_fullsized":"2021-03-10T20:05:19.656333+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T20:00:46.238892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T20:00:46.238892+0000","last_clean_scrub_stamp":"2021-03-10T20:00:46.238892+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332119,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1579999999999999}]},{"osd":1,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.413},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.0229999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.091},{"interface":"front","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.8200000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.288}]},{"osd":4,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.108,"5min":0.108,"15min":0.108},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2090000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.6180000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:06:20 2021","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.7609999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":9,"kb_used_meta":1048566,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9404,"internal_metadata":1073732420},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.7},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":2.2839999999999998}]},{"osd":1,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":2.0150000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2829999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":2.1480000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.8460000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":2.589}]},{"osd":4,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":2.4830000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:15 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.6000000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:24 2021","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":2.8250000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":2.7210000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.63400000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6040000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.86499999999999999,"15min":0.79300000000000004},"min":{"1min":0.27600000000000002,"5min":0.216,"15min":0.216},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Mar 10 20:06:37 2021","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.036,"15min":1.0049999999999999},"min":{"1min":0.32700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.878,"15min":0.80200000000000005},"min":{"1min":0.27000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.4569999999999999,"5min":2.4569999999999999,"15min":2.4569999999999999},"last":0.222}]},{"osd":3,"last update":"Wed Mar 10 20:06:53 2021","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.206,"15min":1.214},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.308},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.1319999999999999,"15min":1.1639999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":2.0529999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.248}]},{"osd":4,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.431,"15min":1.421},"min":{"1min":0.501,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.105},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.2689999999999999,"15min":1.2490000000000001},"min":{"1min":0.49399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0780000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:34 2021","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.643,"15min":1.653},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.242,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.327,"15min":1.325},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.151},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.246}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.224},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.91300000000000003}]}]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 20:06:08 2021","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.71899999999999997,"15min":0.68000000000000005},"min":{"1min":0.25700000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.284},{"interface":"front","average":{"1min":1.2170000000000001,"5min":0.96899999999999997,"15min":0.876},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":1.6559999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:06:38 2021","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.0780000000000001,"15min":1.028},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.474},{"interface":"front","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:06:57 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.96399999999999997},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.4279999999999999,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.244,"15min":1.23},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.8440000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.125}]},{"osd":4,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.5109999999999999,"15min":1.4750000000000001},"min":{"1min":0.80600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":2.2410000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.2470000000000001,"15min":1.2350000000000001},"min":{"1min":0.61099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.7190000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:06:38 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.405,"15min":1.415},"min":{"1min":0.83299999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.821},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7110000000000001,"15min":1.698},"min":{"1min":0.72499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":2.411}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.5800000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":2.1139999999999999},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4369999999999998,"5min":2.4369999999999998,"15min":2.4369999999999998},"last":2.5070000000000001}]}]},{"osd":2,"up_from":21,"seq":90194313260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:30 2021","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":1.861,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92400000000000004,"15min":0.89900000000000002},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.94999999999999996}]},{"osd":1,"last update":"Wed Mar 10 20:06:30 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.665,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0069999999999999,"15min":0.98699999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.635,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.2589999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:06:57 2021","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.123},"min":{"1min":0.33500000000000002,"5min":0.222,"15min":0.222},"max":{"1min":1.605,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.105,"15min":1.0680000000000001},"min":{"1min":0.30399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.141,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.4510000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:06:12 2021","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.2729999999999999,"15min":1.258},"min":{"1min":0.59099999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.008,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.341,"15min":1.3140000000000001},"min":{"1min":0.60799999999999998,"5min":0.499,"15min":0.499},"max":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":1.952}]},{"osd":5,"last update":"Wed Mar 10 20:06:32 2021","interfaces":[{"interface":"back","average":{"1min":1.6599999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.57399999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.593},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.325,"15min":1.2849999999999999},"min":{"1min":0.69999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.5369999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:06:13 2021","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.76},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.6639999999999999}]},{"osd":7,"last update":"Wed Mar 10 20:06:19 2021","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":2.0259999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:55 2021","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.27900000000000003,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.327,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.095,"15min":1.0980000000000001},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.5149999999999999,"5min":1.857,"15min":1.857},"last":1.1779999999999999}]},{"osd":1,"last update":"Wed Mar 10 20:06:55 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.167,"15min":1.1970000000000001},"min":{"1min":0.20499999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.865,"5min":2.254,"15min":2.254},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.6870000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.498}]},{"osd":2,"last update":"Wed Mar 10 20:06:55 2021","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.278,"15min":1.319},"min":{"1min":0.29599999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.8460000000000001,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.111,"15min":1.155},"min":{"1min":0.251,"5min":0.245,"15min":0.245},"max":{"1min":1.2390000000000001,"5min":1.986,"15min":1.986},"last":1.3480000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.502,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.653,"5min":1.5449999999999999,"15min":1.5269999999999999},"min":{"1min":0.90300000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":2.125}]},{"osd":5,"last update":"Wed Mar 10 20:06:35 2021","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.466,"15min":1.444},"min":{"1min":0.97699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.0790000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.802},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.702,"15min":1.6739999999999999},"min":{"1min":1.0449999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.4319999999999999,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.8819999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":2.4020000000000001},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":2.081}]},{"osd":7,"last update":"Wed Mar 10 20:06:22 2021","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.677},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":2.3069999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.3400000000000001,"15min":1.3240000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.448,"15min":1.4339999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":1.028}]},{"osd":1,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.143,"15min":1.131},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1779999999999999,"15min":1.1759999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.2480000000000002,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.252}]},{"osd":2,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.335,"15min":1.325},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.879},{"interface":"front","average":{"1min":1.238,"5min":1.157,"15min":1.143},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Wed Mar 10 20:06:11 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.2509999999999999,"15min":1.2290000000000001},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.387},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.194,"15min":1.2},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.7310000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1419999999999999}]},{"osd":5,"last update":"Wed Mar 10 20:06:34 2021","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":0.78800000000000003,"15min":0.72599999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":0.93500000000000005,"15min":0.84999999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":2.5230000000000001},"last":1.6599999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:06:17 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.9990000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:06:21 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.881},{"interface":"front","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.8149999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049084,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031300,"statfs":{"total":90194313216,"available":89120051200,"internally_reserved":1073741824,"allocated":512000,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.534,"15min":1.591},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.327,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.3939999999999999,"15min":1.423},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3330000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.361,"15min":1.403},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.7969999999999999,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.296},{"interface":"front","average":{"1min":1.276,"5min":1.556,"15min":1.603},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.2290000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.93300000000000005}]},{"osd":2,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.655,"15min":1.712},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.444,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.3899999999999999,"15min":1.4350000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.0489999999999999,"5min":2.073,"15min":2.073},"last":1.0600000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.401,"15min":1.403},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.367},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.6240000000000001,"15min":1.6759999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.4700000000000002,"5min":2.488,"15min":2.488},"last":1.8260000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:06:31 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":0.93100000000000005,"15min":0.89900000000000002},"min":{"1min":0.20699999999999999,"5min":0.189,"15min":0.189},"max":{"1min":2.3490000000000002,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0409999999999999,"15min":1.0289999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.9330000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:06:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.409}]},{"osd":7,"last update":"Wed Mar 10 20:06:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.728},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":2.016}]}]}]}} 2021-03-10T20:07:02.435 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-03-10T20:07:02.436 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-10T20:07:02.436 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-03-10T20:07:02.436 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -- ceph health --format=json 2021-03-10T20:07:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:02 gibba004 bash[9777]: audit 2021-03-10T20:07:01.885434+0000 mgr.y (mgr.14140) 227 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:07:02.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:02 gibba004 bash[12967]: audit 2021-03-10T20:07:01.885434+0000 mgr.y (mgr.14140) 227 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:07:02.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:02 gibba009 bash[9804]: audit 2021-03-10T20:07:01.885434+0000 mgr.y (mgr.14140) 227 : audit [DBG] from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:07:03.631 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:03 gibba004 bash[9777]: cluster 2021-03-10T20:07:02.390507+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:03.632 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:03 gibba004 bash[12967]: cluster 2021-03-10T20:07:02.390507+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:03.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:03 gibba009 bash[9804]: cluster 2021-03-10T20:07:02.390507+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:05.011 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-03-10T20:07:05.638 INFO:teuthology.orchestra.run.gibba004.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-10T20:07:05.638 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-03-10T20:07:05.639 INFO:tasks.cephadm:Setup complete, yielding 2021-03-10T20:07:05.639 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T20:07:05.648 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba004.front.sepia.ceph.com 2021-03-10T20:07:05.649 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2021-03-10T20:07:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:05 gibba004 bash[9777]: cluster 2021-03-10T20:07:04.391489+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:05 gibba004 bash[9777]: audit 2021-03-10T20:07:05.011121+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.104:0/1974121847' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:07:05.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:05 gibba004 bash[12967]: cluster 2021-03-10T20:07:04.391489+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:05 gibba004 bash[12967]: audit 2021-03-10T20:07:05.011121+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.104:0/1974121847' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:07:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:05 gibba009 bash[9804]: cluster 2021-03-10T20:07:04.391489+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:05 gibba009 bash[9804]: audit 2021-03-10T20:07:05.011121+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.104:0/1974121847' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:07:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:07 gibba004 bash[9777]: cluster 2021-03-10T20:07:06.392169+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:07 gibba004 bash[12967]: cluster 2021-03-10T20:07:06.392169+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:07 gibba009 bash[9804]: cluster 2021-03-10T20:07:06.392169+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:09.561 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:07:09.561 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "4a438c4b-d31f-4f2d-95e6-1424036f720c", 2021-03-10T20:07:09.561 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "r", 2021-03-10T20:07:09.561 INFO:teuthology.orchestra.run.gibba004.stdout: "current_period": "370a8a08-38f0-4191-ac3d-11245296fe0a", 2021-03-10T20:07:09.562 INFO:teuthology.orchestra.run.gibba004.stdout: "epoch": 1 2021-03-10T20:07:09.562 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:07:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[9777]: cluster 2021-03-10T20:07:08.392978+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[9777]: cluster 2021-03-10T20:07:08.534194+0000 mon.a (mon.0) 581 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:07:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[9777]: audit 2021-03-10T20:07:08.534866+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.104:0/1251547559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[9777]: audit 2021-03-10T20:07:08.537889+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:09.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[12967]: cluster 2021-03-10T20:07:08.392978+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[12967]: cluster 2021-03-10T20:07:08.534194+0000 mon.a (mon.0) 581 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:07:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[12967]: audit 2021-03-10T20:07:08.534866+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.104:0/1251547559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:09.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:09 gibba004 bash[12967]: audit 2021-03-10T20:07:08.537889+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:09 gibba009 bash[9804]: cluster 2021-03-10T20:07:08.392978+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 4.0 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:09 gibba009 bash[9804]: cluster 2021-03-10T20:07:08.534194+0000 mon.a (mon.0) 581 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:07:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:09 gibba009 bash[9804]: audit 2021-03-10T20:07:08.534866+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.104:0/1251547559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:09.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:09 gibba009 bash[9804]: audit 2021-03-10T20:07:08.537889+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:07:10.210 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2021-03-10T20:07:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:10 gibba004 bash[9777]: audit 2021-03-10T20:07:09.538792+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:07:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:10 gibba004 bash[9777]: cluster 2021-03-10T20:07:09.538857+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:07:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:10 gibba004 bash[12967]: audit 2021-03-10T20:07:09.538792+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:07:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:10 gibba004 bash[12967]: cluster 2021-03-10T20:07:09.538857+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:07:10.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:10 gibba009 bash[9804]: audit 2021-03-10T20:07:09.538792+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:07:10.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:10 gibba009 bash[9804]: cluster 2021-03-10T20:07:09.538857+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:07:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:11 gibba004 bash[9777]: cluster 2021-03-10T20:07:10.393829+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v223: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 70 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 127 B/s wr, 0 op/s 2021-03-10T20:07:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:11 gibba004 bash[9777]: cluster 2021-03-10T20:07:10.553776+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:07:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:11 gibba004 bash[12967]: cluster 2021-03-10T20:07:10.393829+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v223: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 70 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 127 B/s wr, 0 op/s 2021-03-10T20:07:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:11 gibba004 bash[12967]: cluster 2021-03-10T20:07:10.553776+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:07:11.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:11 gibba009 bash[9804]: cluster 2021-03-10T20:07:10.393829+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v223: 33 pgs: 11 creating+peering, 18 unknown, 4 active+clean; 70 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 127 B/s wr, 0 op/s 2021-03-10T20:07:11.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:11 gibba009 bash[9804]: cluster 2021-03-10T20:07:10.553776+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:07:12.859 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:07:12.859 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "711ab5d9-102c-4400-a178-2945137abbaf", 2021-03-10T20:07:12.859 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "default", 2021-03-10T20:07:12.860 INFO:teuthology.orchestra.run.gibba004.stdout: "api_name": "default", 2021-03-10T20:07:12.860 INFO:teuthology.orchestra.run.gibba004.stdout: "is_master": "true", 2021-03-10T20:07:12.860 INFO:teuthology.orchestra.run.gibba004.stdout: "endpoints": [], 2021-03-10T20:07:12.860 INFO:teuthology.orchestra.run.gibba004.stdout: "hostnames": [], 2021-03-10T20:07:12.861 INFO:teuthology.orchestra.run.gibba004.stdout: "hostnames_s3website": [], 2021-03-10T20:07:12.861 INFO:teuthology.orchestra.run.gibba004.stdout: "master_zone": "", 2021-03-10T20:07:12.861 INFO:teuthology.orchestra.run.gibba004.stdout: "zones": [], 2021-03-10T20:07:12.861 INFO:teuthology.orchestra.run.gibba004.stdout: "placement_targets": [], 2021-03-10T20:07:12.861 INFO:teuthology.orchestra.run.gibba004.stdout: "default_placement": "", 2021-03-10T20:07:12.862 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_id": "4a438c4b-d31f-4f2d-95e6-1424036f720c", 2021-03-10T20:07:12.862 INFO:teuthology.orchestra.run.gibba004.stdout: "sync_policy": { 2021-03-10T20:07:12.862 INFO:teuthology.orchestra.run.gibba004.stdout: "groups": [] 2021-03-10T20:07:12.862 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:12.863 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:07:13.540 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2021-03-10T20:07:13.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:13 gibba004 bash[9777]: cluster 2021-03-10T20:07:12.394682+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 11 creating+peering, 7 unknown, 15 active+clean; 506 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T20:07:13.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:13 gibba004 bash[12967]: cluster 2021-03-10T20:07:12.394682+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 11 creating+peering, 7 unknown, 15 active+clean; 506 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T20:07:13.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:13 gibba009 bash[9804]: cluster 2021-03-10T20:07:12.394682+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 11 creating+peering, 7 unknown, 15 active+clean; 506 B data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T20:07:15.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:15 gibba004 bash[9777]: cluster 2021-03-10T20:07:14.395691+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 1 creating+peering, 32 active+clean; 726 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:16.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:15 gibba004 bash[12967]: cluster 2021-03-10T20:07:14.395691+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 1 creating+peering, 32 active+clean; 726 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:16.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:15 gibba009 bash[9804]: cluster 2021-03-10T20:07:14.395691+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 1 creating+peering, 32 active+clean; 726 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:16.342 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:07:16.343 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "c5285fa2-d363-4a8c-9393-a6c4747f3648", 2021-03-10T20:07:16.343 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "z", 2021-03-10T20:07:16.344 INFO:teuthology.orchestra.run.gibba004.stdout: "domain_root": "z.rgw.meta:root", 2021-03-10T20:07:16.344 INFO:teuthology.orchestra.run.gibba004.stdout: "control_pool": "z.rgw.control", 2021-03-10T20:07:16.344 INFO:teuthology.orchestra.run.gibba004.stdout: "gc_pool": "z.rgw.log:gc", 2021-03-10T20:07:16.344 INFO:teuthology.orchestra.run.gibba004.stdout: "lc_pool": "z.rgw.log:lc", 2021-03-10T20:07:16.345 INFO:teuthology.orchestra.run.gibba004.stdout: "log_pool": "z.rgw.log", 2021-03-10T20:07:16.345 INFO:teuthology.orchestra.run.gibba004.stdout: "intent_log_pool": "z.rgw.log:intent", 2021-03-10T20:07:16.345 INFO:teuthology.orchestra.run.gibba004.stdout: "usage_log_pool": "z.rgw.log:usage", 2021-03-10T20:07:16.345 INFO:teuthology.orchestra.run.gibba004.stdout: "roles_pool": "z.rgw.meta:roles", 2021-03-10T20:07:16.346 INFO:teuthology.orchestra.run.gibba004.stdout: "reshard_pool": "z.rgw.log:reshard", 2021-03-10T20:07:16.346 INFO:teuthology.orchestra.run.gibba004.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2021-03-10T20:07:16.346 INFO:teuthology.orchestra.run.gibba004.stdout: "user_email_pool": "z.rgw.meta:users.email", 2021-03-10T20:07:16.347 INFO:teuthology.orchestra.run.gibba004.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2021-03-10T20:07:16.347 INFO:teuthology.orchestra.run.gibba004.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2021-03-10T20:07:16.347 INFO:teuthology.orchestra.run.gibba004.stdout: "otp_pool": "z.rgw.otp", 2021-03-10T20:07:16.347 INFO:teuthology.orchestra.run.gibba004.stdout: "system_key": { 2021-03-10T20:07:16.348 INFO:teuthology.orchestra.run.gibba004.stdout: "access_key": "", 2021-03-10T20:07:16.348 INFO:teuthology.orchestra.run.gibba004.stdout: "secret_key": "" 2021-03-10T20:07:16.348 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:07:16.348 INFO:teuthology.orchestra.run.gibba004.stdout: "placement_pools": [ 2021-03-10T20:07:16.348 INFO:teuthology.orchestra.run.gibba004.stdout: { 2021-03-10T20:07:16.349 INFO:teuthology.orchestra.run.gibba004.stdout: "key": "default-placement", 2021-03-10T20:07:16.349 INFO:teuthology.orchestra.run.gibba004.stdout: "val": { 2021-03-10T20:07:16.349 INFO:teuthology.orchestra.run.gibba004.stdout: "index_pool": "z.rgw.buckets.index", 2021-03-10T20:07:16.349 INFO:teuthology.orchestra.run.gibba004.stdout: "storage_classes": { 2021-03-10T20:07:16.350 INFO:teuthology.orchestra.run.gibba004.stdout: "STANDARD": { 2021-03-10T20:07:16.350 INFO:teuthology.orchestra.run.gibba004.stdout: "data_pool": "z.rgw.buckets.data" 2021-03-10T20:07:16.350 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:16.351 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:07:16.351 INFO:teuthology.orchestra.run.gibba004.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2021-03-10T20:07:16.351 INFO:teuthology.orchestra.run.gibba004.stdout: "index_type": 0 2021-03-10T20:07:16.351 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:16.351 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:16.352 INFO:teuthology.orchestra.run.gibba004.stdout: ], 2021-03-10T20:07:16.352 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_id": "4a438c4b-d31f-4f2d-95e6-1424036f720c" 2021-03-10T20:07:16.352 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:07:16.994 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2021-03-10T20:07:17.914 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:17 gibba004 bash[9777]: cluster 2021-03-10T20:07:16.396517+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 772 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 260 B/s rd, 1.4 KiB/s wr, 2 op/s 2021-03-10T20:07:17.915 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:17 gibba004 bash[12967]: cluster 2021-03-10T20:07:16.396517+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 772 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 260 B/s rd, 1.4 KiB/s wr, 2 op/s 2021-03-10T20:07:18.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:17 gibba009 bash[9804]: cluster 2021-03-10T20:07:16.396517+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 772 B data, 4.3 MiB used, 664 GiB / 672 GiB avail; 260 B/s rd, 1.4 KiB/s wr, 2 op/s 2021-03-10T20:07:20.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:19 gibba004 bash[9777]: cluster 2021-03-10T20:07:18.397487+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.6 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 346 B/s rd, 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:20.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:19 gibba004 bash[12967]: cluster 2021-03-10T20:07:18.397487+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.6 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 346 B/s rd, 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:20.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:19 gibba009 bash[9804]: cluster 2021-03-10T20:07:18.397487+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.6 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 346 B/s rd, 1.7 KiB/s wr, 2 op/s 2021-03-10T20:07:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[9777]: cluster 2021-03-10T20:07:20.398396+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T20:07:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[9777]: cluster 2021-03-10T20:07:20.615248+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:07:22.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[9777]: audit 2021-03-10T20:07:20.618288+0000 mon.a (mon.0) 587 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:07:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[12967]: cluster 2021-03-10T20:07:20.398396+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T20:07:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[12967]: cluster 2021-03-10T20:07:20.615248+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:07:22.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:21 gibba004 bash[12967]: audit 2021-03-10T20:07:20.618288+0000 mon.a (mon.0) 587 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:07:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:21 gibba009 bash[9804]: cluster 2021-03-10T20:07:20.398396+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.5 KiB/s wr, 2 op/s 2021-03-10T20:07:22.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:21 gibba009 bash[9804]: cluster 2021-03-10T20:07:20.615248+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:07:22.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:21 gibba009 bash[9804]: audit 2021-03-10T20:07:20.618288+0000 mon.a (mon.0) 587 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:07:23.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:22 gibba004 bash[9777]: audit 2021-03-10T20:07:21.626924+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:07:23.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:22 gibba004 bash[9777]: cluster 2021-03-10T20:07:21.626999+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:07:23.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:22 gibba004 bash[12967]: audit 2021-03-10T20:07:21.626924+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:07:23.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:22 gibba004 bash[12967]: cluster 2021-03-10T20:07:21.626999+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:07:23.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:22 gibba009 bash[9804]: audit 2021-03-10T20:07:21.626924+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:07:23.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:22 gibba009 bash[9804]: cluster 2021-03-10T20:07:21.626999+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:07:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[9777]: cluster 2021-03-10T20:07:22.399170+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v232: 65 pgs: 8 creating+peering, 24 unknown, 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2021-03-10T20:07:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[9777]: cluster 2021-03-10T20:07:22.641869+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:07:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[9777]: audit 2021-03-10T20:07:22.642415+0000 mon.a (mon.0) 591 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:07:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[12967]: cluster 2021-03-10T20:07:22.399170+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v232: 65 pgs: 8 creating+peering, 24 unknown, 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2021-03-10T20:07:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[12967]: cluster 2021-03-10T20:07:22.641869+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:07:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:23 gibba004 bash[12967]: audit 2021-03-10T20:07:22.642415+0000 mon.a (mon.0) 591 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:07:24.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:23 gibba009 bash[9804]: cluster 2021-03-10T20:07:22.399170+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v232: 65 pgs: 8 creating+peering, 24 unknown, 33 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2021-03-10T20:07:24.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:23 gibba009 bash[9804]: cluster 2021-03-10T20:07:22.641869+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:07:24.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:23 gibba009 bash[9804]: audit 2021-03-10T20:07:22.642415+0000 mon.a (mon.0) 591 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:07:25.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:24 gibba004 bash[9777]: audit 2021-03-10T20:07:23.646543+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:07:25.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:24 gibba004 bash[9777]: cluster 2021-03-10T20:07:23.646658+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:07:25.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:24 gibba004 bash[12967]: audit 2021-03-10T20:07:23.646543+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:07:25.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:24 gibba004 bash[12967]: cluster 2021-03-10T20:07:23.646658+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:07:25.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:24 gibba009 bash[9804]: audit 2021-03-10T20:07:23.646543+0000 mon.a (mon.0) 592 : audit [INF] from='client.? 172.21.2.104:0/2169265772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:07:25.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:24 gibba009 bash[9804]: cluster 2021-03-10T20:07:23.646658+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:07:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[9777]: cluster 2021-03-10T20:07:24.400138+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v235: 97 pgs: 13 creating+peering, 36 unknown, 48 active+clean; 1.8 KiB data, 4.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-03-10T20:07:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[9777]: cluster 2021-03-10T20:07:24.657594+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:07:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[9777]: audit 2021-03-10T20:07:24.659725+0000 mon.a (mon.0) 595 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:07:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[9777]: audit 2021-03-10T20:07:25.661290+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:07:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[9777]: cluster 2021-03-10T20:07:25.661322+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:07:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[12967]: cluster 2021-03-10T20:07:24.400138+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v235: 97 pgs: 13 creating+peering, 36 unknown, 48 active+clean; 1.8 KiB data, 4.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-03-10T20:07:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[12967]: cluster 2021-03-10T20:07:24.657594+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:07:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[12967]: audit 2021-03-10T20:07:24.659725+0000 mon.a (mon.0) 595 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:07:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[12967]: audit 2021-03-10T20:07:25.661290+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:07:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:25 gibba004 bash[12967]: cluster 2021-03-10T20:07:25.661322+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:07:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:25 gibba009 bash[9804]: cluster 2021-03-10T20:07:24.400138+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v235: 97 pgs: 13 creating+peering, 36 unknown, 48 active+clean; 1.8 KiB data, 4.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 3 op/s 2021-03-10T20:07:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:25 gibba009 bash[9804]: cluster 2021-03-10T20:07:24.657594+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:07:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:25 gibba009 bash[9804]: audit 2021-03-10T20:07:24.659725+0000 mon.a (mon.0) 595 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:07:26.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:25 gibba009 bash[9804]: audit 2021-03-10T20:07:25.661290+0000 mon.a (mon.0) 596 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:07:26.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:25 gibba009 bash[9804]: cluster 2021-03-10T20:07:25.661322+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:07:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:26 gibba004 bash[9777]: audit 2021-03-10T20:07:25.663963+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:07:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:26 gibba004 bash[12967]: audit 2021-03-10T20:07:25.663963+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:07:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:26 gibba009 bash[9804]: audit 2021-03-10T20:07:25.663963+0000 mon.a (mon.0) 598 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:07:27.896 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:07:27.897 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "4102c49b-e46e-4740-8364-a3a43708db46", 2021-03-10T20:07:27.897 INFO:teuthology.orchestra.run.gibba004.stdout: "epoch": 1, 2021-03-10T20:07:27.897 INFO:teuthology.orchestra.run.gibba004.stdout: "predecessor_uuid": "370a8a08-38f0-4191-ac3d-11245296fe0a", 2021-03-10T20:07:27.898 INFO:teuthology.orchestra.run.gibba004.stdout: "sync_status": [], 2021-03-10T20:07:27.898 INFO:teuthology.orchestra.run.gibba004.stdout: "period_map": { 2021-03-10T20:07:27.898 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "4102c49b-e46e-4740-8364-a3a43708db46", 2021-03-10T20:07:27.898 INFO:teuthology.orchestra.run.gibba004.stdout: "zonegroups": [ 2021-03-10T20:07:27.899 INFO:teuthology.orchestra.run.gibba004.stdout: { 2021-03-10T20:07:27.899 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "711ab5d9-102c-4400-a178-2945137abbaf", 2021-03-10T20:07:27.899 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "default", 2021-03-10T20:07:27.899 INFO:teuthology.orchestra.run.gibba004.stdout: "api_name": "default", 2021-03-10T20:07:27.900 INFO:teuthology.orchestra.run.gibba004.stdout: "is_master": "true", 2021-03-10T20:07:27.900 INFO:teuthology.orchestra.run.gibba004.stdout: "endpoints": [], 2021-03-10T20:07:27.900 INFO:teuthology.orchestra.run.gibba004.stdout: "hostnames": [], 2021-03-10T20:07:27.900 INFO:teuthology.orchestra.run.gibba004.stdout: "hostnames_s3website": [], 2021-03-10T20:07:27.900 INFO:teuthology.orchestra.run.gibba004.stdout: "master_zone": "c5285fa2-d363-4a8c-9393-a6c4747f3648", 2021-03-10T20:07:27.901 INFO:teuthology.orchestra.run.gibba004.stdout: "zones": [ 2021-03-10T20:07:27.901 INFO:teuthology.orchestra.run.gibba004.stdout: { 2021-03-10T20:07:27.901 INFO:teuthology.orchestra.run.gibba004.stdout: "id": "c5285fa2-d363-4a8c-9393-a6c4747f3648", 2021-03-10T20:07:27.901 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "z", 2021-03-10T20:07:27.902 INFO:teuthology.orchestra.run.gibba004.stdout: "endpoints": [], 2021-03-10T20:07:27.906 INFO:teuthology.orchestra.run.gibba004.stdout: "log_meta": "false", 2021-03-10T20:07:27.906 INFO:teuthology.orchestra.run.gibba004.stdout: "log_data": "false", 2021-03-10T20:07:27.906 INFO:teuthology.orchestra.run.gibba004.stdout: "bucket_index_max_shards": 11, 2021-03-10T20:07:27.907 INFO:teuthology.orchestra.run.gibba004.stdout: "read_only": "false", 2021-03-10T20:07:27.907 INFO:teuthology.orchestra.run.gibba004.stdout: "tier_type": "", 2021-03-10T20:07:27.907 INFO:teuthology.orchestra.run.gibba004.stdout: "sync_from_all": "true", 2021-03-10T20:07:27.907 INFO:teuthology.orchestra.run.gibba004.stdout: "sync_from": [], 2021-03-10T20:07:27.907 INFO:teuthology.orchestra.run.gibba004.stdout: "redirect_zone": "" 2021-03-10T20:07:27.908 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.908 INFO:teuthology.orchestra.run.gibba004.stdout: ], 2021-03-10T20:07:27.908 INFO:teuthology.orchestra.run.gibba004.stdout: "placement_targets": [ 2021-03-10T20:07:27.908 INFO:teuthology.orchestra.run.gibba004.stdout: { 2021-03-10T20:07:27.909 INFO:teuthology.orchestra.run.gibba004.stdout: "name": "default-placement", 2021-03-10T20:07:27.909 INFO:teuthology.orchestra.run.gibba004.stdout: "tags": [], 2021-03-10T20:07:27.909 INFO:teuthology.orchestra.run.gibba004.stdout: "storage_classes": [ 2021-03-10T20:07:27.909 INFO:teuthology.orchestra.run.gibba004.stdout: "STANDARD" 2021-03-10T20:07:27.910 INFO:teuthology.orchestra.run.gibba004.stdout: ] 2021-03-10T20:07:27.910 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.910 INFO:teuthology.orchestra.run.gibba004.stdout: ], 2021-03-10T20:07:27.910 INFO:teuthology.orchestra.run.gibba004.stdout: "default_placement": "default-placement", 2021-03-10T20:07:27.911 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_id": "4a438c4b-d31f-4f2d-95e6-1424036f720c", 2021-03-10T20:07:27.911 INFO:teuthology.orchestra.run.gibba004.stdout: "sync_policy": { 2021-03-10T20:07:27.911 INFO:teuthology.orchestra.run.gibba004.stdout: "groups": [] 2021-03-10T20:07:27.911 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.911 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.912 INFO:teuthology.orchestra.run.gibba004.stdout: ], 2021-03-10T20:07:27.912 INFO:teuthology.orchestra.run.gibba004.stdout: "short_zone_ids": [ 2021-03-10T20:07:27.912 INFO:teuthology.orchestra.run.gibba004.stdout: { 2021-03-10T20:07:27.912 INFO:teuthology.orchestra.run.gibba004.stdout: "key": "c5285fa2-d363-4a8c-9393-a6c4747f3648", 2021-03-10T20:07:27.913 INFO:teuthology.orchestra.run.gibba004.stdout: "val": 41154515 2021-03-10T20:07:27.913 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.913 INFO:teuthology.orchestra.run.gibba004.stdout: ] 2021-03-10T20:07:27.913 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:07:27.914 INFO:teuthology.orchestra.run.gibba004.stdout: "master_zonegroup": "711ab5d9-102c-4400-a178-2945137abbaf", 2021-03-10T20:07:27.914 INFO:teuthology.orchestra.run.gibba004.stdout: "master_zone": "c5285fa2-d363-4a8c-9393-a6c4747f3648", 2021-03-10T20:07:27.914 INFO:teuthology.orchestra.run.gibba004.stdout: "period_config": { 2021-03-10T20:07:27.914 INFO:teuthology.orchestra.run.gibba004.stdout: "bucket_quota": { 2021-03-10T20:07:27.915 INFO:teuthology.orchestra.run.gibba004.stdout: "enabled": false, 2021-03-10T20:07:27.915 INFO:teuthology.orchestra.run.gibba004.stdout: "check_on_raw": false, 2021-03-10T20:07:27.915 INFO:teuthology.orchestra.run.gibba004.stdout: "max_size": -1, 2021-03-10T20:07:27.915 INFO:teuthology.orchestra.run.gibba004.stdout: "max_size_kb": 0, 2021-03-10T20:07:27.916 INFO:teuthology.orchestra.run.gibba004.stdout: "max_objects": -1 2021-03-10T20:07:27.916 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:07:27.917 INFO:teuthology.orchestra.run.gibba004.stdout: "user_quota": { 2021-03-10T20:07:27.917 INFO:teuthology.orchestra.run.gibba004.stdout: "enabled": false, 2021-03-10T20:07:27.917 INFO:teuthology.orchestra.run.gibba004.stdout: "check_on_raw": false, 2021-03-10T20:07:27.918 INFO:teuthology.orchestra.run.gibba004.stdout: "max_size": -1, 2021-03-10T20:07:27.918 INFO:teuthology.orchestra.run.gibba004.stdout: "max_size_kb": 0, 2021-03-10T20:07:27.918 INFO:teuthology.orchestra.run.gibba004.stdout: "max_objects": -1 2021-03-10T20:07:27.919 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:07:27.919 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:07:27.919 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_id": "4a438c4b-d31f-4f2d-95e6-1424036f720c", 2021-03-10T20:07:27.919 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_name": "r", 2021-03-10T20:07:27.919 INFO:teuthology.orchestra.run.gibba004.stdout: "realm_epoch": 2 2021-03-10T20:07:27.920 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:07:27.999 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[9777]: cluster 2021-03-10T20:07:26.401407+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v238: 129 pgs: 12 creating+peering, 31 unknown, 86 active+clean; 1.8 KiB data, 4.7 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-03-10T20:07:27.999 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[9777]: audit 2021-03-10T20:07:26.665131+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:07:27.999 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[9777]: cluster 2021-03-10T20:07:26.665166+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:07:28.000 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[9777]: audit 2021-03-10T20:07:26.665982+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:07:28.000 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[12967]: cluster 2021-03-10T20:07:26.401407+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v238: 129 pgs: 12 creating+peering, 31 unknown, 86 active+clean; 1.8 KiB data, 4.7 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-03-10T20:07:28.000 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[12967]: audit 2021-03-10T20:07:26.665131+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:07:28.001 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[12967]: cluster 2021-03-10T20:07:26.665166+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:07:28.001 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:27 gibba004 bash[12967]: audit 2021-03-10T20:07:26.665982+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:07:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:27 gibba009 bash[9804]: cluster 2021-03-10T20:07:26.401407+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v238: 129 pgs: 12 creating+peering, 31 unknown, 86 active+clean; 1.8 KiB data, 4.7 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-03-10T20:07:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:27 gibba009 bash[9804]: audit 2021-03-10T20:07:26.665131+0000 mon.a (mon.0) 599 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:07:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:27 gibba009 bash[9804]: cluster 2021-03-10T20:07:26.665166+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:07:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:27 gibba009 bash[9804]: audit 2021-03-10T20:07:26.665982+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:07:28.698 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch apply rgw r z --placement=2' 2021-03-10T20:07:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:28 gibba004 bash[12967]: audit 2021-03-10T20:07:27.670496+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:07:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:28 gibba004 bash[12967]: cluster 2021-03-10T20:07:27.670530+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T20:07:29.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:28 gibba004 bash[9777]: audit 2021-03-10T20:07:27.670496+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:07:29.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:28 gibba004 bash[9777]: cluster 2021-03-10T20:07:27.670530+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T20:07:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:28 gibba009 bash[9804]: audit 2021-03-10T20:07:27.670496+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.2.104:0/713540461' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:07:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:28 gibba009 bash[9804]: cluster 2021-03-10T20:07:27.670530+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-03-10T20:07:29.904 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:29 gibba004 bash[12967]: cluster 2021-03-10T20:07:28.402514+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v241: 129 pgs: 9 creating+peering, 16 unknown, 104 active+clean; 1.8 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 op/s 2021-03-10T20:07:29.905 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:29 gibba004 bash[9777]: cluster 2021-03-10T20:07:28.402514+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v241: 129 pgs: 9 creating+peering, 16 unknown, 104 active+clean; 1.8 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 op/s 2021-03-10T20:07:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:29 gibba009 bash[9804]: cluster 2021-03-10T20:07:28.402514+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v241: 129 pgs: 9 creating+peering, 16 unknown, 104 active+clean; 1.8 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 op/s 2021-03-10T20:07:31.410 INFO:teuthology.orchestra.run.gibba004.stdout:Scheduled rgw update... 2021-03-10T20:07:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: cluster 2021-03-10T20:07:30.403579+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 5.7 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail; 712 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:07:31.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.403870+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:07:31.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.407514+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:07:31.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.409304+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:07:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.418108+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:07:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.419141+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:07:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.422212+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:07:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.423088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:07:31.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.426171+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:07:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.427064+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.429680+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.430461+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:31.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[9777]: audit 2021-03-10T20:07:31.431312+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba009.xbhxrc", "key": "container_image"}]: dispatch 2021-03-10T20:07:31.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: cluster 2021-03-10T20:07:30.403579+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 5.7 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail; 712 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:07:31.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.403870+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:07:31.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.407514+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:07:31.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.409304+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:07:31.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.418108+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:07:31.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.419141+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:07:31.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.422212+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:07:31.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.423088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:07:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.426171+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:07:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.427064+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.429680+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.430461+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:31.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:31 gibba004 bash[12967]: audit 2021-03-10T20:07:31.431312+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba009.xbhxrc", "key": "container_image"}]: dispatch 2021-03-10T20:07:31.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: cluster 2021-03-10T20:07:30.403579+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 5.7 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail; 712 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:07:31.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.403870+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:07:31.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.407514+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:07:31.403613\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:07:31.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.409304+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:07:31.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.418108+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:07:31.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.419141+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:07:31.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.422212+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:07:31.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.423088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:07:31.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.426171+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:07:31.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.427064+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:31.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.429680+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:31.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.430461+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:31.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:31 gibba009 bash[9804]: audit 2021-03-10T20:07:31.431312+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba009.xbhxrc", "key": "container_image"}]: dispatch 2021-03-10T20:07:32.059 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'sleep 120' 2021-03-10T20:07:32.787 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:32 gibba009 bash[9804]: audit 2021-03-10T20:07:31.403257+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:32.787 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:32 gibba009 bash[9804]: cephadm 2021-03-10T20:07:31.403600+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:07:32.787 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:32 gibba009 bash[9804]: cephadm 2021-03-10T20:07:31.431126+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Deploying daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:07:32.998 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[9777]: audit 2021-03-10T20:07:31.403257+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:32.998 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[9777]: cephadm 2021-03-10T20:07:31.403600+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:07:32.998 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[9777]: cephadm 2021-03-10T20:07:31.431126+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Deploying daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:07:32.999 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[12967]: audit 2021-03-10T20:07:31.403257+0000 mgr.y (mgr.14140) 243 : audit [DBG] from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:32.999 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[12967]: cephadm 2021-03-10T20:07:31.403600+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:07:32.999 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:32 gibba004 bash[12967]: cephadm 2021-03-10T20:07:31.431126+0000 mgr.y (mgr.14140) 245 : cephadm [INF] Deploying daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:07:33.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: cluster 2021-03-10T20:07:32.405102+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 6.8 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.5 KiB/s wr, 20 op/s 2021-03-10T20:07:33.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.537245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:33.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.547022+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:33.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.547441+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:33.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.549894+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:33.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.550335+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:33.848 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:33 gibba009 bash[9804]: audit 2021-03-10T20:07:33.551132+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba004.fosjgj", "key": "container_image"}]: dispatch 2021-03-10T20:07:34.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: cluster 2021-03-10T20:07:32.405102+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 6.8 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.5 KiB/s wr, 20 op/s 2021-03-10T20:07:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: cluster 2021-03-10T20:07:32.405102+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 6.8 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.5 KiB/s wr, 20 op/s 2021-03-10T20:07:34.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.537245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:34.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.537245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.547022+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.547441+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:34.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.549894+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:34.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.550335+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:34.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[9777]: audit 2021-03-10T20:07:33.551132+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba004.fosjgj", "key": "container_image"}]: dispatch 2021-03-10T20:07:34.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.547022+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.297941\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298239\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298426\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298585\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298740\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.298891\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299043\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299195\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299346\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:11.299498\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:34.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.547441+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:07:34.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.549894+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:07:34.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.550335+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:07:34.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:33 gibba004 bash[12967]: audit 2021-03-10T20:07:33.551132+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba004.fosjgj", "key": "container_image"}]: dispatch 2021-03-10T20:07:35.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:34 gibba009 bash[9804]: cephadm 2021-03-10T20:07:33.550915+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Deploying daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:07:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:34 gibba004 bash[9777]: cephadm 2021-03-10T20:07:33.550915+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Deploying daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:07:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:34 gibba004 bash[12967]: cephadm 2021-03-10T20:07:33.550915+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Deploying daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:07:35.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:35 gibba009 bash[9804]: cluster 2021-03-10T20:07:34.406928+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T20:07:36.034 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:35 gibba004 bash[9777]: cluster 2021-03-10T20:07:34.406928+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T20:07:36.035 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:35 gibba004 bash[12967]: cluster 2021-03-10T20:07:34.406928+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T20:07:37.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[9777]: audit 2021-03-10T20:07:36.210385+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:37.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[9777]: audit 2021-03-10T20:07:36.214165+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:37.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[9777]: audit 2021-03-10T20:07:36.214741+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:37.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[12967]: audit 2021-03-10T20:07:36.210385+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:37.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[12967]: audit 2021-03-10T20:07:36.214165+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:37.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:36 gibba004 bash[12967]: audit 2021-03-10T20:07:36.214741+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:37.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:36 gibba009 bash[9804]: audit 2021-03-10T20:07:36.210385+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:37.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:36 gibba009 bash[9804]: audit 2021-03-10T20:07:36.214165+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976485\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976584\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976646\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976689\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976731\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976773\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976815\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976857\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:06:09.976898\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:37.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:36 gibba009 bash[9804]: audit 2021-03-10T20:07:36.214741+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:38.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: cluster 2021-03-10T20:07:36.407419+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2021-03-10T20:07:38.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: cluster 2021-03-10T20:07:36.407419+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2021-03-10T20:07:38.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: audit 2021-03-10T20:07:37.323806+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:38.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: audit 2021-03-10T20:07:37.323806+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:38.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: audit 2021-03-10T20:07:37.326943+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:38.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: audit 2021-03-10T20:07:37.327463+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:38.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: audit 2021-03-10T20:07:37.326943+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:38.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: audit 2021-03-10T20:07:37.327463+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:38.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: audit 2021-03-10T20:07:38.194128+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:38.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[9777]: audit 2021-03-10T20:07:38.203764+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:38.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: audit 2021-03-10T20:07:38.194128+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:38.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:38 gibba004 bash[12967]: audit 2021-03-10T20:07:38.203764+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:38.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: cluster 2021-03-10T20:07:36.407419+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2021-03-10T20:07:38.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: audit 2021-03-10T20:07:37.323806+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]: dispatch 2021-03-10T20:07:38.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: audit 2021-03-10T20:07:37.326943+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322765\", \"created\": \"2021-03-10T20:00:34.686383\", \"started\": \"2021-03-10T20:00:40.144559\"}, \"mgr.y\": {\"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322827\", \"created\": \"2021-03-10T20:00:42.230383\", \"started\": \"2021-03-10T20:00:42.258489\"}, \"mon.c\": {\"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322857\", \"created\": \"2021-03-10T20:01:47.270382\", \"started\": \"2021-03-10T20:01:47.294835\"}, \"osd.0\": {\"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322885\", \"created\": \"2021-03-10T20:02:33.318381\", \"started\": \"2021-03-10T20:02:36.701989\"}, \"osd.1\": {\"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322913\", \"created\": \"2021-03-10T20:02:56.010381\", \"started\": \"2021-03-10T20:02:59.615574\"}, \"osd.2\": {\"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322940\", \"created\": \"2021-03-10T20:03:17.962380\", \"started\": \"2021-03-10T20:03:21.995754\"}, \"osd.3\": {\"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322967\", \"created\": \"2021-03-10T20:03:41.346689\", \"started\": \"2021-03-10T20:03:44.651944\"}, \"node-exporter.a\": {\"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.322994\", \"created\": \"2021-03-10T20:05:31.310687\", \"started\": \"2021-03-10T20:05:33.944063\"}, \"alertmanager.a\": {\"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323021\", \"created\": \"2021-03-10T20:05:41.606687\", \"started\": \"2021-03-10T20:06:02.652351\"}, \"rgw.r.z.gibba004.fosjgj\": {\"hostname\": \"gibba004\", \"container_id\": \"6cfa7fc37d5e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:37.323048\", \"created\": \"2021-03-10T20:07:36.194685\", \"started\": \"2021-03-10T20:07:36.223805\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215\"}}, \"last_daemon_update\": \"2021-03-10T20:07:37.323113\", \"last_device_update\": \"2021-03-10T20:03:48.056286\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068\"}"}]': finished 2021-03-10T20:07:38.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: audit 2021-03-10T20:07:37.327463+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:07:38.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: audit 2021-03-10T20:07:38.194128+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:07:38.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:38 gibba009 bash[9804]: audit 2021-03-10T20:07:38.203764+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"e79934c98f1b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188983\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:02:15.293727\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:13.196624\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:07:38.190703\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:07:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:40 gibba004 bash[9777]: cluster 2021-03-10T20:07:38.408674+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2021-03-10T20:07:40.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:40 gibba004 bash[12967]: cluster 2021-03-10T20:07:38.408674+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2021-03-10T20:07:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:40 gibba009 bash[9804]: cluster 2021-03-10T20:07:38.408674+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2021-03-10T20:07:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:42 gibba004 bash[9777]: cluster 2021-03-10T20:07:40.410521+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 3.3 KiB/s wr, 17 op/s 2021-03-10T20:07:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:42 gibba004 bash[12967]: cluster 2021-03-10T20:07:40.410521+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 3.3 KiB/s wr, 17 op/s 2021-03-10T20:07:42.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:42 gibba009 bash[9804]: cluster 2021-03-10T20:07:40.410521+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 3.3 KiB/s wr, 17 op/s 2021-03-10T20:07:43.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:43 gibba004 bash[9777]: cluster 2021-03-10T20:07:42.411754+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2021-03-10T20:07:43.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:43 gibba004 bash[12967]: cluster 2021-03-10T20:07:42.411754+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2021-03-10T20:07:43.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:43 gibba009 bash[9804]: cluster 2021-03-10T20:07:42.411754+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2021-03-10T20:07:45.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:45 gibba004 bash[9777]: cluster 2021-03-10T20:07:44.413324+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 341 B/s wr, 7 op/s 2021-03-10T20:07:45.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:45 gibba004 bash[12967]: cluster 2021-03-10T20:07:44.413324+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 341 B/s wr, 7 op/s 2021-03-10T20:07:45.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:45 gibba009 bash[9804]: cluster 2021-03-10T20:07:44.413324+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 341 B/s wr, 7 op/s 2021-03-10T20:07:47.731 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:47 gibba004 bash[9777]: cluster 2021-03-10T20:07:46.414906+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:47.732 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:47 gibba004 bash[12967]: cluster 2021-03-10T20:07:46.414906+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:47.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:47 gibba009 bash[9804]: cluster 2021-03-10T20:07:46.414906+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:49 gibba004 bash[9777]: cluster 2021-03-10T20:07:48.416053+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:49 gibba004 bash[12967]: cluster 2021-03-10T20:07:48.416053+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:49.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:49 gibba009 bash[9804]: cluster 2021-03-10T20:07:48.416053+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:07:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:51 gibba004 bash[9777]: cluster 2021-03-10T20:07:50.417678+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 7 op/s 2021-03-10T20:07:51.994 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:51 gibba004 bash[12967]: cluster 2021-03-10T20:07:50.417678+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 7 op/s 2021-03-10T20:07:51.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:51 gibba009 bash[9804]: cluster 2021-03-10T20:07:50.417678+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 7 op/s 2021-03-10T20:07:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:53 gibba004 bash[9777]: cluster 2021-03-10T20:07:52.418833+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:07:53.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:53 gibba004 bash[12967]: cluster 2021-03-10T20:07:52.418833+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:07:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:53 gibba009 bash[9804]: cluster 2021-03-10T20:07:52.418833+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:07:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:55 gibba004 bash[9777]: cluster 2021-03-10T20:07:54.420391+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:55.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:55 gibba004 bash[12967]: cluster 2021-03-10T20:07:54.420391+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:55 gibba009 bash[9804]: cluster 2021-03-10T20:07:54.420391+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:57 gibba004 bash[9777]: cluster 2021-03-10T20:07:56.420896+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:57 gibba004 bash[12967]: cluster 2021-03-10T20:07:56.420896+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:57 gibba009 bash[9804]: cluster 2021-03-10T20:07:56.420896+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:59.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:07:59 gibba004 bash[9777]: cluster 2021-03-10T20:07:58.421860+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:59.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:07:59 gibba004 bash[12967]: cluster 2021-03-10T20:07:58.421860+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:59.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:07:59 gibba009 bash[9804]: cluster 2021-03-10T20:07:58.421860+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:01.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:01 gibba004 bash[9777]: cluster 2021-03-10T20:08:00.423508+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:01.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:01 gibba004 bash[12967]: cluster 2021-03-10T20:08:00.423508+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:01.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:01 gibba009 bash[9804]: cluster 2021-03-10T20:08:00.423508+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:03 gibba004 bash[9777]: cluster 2021-03-10T20:08:02.424839+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:03.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:03 gibba004 bash[12967]: cluster 2021-03-10T20:08:02.424839+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:03 gibba009 bash[9804]: cluster 2021-03-10T20:08:02.424839+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:05 gibba004 bash[9777]: cluster 2021-03-10T20:08:04.426277+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:05.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:05 gibba004 bash[12967]: cluster 2021-03-10T20:08:04.426277+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:05 gibba009 bash[9804]: cluster 2021-03-10T20:08:04.426277+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:07 gibba004 bash[9777]: cluster 2021-03-10T20:08:06.427567+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:07 gibba004 bash[12967]: cluster 2021-03-10T20:08:06.427567+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:07.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:07 gibba009 bash[9804]: cluster 2021-03-10T20:08:06.427567+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:09.788 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:09 gibba004 bash[12967]: cluster 2021-03-10T20:08:08.428986+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:09.788 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:09 gibba004 bash[9777]: cluster 2021-03-10T20:08:08.428986+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:09 gibba009 bash[9804]: cluster 2021-03-10T20:08:08.428986+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:11 gibba004 bash[9777]: cluster 2021-03-10T20:08:10.430671+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:11 gibba004 bash[12967]: cluster 2021-03-10T20:08:10.430671+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:11.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:11 gibba009 bash[9804]: cluster 2021-03-10T20:08:10.430671+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:13.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:13 gibba004 bash[9777]: cluster 2021-03-10T20:08:12.432033+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 4 op/s 2021-03-10T20:08:13.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:13 gibba004 bash[12967]: cluster 2021-03-10T20:08:12.432033+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 4 op/s 2021-03-10T20:08:13.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:13 gibba009 bash[9804]: cluster 2021-03-10T20:08:12.432033+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 4 op/s 2021-03-10T20:08:15.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:15 gibba004 bash[9777]: cluster 2021-03-10T20:08:14.433364+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:15.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:15 gibba004 bash[12967]: cluster 2021-03-10T20:08:14.433364+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:15.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:15 gibba009 bash[9804]: cluster 2021-03-10T20:08:14.433364+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:17 gibba004 bash[9777]: cluster 2021-03-10T20:08:16.434686+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:17.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:17 gibba004 bash[12967]: cluster 2021-03-10T20:08:16.434686+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:17 gibba009 bash[9804]: cluster 2021-03-10T20:08:16.434686+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:19.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:19 gibba004 bash[9777]: cluster 2021-03-10T20:08:18.435935+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:19.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:19 gibba004 bash[12967]: cluster 2021-03-10T20:08:18.435935+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:19.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:19 gibba009 bash[9804]: cluster 2021-03-10T20:08:18.435935+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:21.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:21 gibba004 bash[9777]: cluster 2021-03-10T20:08:20.437212+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:21 gibba004 bash[12967]: cluster 2021-03-10T20:08:20.437212+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:21.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:21 gibba009 bash[9804]: cluster 2021-03-10T20:08:20.437212+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:23.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:23 gibba004 bash[9777]: cluster 2021-03-10T20:08:22.438468+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:08:23.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:23 gibba004 bash[12967]: cluster 2021-03-10T20:08:22.438468+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:08:23.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:23 gibba009 bash[9804]: cluster 2021-03-10T20:08:22.438468+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:08:25.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:25 gibba004 bash[9777]: cluster 2021-03-10T20:08:24.440088+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:25.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:25 gibba004 bash[12967]: cluster 2021-03-10T20:08:24.440088+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:25.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:25 gibba009 bash[9804]: cluster 2021-03-10T20:08:24.440088+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:08:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:27 gibba004 bash[9777]: cluster 2021-03-10T20:08:26.440751+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:27.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:27 gibba004 bash[12967]: cluster 2021-03-10T20:08:26.440751+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:27.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:27 gibba009 bash[9804]: cluster 2021-03-10T20:08:26.440751+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:29.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:29 gibba004 bash[9777]: cluster 2021-03-10T20:08:28.442143+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:29.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:29 gibba004 bash[12967]: cluster 2021-03-10T20:08:28.442143+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:29.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:29 gibba009 bash[9804]: cluster 2021-03-10T20:08:28.442143+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:31.725 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:31 gibba004 bash[9777]: cluster 2021-03-10T20:08:30.443625+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:31.725 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:31 gibba004 bash[12967]: cluster 2021-03-10T20:08:30.443625+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:31.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:31 gibba009 bash[9804]: cluster 2021-03-10T20:08:30.443625+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:33.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:33 gibba004 bash[9777]: cluster 2021-03-10T20:08:32.444888+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:33 gibba004 bash[12967]: cluster 2021-03-10T20:08:32.444888+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:33.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:33 gibba009 bash[9804]: cluster 2021-03-10T20:08:32.444888+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:35.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:35 gibba004 bash[9777]: cluster 2021-03-10T20:08:34.446370+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:35.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:35 gibba004 bash[12967]: cluster 2021-03-10T20:08:34.446370+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:35.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:35 gibba009 bash[9804]: cluster 2021-03-10T20:08:34.446370+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:37.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:37 gibba004 bash[9777]: cluster 2021-03-10T20:08:36.446981+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:37.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:37 gibba004 bash[12967]: cluster 2021-03-10T20:08:36.446981+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:37.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:37 gibba009 bash[9804]: cluster 2021-03-10T20:08:36.446981+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:39 gibba004 bash[9777]: cluster 2021-03-10T20:08:38.448341+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:39.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:39 gibba004 bash[12967]: cluster 2021-03-10T20:08:38.448341+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:39.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:39 gibba009 bash[9804]: cluster 2021-03-10T20:08:38.448341+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:41 gibba004 bash[9777]: cluster 2021-03-10T20:08:40.449703+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:41 gibba004 bash[12967]: cluster 2021-03-10T20:08:40.449703+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:41.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:41 gibba009 bash[9804]: cluster 2021-03-10T20:08:40.449703+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:43.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:43 gibba004 bash[9777]: cluster 2021-03-10T20:08:42.450894+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:43.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:43 gibba004 bash[12967]: cluster 2021-03-10T20:08:42.450894+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:43 gibba009 bash[9804]: cluster 2021-03-10T20:08:42.450894+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:45.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:45 gibba004 bash[9777]: cluster 2021-03-10T20:08:44.452193+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:45.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:45 gibba004 bash[12967]: cluster 2021-03-10T20:08:44.452193+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:45.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:45 gibba009 bash[9804]: cluster 2021-03-10T20:08:44.452193+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:47.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:47 gibba004 bash[9777]: cluster 2021-03-10T20:08:46.452983+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:47.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:47 gibba004 bash[12967]: cluster 2021-03-10T20:08:46.452983+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:47.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:47 gibba009 bash[9804]: cluster 2021-03-10T20:08:46.452983+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:08:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:49 gibba004 bash[9777]: cluster 2021-03-10T20:08:48.454315+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:49 gibba004 bash[12967]: cluster 2021-03-10T20:08:48.454315+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:49.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:49 gibba009 bash[9804]: cluster 2021-03-10T20:08:48.454315+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:51 gibba004 bash[9777]: cluster 2021-03-10T20:08:50.455675+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:51.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:51 gibba004 bash[12967]: cluster 2021-03-10T20:08:50.455675+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:51.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:51 gibba009 bash[9804]: cluster 2021-03-10T20:08:50.455675+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:53.791 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:53 gibba004 bash[9777]: cluster 2021-03-10T20:08:52.457030+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:53.791 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:53 gibba004 bash[12967]: cluster 2021-03-10T20:08:52.457030+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:53.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:53 gibba009 bash[9804]: cluster 2021-03-10T20:08:52.457030+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:08:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:55 gibba004 bash[9777]: cluster 2021-03-10T20:08:54.458469+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:55.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:55 gibba004 bash[12967]: cluster 2021-03-10T20:08:54.458469+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:55 gibba009 bash[9804]: cluster 2021-03-10T20:08:54.458469+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:08:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:57 gibba004 bash[9777]: cluster 2021-03-10T20:08:56.458934+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:57 gibba004 bash[12967]: cluster 2021-03-10T20:08:56.458934+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:57 gibba009 bash[9804]: cluster 2021-03-10T20:08:56.458934+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:08:59.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:08:59 gibba004 bash[9777]: cluster 2021-03-10T20:08:58.460007+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:59.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:08:59 gibba004 bash[12967]: cluster 2021-03-10T20:08:58.460007+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:08:59.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:08:59 gibba009 bash[9804]: cluster 2021-03-10T20:08:58.460007+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:09:01.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:01 gibba004 bash[9777]: cluster 2021-03-10T20:09:00.461634+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:01.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:01 gibba004 bash[12967]: cluster 2021-03-10T20:09:00.461634+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:01.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:01 gibba009 bash[9804]: cluster 2021-03-10T20:09:00.461634+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:03 gibba004 bash[9777]: cluster 2021-03-10T20:09:02.463081+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:03.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:03 gibba004 bash[12967]: cluster 2021-03-10T20:09:02.463081+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:03 gibba009 bash[9804]: cluster 2021-03-10T20:09:02.463081+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:05 gibba004 bash[9777]: cluster 2021-03-10T20:09:04.464503+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:05 gibba004 bash[12967]: cluster 2021-03-10T20:09:04.464503+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:05.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:05 gibba009 bash[9804]: cluster 2021-03-10T20:09:04.464503+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:09:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:07 gibba004 bash[9777]: cluster 2021-03-10T20:09:06.464985+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:09:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:07 gibba004 bash[12967]: cluster 2021-03-10T20:09:06.464985+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:09:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:07 gibba009 bash[9804]: cluster 2021-03-10T20:09:06.464985+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:09:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:09 gibba004 bash[9777]: cluster 2021-03-10T20:09:08.466363+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:09:09.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:09 gibba004 bash[12967]: cluster 2021-03-10T20:09:08.466363+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:09:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:09 gibba009 bash[9804]: cluster 2021-03-10T20:09:08.466363+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:09:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:11 gibba004 bash[9777]: cluster 2021-03-10T20:09:10.467721+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:11 gibba004 bash[12967]: cluster 2021-03-10T20:09:10.467721+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:11 gibba009 bash[9804]: cluster 2021-03-10T20:09:10.467721+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:13.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:13 gibba004 bash[9777]: cluster 2021-03-10T20:09:12.469167+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:13.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:13 gibba004 bash[12967]: cluster 2021-03-10T20:09:12.469167+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:13.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:13 gibba009 bash[9804]: cluster 2021-03-10T20:09:12.469167+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:15.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:15 gibba004 bash[9777]: cluster 2021-03-10T20:09:14.470808+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:15.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:15 gibba004 bash[12967]: cluster 2021-03-10T20:09:14.470808+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:15.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:15 gibba009 bash[9804]: cluster 2021-03-10T20:09:14.470808+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:17 gibba004 bash[9777]: cluster 2021-03-10T20:09:16.471507+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:17.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:17 gibba004 bash[12967]: cluster 2021-03-10T20:09:16.471507+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:17 gibba009 bash[9804]: cluster 2021-03-10T20:09:16.471507+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:09:19.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:19 gibba004 bash[9777]: cluster 2021-03-10T20:09:18.472373+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:09:19.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:19 gibba004 bash[12967]: cluster 2021-03-10T20:09:18.472373+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:09:19.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:19 gibba009 bash[9804]: cluster 2021-03-10T20:09:18.472373+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:09:21.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:21 gibba004 bash[9777]: cluster 2021-03-10T20:09:20.473910+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:09:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:21 gibba004 bash[12967]: cluster 2021-03-10T20:09:20.473910+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:09:21.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:21 gibba009 bash[9804]: cluster 2021-03-10T20:09:20.473910+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:09:23.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:23 gibba004 bash[9777]: cluster 2021-03-10T20:09:22.475361+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:23.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:23 gibba004 bash[12967]: cluster 2021-03-10T20:09:22.475361+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:23.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:23 gibba009 bash[9804]: cluster 2021-03-10T20:09:22.475361+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:25.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:25 gibba004 bash[9777]: cluster 2021-03-10T20:09:24.476807+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:25.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:25 gibba004 bash[12967]: cluster 2021-03-10T20:09:24.476807+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:25.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:25 gibba009 bash[9804]: cluster 2021-03-10T20:09:24.476807+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:27 gibba004 bash[9777]: cluster 2021-03-10T20:09:26.477251+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:27.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:27 gibba004 bash[12967]: cluster 2021-03-10T20:09:26.477251+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:27 gibba009 bash[9804]: cluster 2021-03-10T20:09:26.477251+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:29.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:29 gibba004 bash[9777]: cluster 2021-03-10T20:09:28.478409+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:29.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:29 gibba004 bash[12967]: cluster 2021-03-10T20:09:28.478409+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:29.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:29 gibba009 bash[9804]: cluster 2021-03-10T20:09:28.478409+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:31 gibba004 bash[9777]: cluster 2021-03-10T20:09:30.480022+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:31.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:31 gibba004 bash[12967]: cluster 2021-03-10T20:09:30.480022+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:31.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:31 gibba009 bash[9804]: cluster 2021-03-10T20:09:30.480022+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:09:33.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:33 gibba004 bash[9777]: cluster 2021-03-10T20:09:32.481548+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:33 gibba004 bash[12967]: cluster 2021-03-10T20:09:32.481548+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:33 gibba009 bash[9804]: cluster 2021-03-10T20:09:32.481548+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:35.801 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:35 gibba004 bash[9777]: cluster 2021-03-10T20:09:34.483030+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:35.802 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:35 gibba004 bash[12967]: cluster 2021-03-10T20:09:34.483030+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:35.803 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-03-10T20:09:35.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:35 gibba009 bash[9804]: cluster 2021-03-10T20:09:34.483030+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:37.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:37 gibba004 bash[9777]: cluster 2021-03-10T20:09:36.483653+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:37.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:37 gibba004 bash[12967]: cluster 2021-03-10T20:09:36.483653+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:37 gibba009 bash[9804]: cluster 2021-03-10T20:09:36.483653+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:38.651 INFO:teuthology.orchestra.run.gibba004.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:09:39.338 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T20:09:39.346 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba004.front.sepia.ceph.com 2021-03-10T20:09:39.347 DEBUG:teuthology.orchestra.run.gibba004:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 37a23cfe-81db-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-03-10T20:09:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[9777]: cluster 2021-03-10T20:09:38.484014+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[9777]: audit 2021-03-10T20:09:38.645975+0000 mgr.y (mgr.14140) 311 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[9777]: audit 2021-03-10T20:09:38.646576+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]: dispatch 2021-03-10T20:09:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[9777]: audit 2021-03-10T20:09:38.650070+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]': finished 2021-03-10T20:09:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[9777]: cephadm 2021-03-10T20:09:38.652515+0000 mgr.y (mgr.14140) 312 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:09:39.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[12967]: cluster 2021-03-10T20:09:38.484014+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:39.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[12967]: audit 2021-03-10T20:09:38.645975+0000 mgr.y (mgr.14140) 311 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:39.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[12967]: audit 2021-03-10T20:09:38.646576+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]: dispatch 2021-03-10T20:09:39.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[12967]: audit 2021-03-10T20:09:38.650070+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]': finished 2021-03-10T20:09:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:39 gibba004 bash[12967]: cephadm 2021-03-10T20:09:38.652515+0000 mgr.y (mgr.14140) 312 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:09:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:39 gibba009 bash[9804]: cluster 2021-03-10T20:09:38.484014+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:39 gibba009 bash[9804]: audit 2021-03-10T20:09:38.645975+0000 mgr.y (mgr.14140) 311 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:39.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:39 gibba009 bash[9804]: audit 2021-03-10T20:09:38.646576+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]: dispatch 2021-03-10T20:09:39.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:39 gibba009 bash[9804]: audit 2021-03-10T20:09:38.650070+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\"}"}]': finished 2021-03-10T20:09:39.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:39 gibba009 bash[9804]: cephadm 2021-03-10T20:09:38.652515+0000 mgr.y (mgr.14140) 312 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:09:41.829 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:41 gibba004 bash[9777]: cluster 2021-03-10T20:09:40.484421+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:41.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:41 gibba004 bash[12967]: cluster 2021-03-10T20:09:40.484421+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:41 gibba009 bash[9804]: cluster 2021-03-10T20:09:40.484421+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:43.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:43 gibba004 bash[9777]: cluster 2021-03-10T20:09:42.484751+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:43.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:43 gibba004 bash[12967]: cluster 2021-03-10T20:09:42.484751+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:43.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:43 gibba009 bash[9804]: cluster 2021-03-10T20:09:42.484751+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:45.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:45 gibba004 bash[9777]: cluster 2021-03-10T20:09:44.485072+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:45.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:45 gibba004 bash[12967]: cluster 2021-03-10T20:09:44.485072+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:45.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:45 gibba009 bash[9804]: cluster 2021-03-10T20:09:44.485072+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:47.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:47 gibba004 bash[9777]: cluster 2021-03-10T20:09:46.486388+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:47 gibba004 bash[12967]: cluster 2021-03-10T20:09:46.486388+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:47.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:47 gibba009 bash[9804]: cluster 2021-03-10T20:09:46.486388+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:49 gibba004 bash[9777]: cluster 2021-03-10T20:09:48.487914+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:49.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:49 gibba004 bash[12967]: cluster 2021-03-10T20:09:48.487914+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:49.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:49 gibba009 bash[9804]: cluster 2021-03-10T20:09:48.487914+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:51 gibba004 bash[9777]: cluster 2021-03-10T20:09:50.489442+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:51.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:51 gibba004 bash[12967]: cluster 2021-03-10T20:09:50.489442+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:51.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:51 gibba009 bash[9804]: cluster 2021-03-10T20:09:50.489442+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:53.104 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:09:53.297 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:09:53.298 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (3m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b 992da04b7f06 2021-03-10T20:09:53.298 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (3m) 2m ago 3m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:09:53.298 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0eda228f0950 2021-03-10T20:09:53.299 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e79934c98f1b 2021-03-10T20:09:53.299 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 880e4880fd17 2021-03-10T20:09:53.299 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 01602dd42b4c 2021-03-10T20:09:53.299 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 40c0351a70b1 2021-03-10T20:09:53.299 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ab2f2fedfc 2021-03-10T20:09:53.300 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:09:53.300 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:09:53.300 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:09:53.300 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:09:53.301 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:09:53.301 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:09:53.301 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:09:53.301 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:09:53.302 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (4m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:09:53.303 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:09:53.303 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (3m) 2m ago 4m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:09:53.303 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6cfa7fc37d5e 2021-03-10T20:09:53.303 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:09:53.512 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:09:53.513 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:09:53.513 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:09:53.513 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:09:53.514 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:09:53.514 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:09:53.514 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:09:53.514 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:09:53.515 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:09:53.515 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:09:53.515 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:09:53.515 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:09:53.516 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T20:09:53.516 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:09:53.516 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:09:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: cluster 2021-03-10T20:09:52.490716+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: audit 2021-03-10T20:09:53.095931+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: audit 2021-03-10T20:09:53.266495+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:09:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: audit 2021-03-10T20:09:53.270368+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:09:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: cephadm 2021-03-10T20:09:53.270658+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:09:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: audit 2021-03-10T20:09:53.270853+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: cephadm 2021-03-10T20:09:53.271605+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:09:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: cephadm 2021-03-10T20:09:53.271674+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:09:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:53 gibba009 bash[9804]: audit 2021-03-10T20:09:53.512644+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.104:0/3479934066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:54.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: cluster 2021-03-10T20:09:52.490716+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:54.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: audit 2021-03-10T20:09:53.095931+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:54.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: audit 2021-03-10T20:09:53.266495+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:09:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: audit 2021-03-10T20:09:53.270368+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:09:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: cephadm 2021-03-10T20:09:53.270658+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:09:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: audit 2021-03-10T20:09:53.270853+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: cephadm 2021-03-10T20:09:53.271605+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:09:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: cephadm 2021-03-10T20:09:53.271674+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:09:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[9777]: audit 2021-03-10T20:09:53.512644+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.104:0/3479934066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:54.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: cluster 2021-03-10T20:09:52.490716+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:54.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: audit 2021-03-10T20:09:53.095931+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: audit 2021-03-10T20:09:53.266495+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: audit 2021-03-10T20:09:53.270368+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: cephadm 2021-03-10T20:09:53.270658+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: audit 2021-03-10T20:09:53.270853+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: cephadm 2021-03-10T20:09:53.271605+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:09:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: cephadm 2021-03-10T20:09:53.271674+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:09:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:53 gibba004 bash[12967]: audit 2021-03-10T20:09:53.512644+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.104:0/3479934066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:54.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:54 gibba009 bash[9804]: audit 2021-03-10T20:09:53.294363+0000 mgr.y (mgr.14140) 324 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:54.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:54 gibba009 bash[9804]: cephadm 2021-03-10T20:09:53.448190+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba009 2021-03-10T20:09:55.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:54 gibba004 bash[9777]: audit 2021-03-10T20:09:53.294363+0000 mgr.y (mgr.14140) 324 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:55.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:54 gibba004 bash[9777]: cephadm 2021-03-10T20:09:53.448190+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba009 2021-03-10T20:09:55.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:54 gibba004 bash[12967]: audit 2021-03-10T20:09:53.294363+0000 mgr.y (mgr.14140) 324 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:55.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:54 gibba004 bash[12967]: cephadm 2021-03-10T20:09:53.448190+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba009 2021-03-10T20:09:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:55 gibba009 bash[9804]: cluster 2021-03-10T20:09:54.492067+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:56.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:55 gibba004 bash[9777]: cluster 2021-03-10T20:09:54.492067+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:56.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:55 gibba004 bash[12967]: cluster 2021-03-10T20:09:54.492067+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:57 gibba004 bash[9777]: cluster 2021-03-10T20:09:56.492718+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:57.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:57 gibba004 bash[12967]: cluster 2021-03-10T20:09:56.492718+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:57.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:57 gibba009 bash[9804]: cluster 2021-03-10T20:09:56.492718+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:59.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:09:59 gibba004 bash[9777]: cluster 2021-03-10T20:09:58.493844+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:59.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:09:59 gibba004 bash[12967]: cluster 2021-03-10T20:09:58.493844+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:59.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:09:59 gibba009 bash[9804]: cluster 2021-03-10T20:09:58.493844+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:01.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:01 gibba009 bash[9804]: cluster 2021-03-10T20:10:00.495352+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:01 gibba004 bash[9777]: cluster 2021-03-10T20:10:00.495352+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:01 gibba004 bash[12967]: cluster 2021-03-10T20:10:00.495352+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:03.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:03 gibba009 bash[9804]: cluster 2021-03-10T20:10:02.496797+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:03 gibba004 bash[9777]: cluster 2021-03-10T20:10:02.496797+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:03 gibba004 bash[12967]: cluster 2021-03-10T20:10:02.496797+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:05.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:05 gibba009 bash[9804]: cluster 2021-03-10T20:10:04.498133+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:06.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:05 gibba004 bash[9777]: cluster 2021-03-10T20:10:04.498133+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:06.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:05 gibba004 bash[12967]: cluster 2021-03-10T20:10:04.498133+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:07 gibba004 bash[9777]: cluster 2021-03-10T20:10:06.498637+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:07.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:07 gibba004 bash[12967]: cluster 2021-03-10T20:10:06.498637+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:07.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:07 gibba009 bash[9804]: cluster 2021-03-10T20:10:06.498637+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: cluster 2021-03-10T20:10:08.500068+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: cephadm 2021-03-10T20:10:08.938579+0000 mgr.y (mgr.14140) 334 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:10:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: cephadm 2021-03-10T20:10:08.938798+0000 mgr.y (mgr.14140) 335 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:10:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: audit 2021-03-10T20:10:08.939690+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: audit 2021-03-10T20:10:08.948756+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:10:09.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: audit 2021-03-10T20:10:08.949807+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:10:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: audit 2021-03-10T20:10:08.950529+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: cephadm 2021-03-10T20:10:08.951326+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:10:09.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[9777]: audit 2021-03-10T20:10:08.951576+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:10:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: cluster 2021-03-10T20:10:08.500068+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: cephadm 2021-03-10T20:10:08.938579+0000 mgr.y (mgr.14140) 334 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:10:09.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: cephadm 2021-03-10T20:10:08.938798+0000 mgr.y (mgr.14140) 335 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:10:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: audit 2021-03-10T20:10:08.939690+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: audit 2021-03-10T20:10:08.948756+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:10:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: audit 2021-03-10T20:10:08.949807+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:10:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: audit 2021-03-10T20:10:08.950529+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: cephadm 2021-03-10T20:10:08.951326+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:10:09.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:09 gibba004 bash[12967]: audit 2021-03-10T20:10:08.951576+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:10:09.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: cluster 2021-03-10T20:10:08.500068+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: cephadm 2021-03-10T20:10:08.938579+0000 mgr.y (mgr.14140) 334 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:10:09.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: cephadm 2021-03-10T20:10:08.938798+0000 mgr.y (mgr.14140) 335 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:10:09.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: audit 2021-03-10T20:10:08.939690+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:09.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: audit 2021-03-10T20:10:08.948756+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:10:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: audit 2021-03-10T20:10:08.949807+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:10:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: audit 2021-03-10T20:10:08.950529+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:09.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: cephadm 2021-03-10T20:10:08.951326+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Deploying daemon mgr.x on gibba009 2021-03-10T20:10:09.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:09 gibba009 bash[9804]: audit 2021-03-10T20:10:08.951576+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:10:11.087 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:10 gibba009 systemd[1]: Stopping Ceph mgr.x for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:10:11.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:11 gibba004 bash[9777]: cluster 2021-03-10T20:10:10.501740+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:11 gibba004 bash[12967]: cluster 2021-03-10T20:10:10.501740+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:11 gibba009 bash[9804]: cluster 2021-03-10T20:10:10.501740+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:13 gibba004 bash[9777]: cluster 2021-03-10T20:10:12.503207+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:13 gibba004 bash[12967]: cluster 2021-03-10T20:10:12.503207+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:13 gibba009 bash[9804]: cluster 2021-03-10T20:10:12.503207+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:15.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:15 gibba004 bash[9777]: cluster 2021-03-10T20:10:14.504537+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:15.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:15 gibba004 bash[12967]: cluster 2021-03-10T20:10:14.504537+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:15.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:15 gibba009 bash[9804]: cluster 2021-03-10T20:10:14.504537+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:17 gibba004 bash[9777]: cluster 2021-03-10T20:10:16.505282+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:17.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:17 gibba004 bash[12967]: cluster 2021-03-10T20:10:16.505282+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:17.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:17 gibba009 bash[9804]: cluster 2021-03-10T20:10:16.505282+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:19.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:19 gibba009 bash[9804]: cluster 2021-03-10T20:10:18.506695+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:19 gibba004 bash[9777]: cluster 2021-03-10T20:10:18.506695+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:20.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:19 gibba004 bash[12967]: cluster 2021-03-10T20:10:18.506695+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:21.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:21 gibba009 bash[9804]: cluster 2021-03-10T20:10:20.508041+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:21.836 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 docker[22633]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mgr.x 2021-03-10T20:10:21.837 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2021-03-10T20:10:21.837 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-03-10T20:10:21.837 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 systemd[1]: Stopped Ceph mgr.x for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:10:21.837 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 systemd[1]: Starting Ceph mgr.x for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:10:21.838 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 docker[22707]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mgr.x 2021-03-10T20:10:21.838 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:21 gibba009 systemd[1]: Started Ceph mgr.x for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:10:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:21 gibba004 bash[9777]: cluster 2021-03-10T20:10:20.508041+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:22.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:21 gibba004 bash[12967]: cluster 2021-03-10T20:10:20.508041+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:22.836 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:10:22 gibba009 bash[22726]: debug 2021-03-10T20:10:22.810+0000 7fb10228c700 1 -- 172.21.2.109:0/2311407628 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ab4ca084e0 con 0x55ab4caf6c00 2021-03-10T20:10:22.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:22 gibba009 bash[9804]: audit 2021-03-10T20:10:21.817460+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:22.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:22 gibba009 bash[9804]: audit 2021-03-10T20:10:21.826218+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:22.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:22 gibba009 bash[9804]: audit 2021-03-10T20:10:21.826768+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:23.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[9777]: audit 2021-03-10T20:10:21.817460+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:23.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[12967]: audit 2021-03-10T20:10:21.817460+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:23.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[12967]: audit 2021-03-10T20:10:21.826218+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:23.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[12967]: audit 2021-03-10T20:10:21.826768+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:23.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[9777]: audit 2021-03-10T20:10:21.826218+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.188713\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189156\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189316\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189471\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189624\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189776\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.189926\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190077\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:07:38.190257\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:07:38.190412\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:23.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:22 gibba004 bash[9777]: audit 2021-03-10T20:10:21.826768+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:23.725 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:10:23.918 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:10:23.918 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (4m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b 992da04b7f06 2021-03-10T20:10:23.919 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (4m) 1s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:10:23.919 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0eda228f0950 2021-03-10T20:10:23.919 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running 1s ago 8m quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:10:23.919 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 880e4880fd17 2021-03-10T20:10:23.920 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 01602dd42b4c 2021-03-10T20:10:23.920 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 40c0351a70b1 2021-03-10T20:10:23.920 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ab2f2fedfc 2021-03-10T20:10:23.920 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:10:23.920 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (4m) 1s ago 4m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:10:23.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:10:23.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:10:23.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:10:23.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:10:23.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:10:23.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (5m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:10:23.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:10:23.923 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:10:23.923 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (4m) 1s ago 4m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:10:23.924 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6cfa7fc37d5e 2021-03-10T20:10:23.924 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 1s ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:24.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: cluster 2021-03-10T20:10:22.509681+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:24.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: audit 2021-03-10T20:10:22.883212+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: audit 2021-03-10T20:10:22.892319+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: cephadm 2021-03-10T20:10:22.894091+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: audit 2021-03-10T20:10:22.894279+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: cephadm 2021-03-10T20:10:22.895086+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:24.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:23 gibba009 bash[9804]: cephadm 2021-03-10T20:10:22.895334+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:24.137 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:10:24.137 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:10:24.137 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:10:24.137 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:24.138 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:10:24.138 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:10:24.138 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:24.138 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:10:24.139 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:10:24.139 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:24.139 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:10:24.139 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:10:24.140 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T20:10:24.140 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:10:24.140 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:10:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: cluster 2021-03-10T20:10:22.509681+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:24.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: cluster 2021-03-10T20:10:22.509681+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: audit 2021-03-10T20:10:22.883212+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: audit 2021-03-10T20:10:22.883212+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: audit 2021-03-10T20:10:22.892319+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: cephadm 2021-03-10T20:10:22.894091+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: audit 2021-03-10T20:10:22.894279+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:24.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: cephadm 2021-03-10T20:10:22.895086+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:24.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[9777]: cephadm 2021-03-10T20:10:22.895334+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:24.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: audit 2021-03-10T20:10:22.892319+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"0eda228f0950\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878405\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:02:17.330359\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:15.295282\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:22.879917\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:24.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: cephadm 2021-03-10T20:10:22.894091+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: audit 2021-03-10T20:10:22.894279+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: cephadm 2021-03-10T20:10:22.895086+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:23 gibba004 bash[12967]: cephadm 2021-03-10T20:10:22.895334+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:25.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:24 gibba009 bash[9804]: audit 2021-03-10T20:10:23.717062+0000 mgr.y (mgr.14140) 347 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:24 gibba009 bash[9804]: audit 2021-03-10T20:10:23.914919+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:24 gibba009 bash[9804]: audit 2021-03-10T20:10:24.136855+0000 mon.a (mon.0) 647 : audit [DBG] from='client.? 172.21.2.104:0/4132819828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:25.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[9777]: audit 2021-03-10T20:10:23.717062+0000 mgr.y (mgr.14140) 347 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[9777]: audit 2021-03-10T20:10:23.914919+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[9777]: audit 2021-03-10T20:10:24.136855+0000 mon.a (mon.0) 647 : audit [DBG] from='client.? 172.21.2.104:0/4132819828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:25.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[12967]: audit 2021-03-10T20:10:23.717062+0000 mgr.y (mgr.14140) 347 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[12967]: audit 2021-03-10T20:10:23.914919+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:25.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:24 gibba004 bash[12967]: audit 2021-03-10T20:10:24.136855+0000 mon.a (mon.0) 647 : audit [DBG] from='client.? 172.21.2.104:0/4132819828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:25 gibba004 bash[9777]: cluster 2021-03-10T20:10:24.511248+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:25 gibba004 bash[12967]: cluster 2021-03-10T20:10:24.511248+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:26.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:25 gibba009 bash[9804]: cluster 2021-03-10T20:10:24.511248+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:27.124 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: cephadm 2021-03-10T20:10:26.263063+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba009.xiladd 2021-03-10T20:10:27.124 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: cephadm 2021-03-10T20:10:26.263283+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Upgrade: Redeploying mgr.gibba009.xiladd 2021-03-10T20:10:27.125 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.264181+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.126 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.273965+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:27.126 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.275131+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.127 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.276085+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.127 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: cephadm 2021-03-10T20:10:26.276685+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:10:27.127 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.276903+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:10:27.127 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.666031+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:27.128 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: cluster 2021-03-10T20:10:26.666240+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:10:27.128 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: cluster 2021-03-10T20:10:26.666625+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:10:27.128 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:26 gibba009 bash[9804]: audit 2021-03-10T20:10:26.667145+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: cephadm 2021-03-10T20:10:26.263063+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba009.xiladd 2021-03-10T20:10:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: cephadm 2021-03-10T20:10:26.263283+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Upgrade: Redeploying mgr.gibba009.xiladd 2021-03-10T20:10:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.264181+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.273965+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.275131+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.276085+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: cephadm 2021-03-10T20:10:26.276685+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:10:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.276903+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:10:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.666031+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: cluster 2021-03-10T20:10:26.666240+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:10:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: cluster 2021-03-10T20:10:26.666625+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:10:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[9777]: audit 2021-03-10T20:10:26.667145+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: cephadm 2021-03-10T20:10:26.263063+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba009.xiladd 2021-03-10T20:10:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: cephadm 2021-03-10T20:10:26.263283+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Upgrade: Redeploying mgr.gibba009.xiladd 2021-03-10T20:10:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.264181+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.273965+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:27.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.275131+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:27.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.276085+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: cephadm 2021-03-10T20:10:26.276685+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Deploying daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:10:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.276903+0000 mon.a (mon.0) 652 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba009.xiladd", "key": "container_image"}]: dispatch 2021-03-10T20:10:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.666031+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: cluster 2021-03-10T20:10:26.666240+0000 mon.a (mon.0) 653 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:10:27.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: cluster 2021-03-10T20:10:26.666625+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:10:27.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:26 gibba004 bash[12967]: audit 2021-03-10T20:10:26.667145+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.109:0/1982007758' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:28.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:27 gibba009 bash[9804]: cluster 2021-03-10T20:10:26.512501+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:28.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:27 gibba009 bash[9804]: cluster 2021-03-10T20:10:27.510434+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba009.xiladd, x 2021-03-10T20:10:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:27 gibba004 bash[9777]: cluster 2021-03-10T20:10:26.512501+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:28.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:27 gibba004 bash[9777]: cluster 2021-03-10T20:10:27.510434+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba009.xiladd, x 2021-03-10T20:10:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:27 gibba004 bash[12967]: cluster 2021-03-10T20:10:26.512501+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:27 gibba004 bash[12967]: cluster 2021-03-10T20:10:27.510434+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba009.xiladd, x 2021-03-10T20:10:30.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:29 gibba004 bash[9777]: cluster 2021-03-10T20:10:28.513858+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:30.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:29 gibba004 bash[12967]: cluster 2021-03-10T20:10:28.513858+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:30.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:29 gibba009 bash[9804]: cluster 2021-03-10T20:10:28.513858+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:31 gibba004 bash[9777]: cluster 2021-03-10T20:10:30.515359+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:31 gibba004 bash[12967]: cluster 2021-03-10T20:10:30.515359+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:32.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:31 gibba009 bash[9804]: cluster 2021-03-10T20:10:30.515359+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:33 gibba004 bash[9777]: cluster 2021-03-10T20:10:32.516706+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:33 gibba004 bash[12967]: cluster 2021-03-10T20:10:32.516706+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:33 gibba009 bash[9804]: cluster 2021-03-10T20:10:32.516706+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:35 gibba004 bash[9777]: cluster 2021-03-10T20:10:34.518170+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:35 gibba004 bash[12967]: cluster 2021-03-10T20:10:34.518170+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:35 gibba009 bash[9804]: cluster 2021-03-10T20:10:34.518170+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:37.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:37 gibba004 bash[9777]: cluster 2021-03-10T20:10:36.518606+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:37.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:37 gibba004 bash[12967]: cluster 2021-03-10T20:10:36.518606+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:37.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:37 gibba009 bash[9804]: cluster 2021-03-10T20:10:36.518606+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:39.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:39 gibba009 bash[9804]: cluster 2021-03-10T20:10:38.520005+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:39 gibba009 bash[9804]: audit 2021-03-10T20:10:38.899575+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:39 gibba009 bash[9804]: audit 2021-03-10T20:10:38.908717+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:39 gibba009 bash[9804]: audit 2021-03-10T20:10:38.909535+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[9777]: cluster 2021-03-10T20:10:38.520005+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:40.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[12967]: cluster 2021-03-10T20:10:38.520005+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[9777]: audit 2021-03-10T20:10:38.899575+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[9777]: audit 2021-03-10T20:10:38.908717+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[9777]: audit 2021-03-10T20:10:38.909535+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[12967]: audit 2021-03-10T20:10:38.899575+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[12967]: audit 2021-03-10T20:10:38.908717+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.877978\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878292\", \"created\": \"2021-03-10T20:02:15.271621\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878571\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878728\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.878880\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879033\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879186\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879337\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:22.879489\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:22.879639\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:39 gibba004 bash[12967]: audit 2021-03-10T20:10:38.909535+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:10:42.062 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[10014]: debug 2021-03-10T20:10:41.619+0000 7f6dbbb37700 -1 mgr handle_mgr_map I was active but no longer am 2021-03-10T20:10:42.062 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[10014]: ignoring --setuser ceph since I am not root 2021-03-10T20:10:42.063 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[10014]: ignoring --setgroup ceph since I am not root 2021-03-10T20:10:42.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cluster 2021-03-10T20:10:40.521629+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:42.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cluster 2021-03-10T20:10:40.521629+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:42.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: audit 2021-03-10T20:10:40.619498+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:42.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: audit 2021-03-10T20:10:40.619498+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:42.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: audit 2021-03-10T20:10:40.622992+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cephadm 2021-03-10T20:10:40.625091+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: audit 2021-03-10T20:10:40.625365+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cephadm 2021-03-10T20:10:40.626420+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:42.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cephadm 2021-03-10T20:10:40.626522+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:42.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cephadm 2021-03-10T20:10:40.628889+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:10:42.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: audit 2021-03-10T20:10:40.629371+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:10:42.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cluster 2021-03-10T20:10:40.633787+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T20:10:42.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[9777]: cluster 2021-03-10T20:10:41.400804+0000 mon.a (mon.0) 664 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:42.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: audit 2021-03-10T20:10:40.622992+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:42.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cephadm 2021-03-10T20:10:40.625091+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:42.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: audit 2021-03-10T20:10:40.625365+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:42.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cephadm 2021-03-10T20:10:40.626420+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:42.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cephadm 2021-03-10T20:10:40.626522+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:42.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cephadm 2021-03-10T20:10:40.628889+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:10:42.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: audit 2021-03-10T20:10:40.629371+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:10:42.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cluster 2021-03-10T20:10:40.633787+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T20:10:42.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:41 gibba004 bash[12967]: cluster 2021-03-10T20:10:41.400804+0000 mon.a (mon.0) 664 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cluster 2021-03-10T20:10:40.521629+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:42.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: audit 2021-03-10T20:10:40.619498+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]: dispatch 2021-03-10T20:10:42.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: audit 2021-03-10T20:10:40.622992+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618082\", \"created\": \"2021-03-10T20:02:01.043621\", \"started\": \"2021-03-10T20:02:01.066462\"}, \"mgr.x\": {\"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618156\", \"created\": \"2021-03-10T20:02:15.271621\", \"started\": \"2021-03-10T20:10:21.826714\"}, \"mgr.gibba009.xiladd\": {\"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba009.xiladd\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618206\", \"created\": \"2021-03-10T20:02:17.307621\", \"started\": \"2021-03-10T20:10:38.909007\"}, \"osd.4\": {\"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618252\", \"created\": \"2021-03-10T20:04:00.369383\", \"started\": \"2021-03-10T20:04:03.318594\"}, \"osd.5\": {\"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618288\", \"created\": \"2021-03-10T20:04:21.549383\", \"started\": \"2021-03-10T20:04:24.298495\"}, \"osd.6\": {\"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618324\", \"created\": \"2021-03-10T20:04:43.045384\", \"started\": \"2021-03-10T20:05:09.183774\"}, \"osd.7\": {\"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618359\", \"created\": \"2021-03-10T20:05:09.369385\", \"started\": \"2021-03-10T20:05:13.042399\"}, \"prometheus.a\": {\"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618393\", \"created\": \"2021-03-10T20:05:30.021385\", \"started\": \"2021-03-10T20:06:09.232210\"}, \"node-exporter.b\": {\"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618428\", \"created\": \"2021-03-10T20:05:31.737385\", \"started\": \"2021-03-10T20:05:33.022735\"}, \"grafana.a\": {\"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:10:40.618462\", \"created\": \"2021-03-10T20:05:54.393386\", \"started\": \"2021-03-10T20:05:54.417503\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:10:40.618496\", \"created\": \"2021-03-10T20:07:33.517388\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173\"}}, \"last_daemon_update\": \"2021-03-10T20:10:40.618565\", \"last_device_update\": \"2021-03-10T20:05:16.897251\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530\"}"}]': finished 2021-03-10T20:10:42.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cephadm 2021-03-10T20:10:40.625091+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:10:42.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: audit 2021-03-10T20:10:40.625365+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:42.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cephadm 2021-03-10T20:10:40.626420+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:10:42.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cephadm 2021-03-10T20:10:40.626522+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:10:42.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cephadm 2021-03-10T20:10:40.628889+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:10:42.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: audit 2021-03-10T20:10:40.629371+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:10:42.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cluster 2021-03-10T20:10:40.633787+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-03-10T20:10:42.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:41 gibba009 bash[9804]: cluster 2021-03-10T20:10:41.400804+0000 mon.a (mon.0) 664 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:42 gibba004 bash[9777]: audit 2021-03-10T20:10:41.627497+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:10:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:42 gibba004 bash[9777]: cluster 2021-03-10T20:10:41.627554+0000 mon.a (mon.0) 666 : cluster [DBG] mgrmap e17: gibba009.xiladd(active, starting, since 0.997649s), standbys: y, x 2021-03-10T20:10:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:42 gibba004 bash[12967]: audit 2021-03-10T20:10:41.627497+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:10:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:42 gibba004 bash[12967]: cluster 2021-03-10T20:10:41.627554+0000 mon.a (mon.0) 666 : cluster [DBG] mgrmap e17: gibba009.xiladd(active, starting, since 0.997649s), standbys: y, x 2021-03-10T20:10:43.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:42 gibba009 bash[9804]: audit 2021-03-10T20:10:41.627497+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14140 172.21.2.104:0/262016041' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:10:43.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:42 gibba009 bash[9804]: cluster 2021-03-10T20:10:41.627554+0000 mon.a (mon.0) 666 : cluster [DBG] mgrmap e17: gibba009.xiladd(active, starting, since 0.997649s), standbys: y, x 2021-03-10T20:10:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[9777]: cluster 2021-03-10T20:10:43.833693+0000 mon.a (mon.0) 667 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:10:44.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[9777]: cluster 2021-03-10T20:10:43.834559+0000 mon.a (mon.0) 668 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:10:44.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[9777]: audit 2021-03-10T20:10:43.835265+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:44.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[9777]: cluster 2021-03-10T20:10:43.837523+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:10:44.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[9777]: audit 2021-03-10T20:10:43.838725+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[12967]: cluster 2021-03-10T20:10:43.833693+0000 mon.a (mon.0) 667 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:10:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[12967]: cluster 2021-03-10T20:10:43.834559+0000 mon.a (mon.0) 668 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:10:44.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[12967]: audit 2021-03-10T20:10:43.835265+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:44.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[12967]: cluster 2021-03-10T20:10:43.837523+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:10:44.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:43 gibba004 bash[12967]: audit 2021-03-10T20:10:43.838725+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:44.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:43 gibba009 bash[9804]: cluster 2021-03-10T20:10:43.833693+0000 mon.a (mon.0) 667 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:10:44.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:43 gibba009 bash[9804]: cluster 2021-03-10T20:10:43.834559+0000 mon.a (mon.0) 668 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:10:44.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:43 gibba009 bash[9804]: audit 2021-03-10T20:10:43.835265+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:44.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:43 gibba009 bash[9804]: cluster 2021-03-10T20:10:43.837523+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:10:44.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:43 gibba009 bash[9804]: audit 2021-03-10T20:10:43.838725+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: cluster 2021-03-10T20:10:43.890423+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e18: gibba009.xiladd(active, starting, since 0.0561046s), standbys: y, x 2021-03-10T20:10:45.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.896685+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:10:45.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.896825+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:10:45.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.896940+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:10:45.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897048+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897198+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:10:45.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897333+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:10:45.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897475+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:10:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897611+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:10:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897746+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:10:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.897878+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:10:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.898013+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:10:45.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.898185+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:10:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.898274+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:10:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.898528+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:10:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.899130+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:10:45.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.899635+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:10:45.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: cluster 2021-03-10T20:10:43.890423+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e18: gibba009.xiladd(active, starting, since 0.0561046s), standbys: y, x 2021-03-10T20:10:45.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.896685+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:10:45.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.896825+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:10:45.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.896940+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:10:45.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897048+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897198+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:10:45.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897333+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:10:45.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897475+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:10:45.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897611+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:10:45.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897746+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:10:45.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.897878+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:10:45.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.898013+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:10:45.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.898185+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:10:45.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.898274+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:10:45.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.898528+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:10:45.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.899130+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:10:45.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.899635+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:10:45.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.899908+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:10:45.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.900202+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:10:45.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.900437+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:10:45.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.900622+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:10:45.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.900934+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:10:45.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.901243+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:10:45.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.901592+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:10:45.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.901893+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:10:45.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.902123+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:10:45.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.902359+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:10:45.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.902532+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:10:45.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.902713+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:10:45.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.902854+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:10:45.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903030+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:10:45.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903164+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903333+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.899908+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:10:45.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.900202+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:10:45.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.900437+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:10:45.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.900622+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:10:45.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.900934+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:10:45.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.901243+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:10:45.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.901592+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:10:45.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.901893+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:10:45.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.902123+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:10:45.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.902359+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:10:45.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.902532+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:10:45.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.902713+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:10:45.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.902854+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:10:45.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903030+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:10:45.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903164+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903333+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.331 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903461+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:10:45.331 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903662+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:10:45.331 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.903831+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:10:45.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:43.904038+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:10:45.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: cluster 2021-03-10T20:10:44.403749+0000 mon.a (mon.0) 671 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:10:45.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: cluster 2021-03-10T20:10:44.403905+0000 mon.a (mon.0) 672 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:45.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:44.404351+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:44.405202+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: cluster 2021-03-10T20:10:44.874829+0000 mon.a (mon.0) 673 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:10:45.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:44.882643+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:44.882668+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[9777]: audit 2021-03-10T20:10:44.891552+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:45.334 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903461+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:10:45.334 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903662+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:10:45.334 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.903831+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:10:45.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:43.904038+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:10:45.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: cluster 2021-03-10T20:10:44.403749+0000 mon.a (mon.0) 671 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:10:45.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: cluster 2021-03-10T20:10:44.403905+0000 mon.a (mon.0) 672 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:45.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:44.404351+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:44.405202+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: cluster 2021-03-10T20:10:44.874829+0000 mon.a (mon.0) 673 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:10:45.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:44.882643+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:44.882668+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:44 gibba004 bash[12967]: audit 2021-03-10T20:10:44.891552+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:45.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: cluster 2021-03-10T20:10:43.890423+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e18: gibba009.xiladd(active, starting, since 0.0561046s), standbys: y, x 2021-03-10T20:10:45.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.896685+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:10:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.896825+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:10:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.896940+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:10:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897048+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897198+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:10:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897333+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:10:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897475+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:10:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897611+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:10:45.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897746+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:10:45.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.897878+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:10:45.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.898013+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:10:45.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.898185+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:10:45.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.898274+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:10:45.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.898528+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:10:45.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.899130+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:10:45.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.899635+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:10:45.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.899908+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:10:45.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.900202+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:10:45.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.900437+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:10:45.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.900622+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:10:45.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.900934+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:10:45.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.901243+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:10:45.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.901592+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:10:45.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.901893+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:10:45.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.902123+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:10:45.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.902359+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:10:45.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.902532+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:10:45.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.902713+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:10:45.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.902854+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:10:45.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903030+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:10:45.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903164+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903333+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903461+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:10:45.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903662+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:10:45.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.903831+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:10:45.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:43.904038+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:10:45.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: cluster 2021-03-10T20:10:44.403749+0000 mon.a (mon.0) 671 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:10:45.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: cluster 2021-03-10T20:10:44.403905+0000 mon.a (mon.0) 672 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:10:45.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:44.404351+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:10:45.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:44.405202+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.104:0/1572617730' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:10:45.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: cluster 2021-03-10T20:10:44.874829+0000 mon.a (mon.0) 673 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:10:45.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:44.882643+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:44.882668+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:45.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:44 gibba009 bash[9804]: audit 2021-03-10T20:10:44.891552+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: debug 2021-03-10T20:10:45.895+0000 7fa80bc1e700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:10:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.894184+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: cephadm 2021-03-10T20:10:44.894532+0000 mgr.gibba009.xiladd (mgr.34418) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:10:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.894889+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: cluster 2021-03-10T20:10:44.898004+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e19: gibba009.xiladd(active, since 1.06368s), standbys: y, x 2021-03-10T20:10:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: cluster 2021-03-10T20:10:44.903802+0000 mgr.gibba009.xiladd (mgr.34418) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.904471+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:10:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.907704+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.908074+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.910863+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.913472+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.914134+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.917113+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:44.998360+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:46.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.894184+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: cephadm 2021-03-10T20:10:44.894532+0000 mgr.gibba009.xiladd (mgr.34418) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:10:46.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.894889+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: cluster 2021-03-10T20:10:44.898004+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e19: gibba009.xiladd(active, since 1.06368s), standbys: y, x 2021-03-10T20:10:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: cluster 2021-03-10T20:10:44.903802+0000 mgr.gibba009.xiladd (mgr.34418) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.904471+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:10:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.907704+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.908074+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.910863+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.913472+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.914134+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.917113+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:44.998360+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:45.017143+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:45.017143+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:45.017402+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:45.021616+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:46.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[9777]: audit 2021-03-10T20:10:45.021710+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:46.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:45.017402+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:45.021616+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:46.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:45 gibba004 bash[12967]: audit 2021-03-10T20:10:45.021710+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.894184+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: cephadm 2021-03-10T20:10:44.894532+0000 mgr.gibba009.xiladd (mgr.34418) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:10:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.894889+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:10:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: cluster 2021-03-10T20:10:44.898004+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e19: gibba009.xiladd(active, since 1.06368s), standbys: y, x 2021-03-10T20:10:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: cluster 2021-03-10T20:10:44.903802+0000 mgr.gibba009.xiladd (mgr.34418) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.904471+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:10:44.894541Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba004=y\", \"gibba009=x\", \"gibba009=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:10:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.907704+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.908074+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.910863+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.913472+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.914134+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:10:46.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.917113+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:10:46.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:44.998360+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:46.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:45.017143+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:45.017402+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:45.021616+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:45 gibba009 bash[9804]: audit 2021-03-10T20:10:45.021710+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[9777]: cluster 2021-03-10T20:10:45.897853+0000 mgr.gibba009.xiladd (mgr.34418) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[9777]: cluster 2021-03-10T20:10:45.902005+0000 mon.a (mon.0) 685 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:10:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[9777]: cluster 2021-03-10T20:10:45.936923+0000 mon.a (mon.0) 686 : cluster [DBG] mgrmap e20: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:10:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[12967]: cluster 2021-03-10T20:10:45.897853+0000 mgr.gibba009.xiladd (mgr.34418) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[12967]: cluster 2021-03-10T20:10:45.902005+0000 mon.a (mon.0) 685 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:10:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:46 gibba004 bash[12967]: cluster 2021-03-10T20:10:45.936923+0000 mon.a (mon.0) 686 : cluster [DBG] mgrmap e20: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:10:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:46 gibba009 bash[9804]: cluster 2021-03-10T20:10:45.897853+0000 mgr.gibba009.xiladd (mgr.34418) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:46 gibba009 bash[9804]: cluster 2021-03-10T20:10:45.902005+0000 mon.a (mon.0) 685 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:10:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:46 gibba009 bash[9804]: cluster 2021-03-10T20:10:45.936923+0000 mon.a (mon.0) 686 : cluster [DBG] mgrmap e20: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:10:48.295 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:47 gibba004 bash[12967]: cluster 2021-03-10T20:10:46.151144+0000 mgr.gibba009.xiladd (mgr.34418) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:48.295 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:47 gibba004 bash[9777]: cluster 2021-03-10T20:10:46.151144+0000 mgr.gibba009.xiladd (mgr.34418) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:47 gibba009 bash[9804]: cluster 2021-03-10T20:10:46.151144+0000 mgr.gibba009.xiladd (mgr.34418) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:49.196 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:48 gibba004 bash[9777]: cluster 2021-03-10T20:10:47.898886+0000 mgr.gibba009.xiladd (mgr.34418) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:49.196 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:48 gibba004 bash[12967]: cluster 2021-03-10T20:10:47.898886+0000 mgr.gibba009.xiladd (mgr.34418) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:49.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:48 gibba009 bash[9804]: cluster 2021-03-10T20:10:47.898886+0000 mgr.gibba009.xiladd (mgr.34418) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.871474+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.871605+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.875485+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T20:10:50.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.882412+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.883003+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.885714+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.887648+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.888225+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.890747+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T20:10:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[9777]: audit 2021-03-10T20:10:49.893329+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.871474+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.871605+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.875485+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T20:10:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.882412+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.883003+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.885714+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.887648+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.888225+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.890747+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T20:10:50.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:49 gibba004 bash[12967]: audit 2021-03-10T20:10:49.893329+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:50.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.871474+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.871605+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T20:10:50.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.875485+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T20:10:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.882412+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.883003+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:10:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.885714+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:10:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.887648+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.888225+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T20:10:50.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.890747+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T20:10:50.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:49 gibba009 bash[9804]: audit 2021-03-10T20:10:49.893329+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:51.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:50 gibba004 bash[9777]: cluster 2021-03-10T20:10:49.899301+0000 mgr.gibba009.xiladd (mgr.34418) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:51.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:50 gibba004 bash[9777]: audit 2021-03-10T20:10:50.084904+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:51.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:50 gibba004 bash[12967]: cluster 2021-03-10T20:10:49.899301+0000 mgr.gibba009.xiladd (mgr.34418) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:51.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:50 gibba004 bash[12967]: audit 2021-03-10T20:10:50.084904+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:51.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:50 gibba009 bash[9804]: cluster 2021-03-10T20:10:49.899301+0000 mgr.gibba009.xiladd (mgr.34418) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:51.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:50 gibba009 bash[9804]: audit 2021-03-10T20:10:50.084904+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:52.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:52 gibba004 bash[9777]: cluster 2021-03-10T20:10:51.901672+0000 mgr.gibba009.xiladd (mgr.34418) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:52.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:52 gibba004 bash[12967]: cluster 2021-03-10T20:10:51.901672+0000 mgr.gibba009.xiladd (mgr.34418) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:52.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:52 gibba009 bash[9804]: cluster 2021-03-10T20:10:51.901672+0000 mgr.gibba009.xiladd (mgr.34418) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[9777]: audit 2021-03-10T20:10:53.539788+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[12967]: audit 2021-03-10T20:10:53.539788+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[9777]: audit 2021-03-10T20:10:53.540040+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[9777]: audit 2021-03-10T20:10:53.542611+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[12967]: audit 2021-03-10T20:10:53.540040+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:53 gibba004 bash[12967]: audit 2021-03-10T20:10:53.542611+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:54.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:53 gibba009 bash[9804]: audit 2021-03-10T20:10:53.539788+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:53 gibba009 bash[9804]: audit 2021-03-10T20:10:53.540040+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:54.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:53 gibba009 bash[9804]: audit 2021-03-10T20:10:53.542611+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:54.378 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:10:54.609 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:10:54.609 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (4m) 1s ago 5m 0.21.0 prom/alertmanager c876f5897d7b 992da04b7f06 2021-03-10T20:10:54.609 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (5m) 0s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:10:54.609 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (15s) 0s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:10:54.610 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (32s) 0s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:10:54.610 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 880e4880fd17 2021-03-10T20:10:54.610 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 01602dd42b4c 2021-03-10T20:10:54.610 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (8m) 0s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 40c0351a70b1 2021-03-10T20:10:54.611 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ab2f2fedfc 2021-03-10T20:10:54.611 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (5m) 1s ago 5m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:10:54.611 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (5m) 0s ago 5m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:10:54.611 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:10:54.611 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:10:54.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:10:54.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:10:54.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:10:54.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:10:54.613 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (5m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:10:54.613 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (5m) 0s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:10:54.613 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (4m) 0s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:10:54.613 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 1s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:54.613 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 0s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:54.861 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:10:54.861 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:10:54.861 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:10:54.862 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:54.862 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:10:54.862 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:10:54.862 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:10:54.863 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:54.863 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:10:54.863 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:10:54.863 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:10:54.863 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:10:54.864 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:10:54.864 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T20:10:54.864 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:10:54.864 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:10:54.865 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:10:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: cephadm 2021-03-10T20:10:53.544776+0000 mgr.gibba009.xiladd (mgr.34418) 9 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:10:55.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: cluster 2021-03-10T20:10:53.902083+0000 mgr.gibba009.xiladd (mgr.34418) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: cephadm 2021-03-10T20:10:53.544776+0000 mgr.gibba009.xiladd (mgr.34418) 9 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:10:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: cluster 2021-03-10T20:10:53.902083+0000 mgr.gibba009.xiladd (mgr.34418) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:55.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.152826+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.152826+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.153337+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.153337+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.156441+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:55.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.386836+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.387132+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.390087+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:10:55.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.393860+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:55.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.394682+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:55.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.395401+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:55.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[9777]: audit 2021-03-10T20:10:54.396328+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:55.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.156441+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:55.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.386836+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.387132+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.390087+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:10:55.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.393860+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:55.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.394682+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:55.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.395401+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:55.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:54 gibba004 bash[12967]: audit 2021-03-10T20:10:54.396328+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:55.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: cephadm 2021-03-10T20:10:53.544776+0000 mgr.gibba009.xiladd (mgr.34418) 9 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:10:55.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: cluster 2021-03-10T20:10:53.902083+0000 mgr.gibba009.xiladd (mgr.34418) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:55.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.152826+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.153337+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:55.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.156441+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:57.750110Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:55.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.386836+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.387132+0000 mon.b (mon.2) 80 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:10:55.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.390087+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:10:55.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.393860+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:55.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.394682+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:55.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.395401+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:55.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:54 gibba009 bash[9804]: audit 2021-03-10T20:10:54.396328+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:55.925 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: cephadm 2021-03-10T20:10:54.158179+0000 mgr.gibba009.xiladd (mgr.34418) 11 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:10:55.925 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: audit 2021-03-10T20:10:54.370682+0000 mgr.gibba009.xiladd (mgr.34418) 12 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:55.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: cluster 2021-03-10T20:10:54.386841+0000 mgr.gibba009.xiladd (mgr.34418) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:55.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: cephadm 2021-03-10T20:10:54.393639+0000 mgr.gibba009.xiladd (mgr.34418) 14 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:10:55.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: cephadm 2021-03-10T20:10:54.396071+0000 mgr.gibba009.xiladd (mgr.34418) 15 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:10:55.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: cluster 2021-03-10T20:10:54.591774+0000 mon.a (mon.0) 699 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:10:55.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: audit 2021-03-10T20:10:54.600610+0000 mgr.gibba009.xiladd (mgr.34418) 16 : audit [DBG] from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:55.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[9777]: audit 2021-03-10T20:10:54.860963+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.104:0/1383547767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:55.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: cephadm 2021-03-10T20:10:54.158179+0000 mgr.gibba009.xiladd (mgr.34418) 11 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:10:55.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: audit 2021-03-10T20:10:54.370682+0000 mgr.gibba009.xiladd (mgr.34418) 12 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:55.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: cluster 2021-03-10T20:10:54.386841+0000 mgr.gibba009.xiladd (mgr.34418) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:55.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: cephadm 2021-03-10T20:10:54.393639+0000 mgr.gibba009.xiladd (mgr.34418) 14 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:10:55.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: cephadm 2021-03-10T20:10:54.396071+0000 mgr.gibba009.xiladd (mgr.34418) 15 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:10:55.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: cluster 2021-03-10T20:10:54.591774+0000 mon.a (mon.0) 699 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:10:55.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: audit 2021-03-10T20:10:54.600610+0000 mgr.gibba009.xiladd (mgr.34418) 16 : audit [DBG] from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:55.930 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:55 gibba004 bash[12967]: audit 2021-03-10T20:10:54.860963+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.104:0/1383547767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:56.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: cephadm 2021-03-10T20:10:54.158179+0000 mgr.gibba009.xiladd (mgr.34418) 11 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:10:56.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: audit 2021-03-10T20:10:54.370682+0000 mgr.gibba009.xiladd (mgr.34418) 12 : audit [DBG] from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:56.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: cluster 2021-03-10T20:10:54.386841+0000 mgr.gibba009.xiladd (mgr.34418) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: cephadm 2021-03-10T20:10:54.393639+0000 mgr.gibba009.xiladd (mgr.34418) 14 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:10:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: cephadm 2021-03-10T20:10:54.396071+0000 mgr.gibba009.xiladd (mgr.34418) 15 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:10:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: cluster 2021-03-10T20:10:54.591774+0000 mon.a (mon.0) 699 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:10:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: audit 2021-03-10T20:10:54.600610+0000 mgr.gibba009.xiladd (mgr.34418) 16 : audit [DBG] from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:55 gibba009 bash[9804]: audit 2021-03-10T20:10:54.860963+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.104:0/1383547767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:57.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.473547+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.473547+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.473828+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.473828+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.477495+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:57.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.485331+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:57.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.486323+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:57.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.487172+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:57.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[9777]: audit 2021-03-10T20:10:56.488270+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:57.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.477495+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:57.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.485331+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:57.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.486323+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:57.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.487172+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:57.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:56 gibba004 bash[12967]: audit 2021-03-10T20:10:56.488270+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:57.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.473547+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.473828+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:10:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.477495+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:44.383242Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:10:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.485331+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:57.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.486323+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:57.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.487172+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:57.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:56 gibba009 bash[9804]: audit 2021-03-10T20:10:56.488270+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:57.875 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[9777]: cluster 2021-03-10T20:10:56.388855+0000 mgr.gibba009.xiladd (mgr.34418) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:57.875 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[9777]: cephadm 2021-03-10T20:10:56.485072+0000 mgr.gibba009.xiladd (mgr.34418) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:57.875 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[9777]: cephadm 2021-03-10T20:10:56.487984+0000 mgr.gibba009.xiladd (mgr.34418) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:10:57.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[12967]: cluster 2021-03-10T20:10:56.388855+0000 mgr.gibba009.xiladd (mgr.34418) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:57.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[12967]: cephadm 2021-03-10T20:10:56.485072+0000 mgr.gibba009.xiladd (mgr.34418) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:57.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:57 gibba004 bash[12967]: cephadm 2021-03-10T20:10:56.487984+0000 mgr.gibba009.xiladd (mgr.34418) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:10:58.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:57 gibba009 bash[9804]: cluster 2021-03-10T20:10:56.388855+0000 mgr.gibba009.xiladd (mgr.34418) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:58.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:57 gibba009 bash[9804]: cephadm 2021-03-10T20:10:56.485072+0000 mgr.gibba009.xiladd (mgr.34418) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:58.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:57 gibba009 bash[9804]: cephadm 2021-03-10T20:10:56.487984+0000 mgr.gibba009.xiladd (mgr.34418) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:10:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[9777]: audit 2021-03-10T20:10:58.365577+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[12967]: audit 2021-03-10T20:10:58.365577+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[12967]: audit 2021-03-10T20:10:58.365713+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[12967]: audit 2021-03-10T20:10:58.369693+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:10:59.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[9777]: audit 2021-03-10T20:10:58.365713+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:58 gibba004 bash[9777]: audit 2021-03-10T20:10:58.369693+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:10:59.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:58 gibba009 bash[9804]: audit 2021-03-10T20:10:58.365577+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:58 gibba009 bash[9804]: audit 2021-03-10T20:10:58.365713+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:10:59.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:58 gibba009 bash[9804]: audit 2021-03-10T20:10:58.369693+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"992da04b7f06\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13411287, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539009Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:06:02.652351Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:05:55.991596Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:53.539137Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:00.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[9777]: cephadm 2021-03-10T20:10:58.377661+0000 mgr.gibba009.xiladd (mgr.34418) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:11:00.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[9777]: cephadm 2021-03-10T20:10:58.383931+0000 mgr.gibba009.xiladd (mgr.34418) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:11:00.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[9777]: cluster 2021-03-10T20:10:58.389296+0000 mgr.gibba009.xiladd (mgr.34418) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:00.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[12967]: cephadm 2021-03-10T20:10:58.377661+0000 mgr.gibba009.xiladd (mgr.34418) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:11:00.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[12967]: cephadm 2021-03-10T20:10:58.383931+0000 mgr.gibba009.xiladd (mgr.34418) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:11:00.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:10:59 gibba004 bash[12967]: cluster 2021-03-10T20:10:58.389296+0000 mgr.gibba009.xiladd (mgr.34418) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:00.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:59 gibba009 bash[9804]: cephadm 2021-03-10T20:10:58.377661+0000 mgr.gibba009.xiladd (mgr.34418) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:11:00.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:59 gibba009 bash[9804]: cephadm 2021-03-10T20:10:58.383931+0000 mgr.gibba009.xiladd (mgr.34418) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba004 2021-03-10T20:11:00.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:10:59 gibba009 bash[9804]: cluster 2021-03-10T20:10:58.389296+0000 mgr.gibba009.xiladd (mgr.34418) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:01.904 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:01 gibba004 bash[9777]: cluster 2021-03-10T20:11:00.391319+0000 mgr.gibba009.xiladd (mgr.34418) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:01.905 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:01 gibba004 bash[12967]: cluster 2021-03-10T20:11:00.391319+0000 mgr.gibba009.xiladd (mgr.34418) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:01 gibba009 bash[9804]: cluster 2021-03-10T20:11:00.391319+0000 mgr.gibba009.xiladd (mgr.34418) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:03.858 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:03 gibba004 bash[9777]: cluster 2021-03-10T20:11:02.392299+0000 mgr.gibba009.xiladd (mgr.34418) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:03.859 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:03 gibba004 bash[12967]: cluster 2021-03-10T20:11:02.392299+0000 mgr.gibba009.xiladd (mgr.34418) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:03 gibba009 bash[9804]: cluster 2021-03-10T20:11:02.392299+0000 mgr.gibba009.xiladd (mgr.34418) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:04.562 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 systemd[1]: Stopping Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:04.562 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 bash[21918]: level=info ts=2021-03-10T20:11:04.371Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:11:05.312 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 docker[29387]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:11:05.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T20:11:05.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 systemd[1]: Stopped Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:05.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 systemd[1]: Starting Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:05.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 docker[29421]: Error: No such container: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:11:05.314 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:04 gibba004 systemd[1]: Started Ceph alertmanager.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:05.988 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: cluster 2021-03-10T20:11:04.393359+0000 mgr.gibba009.xiladd (mgr.34418) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:05.989 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: cluster 2021-03-10T20:11:04.393359+0000 mgr.gibba009.xiladd (mgr.34418) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:05.989 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.005023+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:05.990 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.005202+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:05.990 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.005023+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:05.991 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.009030+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:05.991 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.016260+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:05.991 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.017032+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:05.992 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.017809+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:05.992 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[9777]: audit 2021-03-10T20:11:05.018689+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:05.992 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.005202+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:05.993 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.009030+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:05.993 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.016260+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:05.993 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.017032+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:05.994 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.017809+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:05.994 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:05 gibba004 bash[12967]: audit 2021-03-10T20:11:05.018689+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:06.041 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: cluster 2021-03-10T20:11:04.393359+0000 mgr.gibba009.xiladd (mgr.34418) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:06.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.005023+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:06.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.005202+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:06.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.009030+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"880e4880fd17\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538242Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:00:42.258489Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:17.672203Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:06.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.016260+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:06.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.017032+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:06.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.017809+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:06.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:05 gibba009 bash[9804]: audit 2021-03-10T20:11:05.018689+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:06.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.020Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:11:06.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.020Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:11:06.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.021Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.104 port=9094 2021-03-10T20:11:06.313 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.022Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:11:06.314 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.035Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:11:06.314 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.036Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:11:06.314 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:06.038Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:11:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[9777]: cephadm 2021-03-10T20:11:05.016037+0000 mgr.gibba009.xiladd (mgr.34418) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:11:07.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[9777]: cephadm 2021-03-10T20:11:05.018440+0000 mgr.gibba009.xiladd (mgr.34418) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:11:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[12967]: cephadm 2021-03-10T20:11:05.016037+0000 mgr.gibba009.xiladd (mgr.34418) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:11:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:06 gibba004 bash[12967]: cephadm 2021-03-10T20:11:05.018440+0000 mgr.gibba009.xiladd (mgr.34418) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:11:07.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:06 gibba009 bash[9804]: cephadm 2021-03-10T20:11:05.016037+0000 mgr.gibba009.xiladd (mgr.34418) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:11:07.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:06 gibba009 bash[9804]: cephadm 2021-03-10T20:11:05.018440+0000 mgr.gibba009.xiladd (mgr.34418) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:11:08.023 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: cluster 2021-03-10T20:11:06.395279+0000 mgr.gibba009.xiladd (mgr.34418) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:08.024 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: cluster 2021-03-10T20:11:06.395279+0000 mgr.gibba009.xiladd (mgr.34418) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:08.025 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: audit 2021-03-10T20:11:06.758986+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.025 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: audit 2021-03-10T20:11:06.758986+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.026 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: audit 2021-03-10T20:11:06.759180+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.026 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: audit 2021-03-10T20:11:06.765148+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:11:08.027 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: audit 2021-03-10T20:11:06.770455+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.027 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: audit 2021-03-10T20:11:06.770789+0000 mgr.gibba009.xiladd (mgr.34418) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.027 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: cephadm 2021-03-10T20:11:06.771673+0000 mgr.gibba009.xiladd (mgr.34418) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:11:08.027 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[9777]: cephadm 2021-03-10T20:11:06.771808+0000 mgr.gibba009.xiladd (mgr.34418) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:11:08.028 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: audit 2021-03-10T20:11:06.759180+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.029 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: audit 2021-03-10T20:11:06.765148+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:11:08.029 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: audit 2021-03-10T20:11:06.770455+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.030 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: audit 2021-03-10T20:11:06.770789+0000 mgr.gibba009.xiladd (mgr.34418) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.030 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: cephadm 2021-03-10T20:11:06.771673+0000 mgr.gibba009.xiladd (mgr.34418) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:11:08.030 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:07 gibba004 bash[12967]: cephadm 2021-03-10T20:11:06.771808+0000 mgr.gibba009.xiladd (mgr.34418) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:11:08.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: cluster 2021-03-10T20:11:06.395279+0000 mgr.gibba009.xiladd (mgr.34418) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:08.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: audit 2021-03-10T20:11:06.758986+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: audit 2021-03-10T20:11:06.759180+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: audit 2021-03-10T20:11:06.765148+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:10:54.152318Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:01:33.487530Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:11:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: audit 2021-03-10T20:11:06.770455+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: audit 2021-03-10T20:11:06.770789+0000 mgr.gibba009.xiladd (mgr.34418) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:11:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: cephadm 2021-03-10T20:11:06.771673+0000 mgr.gibba009.xiladd (mgr.34418) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:11:08.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:07 gibba009 bash[9804]: cephadm 2021-03-10T20:11:06.771808+0000 mgr.gibba009.xiladd (mgr.34418) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:11:08.296 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:08 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:08.022Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000102397s 2021-03-10T20:11:10.051 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: cluster 2021-03-10T20:11:08.396509+0000 mgr.gibba009.xiladd (mgr.34418) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:10.051 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: audit 2021-03-10T20:11:08.895155+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.052 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: audit 2021-03-10T20:11:08.895474+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.052 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: audit 2021-03-10T20:11:08.899123+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:11:10.052 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: cephadm 2021-03-10T20:11:08.905881+0000 mgr.gibba009.xiladd (mgr.34418) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:10.052 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: audit 2021-03-10T20:11:08.906622+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:10.053 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: cephadm 2021-03-10T20:11:08.907509+0000 mgr.gibba009.xiladd (mgr.34418) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:10.053 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[9777]: cephadm 2021-03-10T20:11:08.907744+0000 mgr.gibba009.xiladd (mgr.34418) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:11:10.053 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: cluster 2021-03-10T20:11:08.396509+0000 mgr.gibba009.xiladd (mgr.34418) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:10.053 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: audit 2021-03-10T20:11:08.895155+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.054 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: audit 2021-03-10T20:11:08.895474+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.054 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: audit 2021-03-10T20:11:08.899123+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:11:10.054 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: cephadm 2021-03-10T20:11:08.905881+0000 mgr.gibba009.xiladd (mgr.34418) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:10.054 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: audit 2021-03-10T20:11:08.906622+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:10.055 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: cephadm 2021-03-10T20:11:08.907509+0000 mgr.gibba009.xiladd (mgr.34418) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:10.055 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:09 gibba004 bash[12967]: cephadm 2021-03-10T20:11:08.907744+0000 mgr.gibba009.xiladd (mgr.34418) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:11:10.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: cluster 2021-03-10T20:11:08.396509+0000 mgr.gibba009.xiladd (mgr.34418) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: audit 2021-03-10T20:11:08.895155+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: audit 2021-03-10T20:11:08.895474+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:11:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: audit 2021-03-10T20:11:08.899123+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"9df51a7d-7a08-46d6-9710-45deb94cfca8\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:11:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: cephadm 2021-03-10T20:11:08.905881+0000 mgr.gibba009.xiladd (mgr.34418) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: audit 2021-03-10T20:11:08.906622+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: cephadm 2021-03-10T20:11:08.907509+0000 mgr.gibba009.xiladd (mgr.34418) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:09 gibba009 bash[9804]: cephadm 2021-03-10T20:11:08.907744+0000 mgr.gibba009.xiladd (mgr.34418) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:11:11.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.656599+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.656938+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.660772+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T20:11:11.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.667569+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.668410+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.670057+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:11:11.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.670827+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:11.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[9777]: audit 2021-03-10T20:11:10.671866+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:11:11.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.656599+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.656938+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.660772+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T20:11:11.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.667569+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.668410+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.670057+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:11:11.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.670827+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:11.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:10 gibba004 bash[12967]: audit 2021-03-10T20:11:10.671866+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:11:11.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.656599+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.656938+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:11.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.660772+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T20:11:11.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.667569+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.668410+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:11:11.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.670057+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:11:11.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.670827+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:11.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:10 gibba009 bash[9804]: audit 2021-03-10T20:11:10.671866+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:11:11.958 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[9777]: cluster 2021-03-10T20:11:10.398896+0000 mgr.gibba009.xiladd (mgr.34418) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:11.958 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[9777]: cephadm 2021-03-10T20:11:10.656004+0000 mgr.gibba009.xiladd (mgr.34418) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:11:11.959 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[9777]: cephadm 2021-03-10T20:11:10.671582+0000 mgr.gibba009.xiladd (mgr.34418) 38 : cephadm [INF] Deploying daemon mgr.y on gibba004 2021-03-10T20:11:11.959 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[12967]: cluster 2021-03-10T20:11:10.398896+0000 mgr.gibba009.xiladd (mgr.34418) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:11.959 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[12967]: cephadm 2021-03-10T20:11:10.656004+0000 mgr.gibba009.xiladd (mgr.34418) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:11:11.960 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:11 gibba004 bash[12967]: cephadm 2021-03-10T20:11:10.671582+0000 mgr.gibba009.xiladd (mgr.34418) 38 : cephadm [INF] Deploying daemon mgr.y on gibba004 2021-03-10T20:11:12.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:11 gibba009 bash[9804]: cluster 2021-03-10T20:11:10.398896+0000 mgr.gibba009.xiladd (mgr.34418) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:12.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:11 gibba009 bash[9804]: cephadm 2021-03-10T20:11:10.656004+0000 mgr.gibba009.xiladd (mgr.34418) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:11:12.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:11 gibba009 bash[9804]: cephadm 2021-03-10T20:11:10.671582+0000 mgr.gibba009.xiladd (mgr.34418) 38 : cephadm [INF] Deploying daemon mgr.y on gibba004 2021-03-10T20:11:12.812 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:12 gibba004 systemd[1]: Stopping Ceph mgr.y for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:14.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:13 gibba004 bash[9777]: cluster 2021-03-10T20:11:12.400130+0000 mgr.gibba009.xiladd (mgr.34418) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:14.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:13 gibba004 bash[12967]: cluster 2021-03-10T20:11:12.400130+0000 mgr.gibba009.xiladd (mgr.34418) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:14.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:13 gibba009 bash[9804]: cluster 2021-03-10T20:11:12.400130+0000 mgr.gibba009.xiladd (mgr.34418) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:16.023 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:15 gibba004 bash[9777]: cluster 2021-03-10T20:11:14.401227+0000 mgr.gibba009.xiladd (mgr.34418) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:16.024 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:15 gibba004 bash[12967]: cluster 2021-03-10T20:11:14.401227+0000 mgr.gibba009.xiladd (mgr.34418) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:15 gibba009 bash[9804]: cluster 2021-03-10T20:11:14.401227+0000 mgr.gibba009.xiladd (mgr.34418) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:16.312 INFO:journalctl@ceph.alertmanager.a.gibba004.stdout:Mar 10 20:11:16 gibba004 bash[29439]: level=info ts=2021-03-10T20:11:16.023Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001056435s 2021-03-10T20:11:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:17 gibba004 bash[9777]: cluster 2021-03-10T20:11:16.403438+0000 mgr.gibba009.xiladd (mgr.34418) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:17 gibba004 bash[12967]: cluster 2021-03-10T20:11:16.403438+0000 mgr.gibba009.xiladd (mgr.34418) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:18.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:17 gibba009 bash[9804]: cluster 2021-03-10T20:11:16.403438+0000 mgr.gibba009.xiladd (mgr.34418) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:19 gibba004 bash[9777]: cluster 2021-03-10T20:11:18.404723+0000 mgr.gibba009.xiladd (mgr.34418) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:20.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:19 gibba004 bash[12967]: cluster 2021-03-10T20:11:18.404723+0000 mgr.gibba009.xiladd (mgr.34418) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:20.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:19 gibba009 bash[9804]: cluster 2021-03-10T20:11:18.404723+0000 mgr.gibba009.xiladd (mgr.34418) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:21 gibba004 bash[9777]: cluster 2021-03-10T20:11:20.406892+0000 mgr.gibba009.xiladd (mgr.34418) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:22.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:21 gibba004 bash[12967]: cluster 2021-03-10T20:11:20.406892+0000 mgr.gibba009.xiladd (mgr.34418) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:22.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:21 gibba009 bash[9804]: cluster 2021-03-10T20:11:20.406892+0000 mgr.gibba009.xiladd (mgr.34418) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:23.776 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:23 gibba004 docker[29779]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mgr.y 2021-03-10T20:11:23.777 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:23 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2021-03-10T20:11:23.777 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:23 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-03-10T20:11:23.777 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:23 gibba004 systemd[1]: Stopped Ceph mgr.y for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:23.777 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:23 gibba004 systemd[1]: Started Ceph mgr.y for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[9777]: cluster 2021-03-10T20:11:22.408043+0000 mgr.gibba009.xiladd (mgr.34418) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[12967]: cluster 2021-03-10T20:11:22.408043+0000 mgr.gibba009.xiladd (mgr.34418) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:24.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[9777]: audit 2021-03-10T20:11:23.581185+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[12967]: audit 2021-03-10T20:11:23.581185+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[9777]: audit 2021-03-10T20:11:23.581395+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[9777]: audit 2021-03-10T20:11:23.585078+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:24.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[9777]: audit 2021-03-10T20:11:23.591546+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:24.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[12967]: audit 2021-03-10T20:11:23.581395+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[12967]: audit 2021-03-10T20:11:23.585078+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:24.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:23 gibba004 bash[12967]: audit 2021-03-10T20:11:23.591546+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:24.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:23 gibba009 bash[9804]: cluster 2021-03-10T20:11:22.408043+0000 mgr.gibba009.xiladd (mgr.34418) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:24.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:23 gibba009 bash[9804]: audit 2021-03-10T20:11:23.581185+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:23 gibba009 bash[9804]: audit 2021-03-10T20:11:23.581395+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]: dispatch 2021-03-10T20:11:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:23 gibba009 bash[9804]: audit 2021-03-10T20:11:23.585078+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:01:01.752068Z\"}"}]': finished 2021-03-10T20:11:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:23 gibba009 bash[9804]: audit 2021-03-10T20:11:23.591546+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:25.062 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[29877]: debug 2021-03-10T20:11:24.659+0000 7f39cd2cd700 1 -- 172.21.2.104:0/610511671 <== mon.0 v2:172.21.2.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557e67bc04e0 con 0x557e67cb1000 2021-03-10T20:11:25.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[12967]: audit 2021-03-10T20:11:23.785195+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[9777]: audit 2021-03-10T20:11:23.785195+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[12967]: audit 2021-03-10T20:11:23.786032+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[12967]: audit 2021-03-10T20:11:23.787423+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:25.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[12967]: audit 2021-03-10T20:11:23.789492+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:25.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[9777]: audit 2021-03-10T20:11:23.786032+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[9777]: audit 2021-03-10T20:11:23.787423+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:25.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:24 gibba004 bash[9777]: audit 2021-03-10T20:11:23.789492+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:25.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:24 gibba009 bash[9804]: audit 2021-03-10T20:11:23.785195+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:24 gibba009 bash[9804]: audit 2021-03-10T20:11:23.786032+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:25.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:24 gibba009 bash[9804]: audit 2021-03-10T20:11:23.787423+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96720650, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538054Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91750400, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538323Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538398Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48905584, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538587Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46839889, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538713Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49062871, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538830Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23309844, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.538950Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:53.539061Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:25.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:24 gibba009 bash[9804]: audit 2021-03-10T20:11:23.789492+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:25.106 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:11:25.334 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:11:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 starting - - 2021-03-10T20:11:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (5m) 31s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:11:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (46s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:11:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (63s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:11:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 starting - - 2021-03-10T20:11:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (10m) 31s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 01602dd42b4c 2021-03-10T20:11:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 40c0351a70b1 2021-03-10T20:11:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a6ab2f2fedfc 2021-03-10T20:11:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (5m) 31s ago 5m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:11:25.337 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (5m) 31s ago 5m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:11:25.337 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:11:25.337 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:11:25.338 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:11:25.338 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:11:25.338 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:11:25.339 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:11:25.339 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:11:25.339 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:11:25.339 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (5m) 31s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:11:25.340 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 31s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:25.340 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 31s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:25.587 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:11:25.587 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:11:25.587 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:11:25.587 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:25.588 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:11:25.588 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:11:25.588 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:11:25.588 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:25.589 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:11:25.589 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:11:25.589 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:25.589 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:11:25.589 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:11:25.590 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T20:11:25.590 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:11:25.590 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:11:25.590 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:11:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:25 gibba004 bash[9777]: cluster 2021-03-10T20:11:24.408988+0000 mgr.gibba009.xiladd (mgr.34418) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:25 gibba004 bash[9777]: audit 2021-03-10T20:11:25.586955+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.104:0/3701898246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:25 gibba004 bash[12967]: cluster 2021-03-10T20:11:24.408988+0000 mgr.gibba009.xiladd (mgr.34418) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:25 gibba004 bash[12967]: audit 2021-03-10T20:11:25.586955+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.104:0/3701898246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:26.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:25 gibba009 bash[9804]: cluster 2021-03-10T20:11:24.408988+0000 mgr.gibba009.xiladd (mgr.34418) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:26.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:25 gibba009 bash[9804]: audit 2021-03-10T20:11:25.586955+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.104:0/3701898246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:27.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:26 gibba004 bash[9777]: audit 2021-03-10T20:11:25.099016+0000 mgr.gibba009.xiladd (mgr.34418) 46 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:27.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:26 gibba004 bash[9777]: audit 2021-03-10T20:11:25.324572+0000 mgr.gibba009.xiladd (mgr.34418) 47 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:26 gibba004 bash[12967]: audit 2021-03-10T20:11:25.099016+0000 mgr.gibba009.xiladd (mgr.34418) 46 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:26 gibba004 bash[12967]: audit 2021-03-10T20:11:25.324572+0000 mgr.gibba009.xiladd (mgr.34418) 47 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:27.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:26 gibba009 bash[9804]: audit 2021-03-10T20:11:25.099016+0000 mgr.gibba009.xiladd (mgr.34418) 46 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:27.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:26 gibba009 bash[9804]: audit 2021-03-10T20:11:25.324572+0000 mgr.gibba009.xiladd (mgr.34418) 47 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:28.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: cluster 2021-03-10T20:11:26.411143+0000 mgr.gibba009.xiladd (mgr.34418) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:28.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: cluster 2021-03-10T20:11:26.411143+0000 mgr.gibba009.xiladd (mgr.34418) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:28.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.479469+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.479469+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.480132+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.482574+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.484744+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.480132+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.482574+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.484744+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.485642+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.487058+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:11:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.493613+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.494889+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.495154+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.496043+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.498204+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T20:11:28.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.500077+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.500955+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.502959+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:11:28.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.505140+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.506025+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.507846+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:11:28.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.509203+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.510171+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.511962+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:11:28.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[9777]: audit 2021-03-10T20:11:27.514495+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:11:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.485642+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.487058+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:11:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.493613+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.494889+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.495154+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.496043+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.498204+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T20:11:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.500077+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.500955+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.502959+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:11:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.505140+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.506025+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.507846+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:11:28.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.509203+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.510171+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.511962+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:11:28.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:27 gibba004 bash[12967]: audit 2021-03-10T20:11:27.514495+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:11:28.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: cluster 2021-03-10T20:11:26.411143+0000 mgr.gibba009.xiladd (mgr.34418) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:28.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.479469+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.480132+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:28.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.482574+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"01602dd42b4c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104574484, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.474753Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:00:40.144559Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:54.396018Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:27.479197Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]': finished 2021-03-10T20:11:28.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.484744+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.485642+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.487058+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:11:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.493613+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.494889+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.495154+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.496043+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T20:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.498204+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T20:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.500077+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.500955+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]: dispatch 2021-03-10T20:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.502959+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba009.xiladd"}]': finished 2021-03-10T20:11:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.505140+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.506025+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:11:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.507846+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:11:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.509203+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.510171+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:11:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.511962+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:11:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:27 gibba009 bash[9804]: audit 2021-03-10T20:11:27.514495+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:11:29.059 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.492961+0000 mgr.gibba009.xiladd (mgr.34418) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:29.059 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.494592+0000 mgr.gibba009.xiladd (mgr.34418) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:29.059 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.495771+0000 mgr.gibba009.xiladd (mgr.34418) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:11:29.059 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.495821+0000 mgr.gibba009.xiladd (mgr.34418) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:11:29.060 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.514172+0000 mgr.gibba009.xiladd (mgr.34418) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:29.060 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.514207+0000 mgr.gibba009.xiladd (mgr.34418) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:29.060 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.515124+0000 mgr.gibba009.xiladd (mgr.34418) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:11:29.060 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cephadm 2021-03-10T20:11:27.515165+0000 mgr.gibba009.xiladd (mgr.34418) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:11:29.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cluster 2021-03-10T20:11:28.647365+0000 mon.a (mon.0) 730 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:29.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: cluster 2021-03-10T20:11:28.647433+0000 mon.a (mon.0) 731 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:29.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: audit 2021-03-10T20:11:28.648407+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:29.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[9777]: audit 2021-03-10T20:11:28.649293+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:29.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.492961+0000 mgr.gibba009.xiladd (mgr.34418) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:29.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.494592+0000 mgr.gibba009.xiladd (mgr.34418) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:29.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.495771+0000 mgr.gibba009.xiladd (mgr.34418) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:11:29.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.495821+0000 mgr.gibba009.xiladd (mgr.34418) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:11:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.514172+0000 mgr.gibba009.xiladd (mgr.34418) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.514207+0000 mgr.gibba009.xiladd (mgr.34418) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.515124+0000 mgr.gibba009.xiladd (mgr.34418) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:11:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cephadm 2021-03-10T20:11:27.515165+0000 mgr.gibba009.xiladd (mgr.34418) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:11:29.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cluster 2021-03-10T20:11:28.647365+0000 mon.a (mon.0) 730 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:29.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: cluster 2021-03-10T20:11:28.647433+0000 mon.a (mon.0) 731 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:29.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: audit 2021-03-10T20:11:28.648407+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:29.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:28 gibba004 bash[12967]: audit 2021-03-10T20:11:28.649293+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:29.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.492961+0000 mgr.gibba009.xiladd (mgr.34418) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:29.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.494592+0000 mgr.gibba009.xiladd (mgr.34418) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:29.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.495771+0000 mgr.gibba009.xiladd (mgr.34418) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:11:29.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.495821+0000 mgr.gibba009.xiladd (mgr.34418) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:11:29.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.514172+0000 mgr.gibba009.xiladd (mgr.34418) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:29.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.514207+0000 mgr.gibba009.xiladd (mgr.34418) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:29.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.515124+0000 mgr.gibba009.xiladd (mgr.34418) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:11:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cephadm 2021-03-10T20:11:27.515165+0000 mgr.gibba009.xiladd (mgr.34418) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:11:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cluster 2021-03-10T20:11:28.647365+0000 mon.a (mon.0) 730 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: cluster 2021-03-10T20:11:28.647433+0000 mon.a (mon.0) 731 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: audit 2021-03-10T20:11:28.648407+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:29.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:28 gibba009 bash[9804]: audit 2021-03-10T20:11:28.649293+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.? 172.21.2.104:0/148896273' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: cluster 2021-03-10T20:11:28.412296+0000 mgr.gibba009.xiladd (mgr.34418) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: cluster 2021-03-10T20:11:28.826939+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 44s), standbys: y, x 2021-03-10T20:11:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.574973+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.575346+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.579074+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T20:11:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.586527+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.587291+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.587962+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[9777]: audit 2021-03-10T20:11:29.588819+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:11:30.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: cluster 2021-03-10T20:11:28.412296+0000 mgr.gibba009.xiladd (mgr.34418) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:30.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: cluster 2021-03-10T20:11:28.826939+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 44s), standbys: y, x 2021-03-10T20:11:30.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.574973+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.575346+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.579074+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T20:11:30.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.586527+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:30.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.587291+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:30.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.587962+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:30.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:29 gibba004 bash[12967]: audit 2021-03-10T20:11:29.588819+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:11:30.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: cluster 2021-03-10T20:11:28.412296+0000 mgr.gibba009.xiladd (mgr.34418) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:30.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: cluster 2021-03-10T20:11:28.826939+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 44s), standbys: y, x 2021-03-10T20:11:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.574973+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.575346+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T20:11:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.579074+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34418 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T20:11:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.586527+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:30.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.587291+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:30.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.587962+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:30.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:29 gibba009 bash[9804]: audit 2021-03-10T20:11:29.588819+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:11:31.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:30 gibba004 bash[9777]: cephadm 2021-03-10T20:11:29.574312+0000 mgr.gibba009.xiladd (mgr.34418) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:11:31.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:30 gibba004 bash[9777]: cephadm 2021-03-10T20:11:29.588483+0000 mgr.gibba009.xiladd (mgr.34418) 59 : cephadm [INF] Deploying daemon mon.a on gibba004 2021-03-10T20:11:31.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:30 gibba004 bash[12967]: cephadm 2021-03-10T20:11:29.574312+0000 mgr.gibba009.xiladd (mgr.34418) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:11:31.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:30 gibba004 bash[12967]: cephadm 2021-03-10T20:11:29.588483+0000 mgr.gibba009.xiladd (mgr.34418) 59 : cephadm [INF] Deploying daemon mon.a on gibba004 2021-03-10T20:11:31.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:30 gibba009 bash[9804]: cephadm 2021-03-10T20:11:29.574312+0000 mgr.gibba009.xiladd (mgr.34418) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:11:31.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:30 gibba009 bash[9804]: cephadm 2021-03-10T20:11:29.588483+0000 mgr.gibba009.xiladd (mgr.34418) 59 : cephadm [INF] Deploying daemon mon.a on gibba004 2021-03-10T20:11:31.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:31 gibba004 systemd[1]: Stopping Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:31.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:31 gibba004 bash[9777]: debug 2021-03-10T20:11:31.543+0000 7fa80fc26700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:11:31.655 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:31 gibba004 bash[9777]: debug 2021-03-10T20:11:31.543+0000 7fa80fc26700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-03-10T20:11:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:32 gibba004 docker[30794]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.a 2021-03-10T20:11:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:32 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T20:11:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:32 gibba004 systemd[1]: Stopped Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:32 gibba004 systemd[1]: Started Ceph mon.a for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.367+0000 7f2f8b0c8700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:11:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.367+0000 7f2f8b0c8700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:11:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.367+0000 7f2f8b0c8700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:11:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 0 load: jerasure load: lrc load: isa 2021-03-10T20:11:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:11:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:11:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:11:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: DB SUMMARY 2021-03-10T20:11:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:11:33.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:11:33.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 749 Bytes 2021-03-10T20:11:33.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000023.sst 000024.sst 2021-03-10T20:11:33.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000021.log size: 10689766 ; 2021-03-10T20:11:33.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:11:33.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:11:33.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:11:33.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.env: 0x5570ee53f1c0 2021-03-10T20:11:33.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:11:33.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.info_log: 0x5570f084f1e0 2021-03-10T20:11:33.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:11:33.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:11:33.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:11:33.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:11:33.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:11:33.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:11:33.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:11:33.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:11:33.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:11:33.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:11:33.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:11:33.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:11:33.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:11:33.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:11:33.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:11:33.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T20:11:33.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:11:33.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:11:33.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:11:33.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:11:33.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:11:33.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:11:33.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:11:33.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:11:33.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:11:33.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:11:33.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.write_buffer_manager: 0x5570f08a3c50 2021-03-10T20:11:33.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:11:33.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:11:33.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:11:33.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:11:33.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:11:33.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:11:33.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:11:33.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:11:33.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:11:33.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:11:33.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:11:33.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:11:33.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:11:33.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:11:33.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.row_cache: None 2021-03-10T20:11:33.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:11:33.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:11:33.579 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:11:33.579 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:11:33.579 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:11:33.579 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:11:33.580 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:11:33.580 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:11:33.580 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:11:33.580 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:11:33.580 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:11:33.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:11:33.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:11:33.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:11:33.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:11:33.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:11:33.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:11:33.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:11:33.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:11:33.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:11:33.583 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:11:33.583 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:11:33.583 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:11:33.583 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:11:33.583 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:11:33.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:11:33.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:11:33.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:11:33.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:11:33.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:11:33.585 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:11:33.585 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:11:33.585 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:11:33.585 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:11:33.586 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:11:33.586 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:11:33.586 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:11:33.586 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-03-10T20:11:33.586 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:11:33.587 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:11:33.587 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.merge_operator: 2021-03-10T20:11:33.587 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:11:33.587 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:11:33.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:11:33.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:11:33.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570f07f2230) 2021-03-10T20:11:33.588 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: cache_index_and_filter_blocks: 1 2021-03-10T20:11:33.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:11:33.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:11:33.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: pin_top_level_index_and_filter: 1 2021-03-10T20:11:33.589 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: index_type: 0 2021-03-10T20:11:33.590 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: data_block_index_type: 0 2021-03-10T20:11:33.590 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: index_shortening: 1 2021-03-10T20:11:33.590 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:11:33.590 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: hash_index_allow_collision: 1 2021-03-10T20:11:33.590 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: checksum: 1 2021-03-10T20:11:33.591 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: no_block_cache: 0 2021-03-10T20:11:33.591 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_cache: 0x5570f082a510 2021-03-10T20:11:33.591 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_cache_name: BinnedLRUCache 2021-03-10T20:11:33.591 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_cache_options: 2021-03-10T20:11:33.592 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: capacity : 536870912 2021-03-10T20:11:33.592 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: num_shard_bits : 4 2021-03-10T20:11:33.592 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: strict_capacity_limit : 0 2021-03-10T20:11:33.592 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: high_pri_pool_ratio: 0.000 2021-03-10T20:11:33.592 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_cache_compressed: (nil) 2021-03-10T20:11:33.593 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: persistent_cache: (nil) 2021-03-10T20:11:33.593 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_size: 4096 2021-03-10T20:11:33.593 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_size_deviation: 10 2021-03-10T20:11:33.593 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_restart_interval: 16 2021-03-10T20:11:33.593 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: index_block_restart_interval: 1 2021-03-10T20:11:33.594 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: metadata_block_size: 4096 2021-03-10T20:11:33.594 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: partition_filters: 0 2021-03-10T20:11:33.594 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: use_delta_encoding: 1 2021-03-10T20:11:33.594 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:11:33.595 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: whole_key_filtering: 1 2021-03-10T20:11:33.595 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: verify_compression: 0 2021-03-10T20:11:33.595 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: read_amp_bytes_per_bit: 0 2021-03-10T20:11:33.595 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: format_version: 2 2021-03-10T20:11:33.595 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: enable_index_compression: 1 2021-03-10T20:11:33.596 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: block_align: 0 2021-03-10T20:11:33.596 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:11:33.596 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:11:33.596 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:11:33.597 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:11:33.597 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:11:33.597 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:11:33.597 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:11:33.598 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:11:33.598 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:11:33.598 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:11:33.598 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:11:33.599 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:11:33.599 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:11:33.599 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:11:33.599 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:11:33.599 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:11:33.600 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:11:33.600 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:11:33.600 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:11:33.600 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:11:33.601 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:11:33.601 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:11:33.601 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:11:33.601 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:11:33.602 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:11:33.602 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:11:33.602 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:11:33.602 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:11:33.602 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:11:33.603 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:11:33.603 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:11:33.603 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:11:33.603 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:11:33.604 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:11:33.604 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:11:33.604 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:11:33.604 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:11:33.604 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:11:33.605 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:11:33.605 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:11:33.605 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:11:33.605 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:11:33.606 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:11:33.606 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:11:33.606 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:11:33.606 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:11:33.607 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:11:33.607 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:11:33.607 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:11:33.607 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:11:33.608 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:11:33.608 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:11:33.608 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:11:33.608 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:11:33.608 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:11:33.609 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:11:33.609 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:11:33.609 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:11:33.609 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:11:33.609 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:11:33.610 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:11:33.610 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:11:33.610 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:11:33.610 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:11:33.611 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:11:33.611 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:11:33.611 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:11:33.611 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:11:33.611 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 26, last_sequence is 8743, log_number is 21,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:11:33.612 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 21 2021-03-10T20:11:33.612 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407093382043, "job": 1, "event": "recovery_started", "log_files": [21]} 2021-03-10T20:11:33.612 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.375+0000 7f2f8b0c8700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #21 mode 2 2021-03-10T20:11:33.612 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.383+0000 7f2f8b0c8700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:11:33.613 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.391+0000 7f2f8b0c8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407093397568, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 26, "file_size": 10631450, "table_properties": {"data_size": 10626674, "index_size": 3505, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 4038, "raw_average_key_size": 22, "raw_value_size": 10621326, "raw_average_value_size": 60348, "num_data_blocks": 108, "num_entries": 176, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615407093, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:11:33.613 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.391+0000 7f2f8b0c8700 4 rocksdb: [version_set.cc:3826] Creating manifest 27 2021-03-10T20:11:33.613 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407093398309, "job": 1, "event": "recovery_finished"} 2021-03-10T20:11:33.613 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 4 rocksdb: DB pointer 0x5570f08ef800 2021-03-10T20:11:33.613 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f71edb700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:11:33.614 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f71edb700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:11:33.614 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** DB Stats ** 2021-03-10T20:11:33.614 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:33.614 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:11:33.615 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:11:33.615 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:11:33.615 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:11:33.615 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:11:33.615 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:11:33.616 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** Compaction Stats [default] ** 2021-03-10T20:11:33.616 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:33.616 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:33.617 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: L0 1/0 10.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.617 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:33.617 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Sum 3/0 77.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.617 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.617 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** Compaction Stats [default] ** 2021-03-10T20:11:33.618 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:33.618 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:33.618 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.618 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:33.619 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Flush(GB): cumulative 0.010, interval 0.010 2021-03-10T20:11:33.619 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:11:33.619 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:11:33.619 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:11:33.620 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:11:33.620 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Cumulative compaction: 0.01 GB write, 547.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:33.620 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Interval compaction: 0.01 GB write, 547.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:33.620 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:11:33.621 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:11:33.621 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** Compaction Stats [default] ** 2021-03-10T20:11:33.621 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:33.621 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:33.621 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: L0 1/0 10.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.622 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:33.622 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Sum 3/0 77.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.622 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:33.623 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** Compaction Stats [default] ** 2021-03-10T20:11:33.623 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:33.623 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:33.623 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1135.5 0.01 0.00 1 0.009 0 0 2021-03-10T20:11:33.623 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:33.624 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Flush(GB): cumulative 0.010, interval 0.000 2021-03-10T20:11:33.624 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:11:33.624 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:11:33.624 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:11:33.625 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:11:33.625 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Cumulative compaction: 0.01 GB write, 547.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:33.625 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:33.625 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:11:33.625 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:11:33.626 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] at bind addrs [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:11:33.626 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 1 mon.a@-1(???) e3 preinit fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:11:33.626 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).mds e1 new map 2021-03-10T20:11:33.626 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).mds e1 print_map 2021-03-10T20:11:33.626 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: e1 2021-03-10T20:11:33.627 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:11:33.627 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:11:33.627 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: legacy client fscid: -1 2021-03-10T20:11:33.627 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: 2021-03-10T20:11:33.628 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: No filesystems configured 2021-03-10T20:11:33.628 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:11:33.628 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:33.628 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:33.629 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:33.629 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: cephadm 2021-03-10T20:11:29.574312+0000 mgr.gibba009.xiladd (mgr.34418) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:11:33.629 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: cephadm 2021-03-10T20:11:29.588483+0000 mgr.gibba009.xiladd (mgr.34418) 59 : cephadm [INF] Deploying daemon mon.a on gibba004 2021-03-10T20:11:33.630 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:33 gibba004 bash[30897]: debug 2021-03-10T20:11:33.395+0000 7f2f8b0c8700 1 mon.a@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2021-03-10T20:11:35.312 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[29877]: ignoring --setuser ceph since I am not root 2021-03-10T20:11:35.312 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[29877]: ignoring --setgroup ceph since I am not root 2021-03-10T20:11:35.312 INFO:journalctl@ceph.mgr.y.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[29877]: debug 2021-03-10T20:11:34.871+0000 7fbedc26c700 1 -- 172.21.2.104:0/2784135989 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f7caf84e0 con 0x555f7cbe8c00 2021-03-10T20:11:35.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:35.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:35.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:35.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: debug 2021-03-10T20:11:34.843+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: audit 2021-03-10T20:11:32.397317+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:35.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:32.415387+0000 mgr.gibba009.xiladd (mgr.34418) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:35.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.017580+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:35.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.820125+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:35.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.830503+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:35.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.830529+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:11:35.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.830544+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:11:35.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.831381+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 50s), standbys: y, x 2021-03-10T20:11:35.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.848658+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba009.xiladd(active, since 51s), standbys: y, x 2021-03-10T20:11:35.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849274+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849287+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:35.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849292+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:35.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: audit 2021-03-10T20:11:32.397317+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:35.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:32.415387+0000 mgr.gibba009.xiladd (mgr.34418) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:35.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.017580+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:35.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.820125+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:35.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.830503+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:35.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849298+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:35.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849303+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: cluster 2021-03-10T20:11:34.849308+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[12967]: audit 2021-03-10T20:11:34.857748+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34418 ' entity='' 2021-03-10T20:11:35.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.830529+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:11:35.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.830544+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:11:35.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.831381+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 50s), standbys: y, x 2021-03-10T20:11:35.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.848658+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba009.xiladd(active, since 51s), standbys: y, x 2021-03-10T20:11:35.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849274+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849287+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:35.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849292+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:35.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849298+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:35.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849303+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: cluster 2021-03-10T20:11:34.849308+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:34 gibba004 bash[30897]: audit 2021-03-10T20:11:34.857748+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34418 ' entity='' 2021-03-10T20:11:35.335 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[22726]: ignoring --setuser ceph since I am not root 2021-03-10T20:11:35.335 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[22726]: ignoring --setgroup ceph since I am not root 2021-03-10T20:11:35.335 INFO:journalctl@ceph.mgr.x.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[22726]: debug 2021-03-10T20:11:34.880+0000 7fa1bc9ca700 1 -- 172.21.2.109:0/2255976406 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558e238344e0 con 0x558e23925000 2021-03-10T20:11:35.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: audit 2021-03-10T20:11:32.397317+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34418 172.21.2.109:0/2206582227' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 142606336, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475275Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91834286, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475600Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.475900Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49356472, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.476611Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46944747, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477289Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49471815, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.477910Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23750246, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.478533Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12362711, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:27.478859Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:27.479120Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\"}"}]: dispatch 2021-03-10T20:11:35.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:32.415387+0000 mgr.gibba009.xiladd (mgr.34418) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:35.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.017580+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:35.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.820125+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:35.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.830503+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:35.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.830529+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:11:35.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.830544+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-03-10T20:11:35.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.831381+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba009.xiladd(active, since 50s), standbys: y, x 2021-03-10T20:11:35.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.848658+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba009.xiladd(active, since 51s), standbys: y, x 2021-03-10T20:11:35.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849274+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849287+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:35.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849292+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:35.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849298+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:35.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849303+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: cluster 2021-03-10T20:11:34.849308+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:35.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:34 gibba009 bash[9804]: audit 2021-03-10T20:11:34.857748+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34418 ' entity='' 2021-03-10T20:11:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.611865+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.611951+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: audit 2021-03-10T20:11:38.612951+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: audit 2021-03-10T20:11:38.613877+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.723271+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:11:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.723363+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:11:39.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: audit 2021-03-10T20:11:38.724446+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: audit 2021-03-10T20:11:38.725403+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.733980+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:11:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.735305+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:11:39.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[30897]: cluster 2021-03-10T20:11:38.743239+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.611865+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.611951+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:39.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: audit 2021-03-10T20:11:38.612951+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: audit 2021-03-10T20:11:38.613877+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.723271+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:11:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.723363+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:11:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: audit 2021-03-10T20:11:38.724446+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: audit 2021-03-10T20:11:38.725403+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.733980+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:11:39.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.735305+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:11:39.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:39 gibba004 bash[12967]: cluster 2021-03-10T20:11:38.743239+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:39.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.611865+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:11:39.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.611951+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:11:39.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: audit 2021-03-10T20:11:38.612951+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: audit 2021-03-10T20:11:38.613877+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.2.104:0/3279010774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.723271+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:11:39.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.723363+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:11:39.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: audit 2021-03-10T20:11:38.724446+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: audit 2021-03-10T20:11:38.725403+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.? 172.21.2.109:0/1687800300' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.733980+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba009.xiladd restarted 2021-03-10T20:11:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.735305+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba009.xiladd 2021-03-10T20:11:39.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:39 gibba009 bash[9804]: cluster 2021-03-10T20:11:38.743239+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:40.721 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: cluster 2021-03-10T20:11:39.428509+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba009.xiladd(active, starting, since 0.693387s), standbys: y, x 2021-03-10T20:11:40.722 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440041+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:11:40.722 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440178+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:11:40.722 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440308+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:11:40.723 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440445+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:11:40.723 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440584+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:40.723 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440723+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:40.723 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440849+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:11:40.723 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.440963+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:11:40.724 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.441076+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:11:40.724 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.441187+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:11:40.724 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.441300+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:11:40.724 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.441753+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:11:40.725 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.441887+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:11:40.725 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.442223+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:11:40.725 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.442711+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:11:40.725 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.443355+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:11:40.726 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.443641+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:11:40.726 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.443911+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:11:40.727 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.444155+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:11:40.727 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.444452+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:11:40.727 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.444656+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:11:40.727 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.444958+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:11:40.728 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.445242+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:11:40.728 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.445497+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:11:40.728 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.445757+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:11:40.728 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.445956+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:11:40.728 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.446246+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:11:40.729 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.446557+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:11:40.729 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.446814+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:11:40.729 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.447020+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:11:40.729 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.447265+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:11:40.730 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.447476+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:40.730 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.447612+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:40.730 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.447828+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:11:40.730 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.448005+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:11:40.730 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.448194+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:11:40.731 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.448334+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:11:40.731 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: cluster 2021-03-10T20:11:39.449590+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:11:40.731 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.540805+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:40.731 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.569324+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.732 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.570170+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.732 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.573767+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.732 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.574345+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.732 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.711056+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:40.732 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.890395+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:40.733 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.893181+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:40.733 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:40 gibba009 bash[9804]: audit 2021-03-10T20:11:39.895686+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: cluster 2021-03-10T20:11:39.428509+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba009.xiladd(active, starting, since 0.693387s), standbys: y, x 2021-03-10T20:11:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440041+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:11:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440178+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:11:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440308+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:11:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440445+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:11:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440584+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440723+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440849+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:11:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.440963+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:11:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.441076+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:11:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.441187+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:11:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.441300+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:11:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.441753+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:11:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.441887+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:11:40.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.442223+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:11:40.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.442711+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:11:40.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.443355+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:11:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: cluster 2021-03-10T20:11:39.428509+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba009.xiladd(active, starting, since 0.693387s), standbys: y, x 2021-03-10T20:11:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440041+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "gibba009.xiladd", "id": "gibba009.xiladd"}]: dispatch 2021-03-10T20:11:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440178+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:11:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440308+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:11:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440445+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:11:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440584+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440723+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440849+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:11:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.440963+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:11:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.441076+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:11:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.441187+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:11:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.441300+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:11:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.441753+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:11:40.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.441887+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:11:40.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.442223+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:11:40.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.442711+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:11:40.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.443355+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:11:40.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.443641+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:11:40.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.443911+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:11:40.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.444155+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:11:40.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.444452+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:11:40.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.444656+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:11:40.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.444958+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:11:40.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.445242+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:11:40.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.445497+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:11:40.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.445757+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:11:40.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.445956+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:11:40.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.446246+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:11:40.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.446557+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:11:40.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.446814+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:11:40.826 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.447020+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:11:40.826 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.447265+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:11:40.826 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.447476+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:40.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.443641+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:11:40.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.443911+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba004"}]: dispatch 2021-03-10T20:11:40.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.444155+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba009"}]: dispatch 2021-03-10T20:11:40.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.444452+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:11:40.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.444656+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:11:40.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.444958+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:11:40.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.445242+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:11:40.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.445497+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:11:40.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.445757+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:11:40.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.445956+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:11:40.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.446246+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:11:40.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.446557+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:11:40.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.446814+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:11:40.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.447020+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:11:40.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.447265+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:11:40.831 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.447476+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:11:40.831 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.447612+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:40.831 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.447828+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:11:40.832 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.448005+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:11:40.832 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.448194+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:11:40.832 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.448334+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:11:40.832 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: cluster 2021-03-10T20:11:39.449590+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:11:40.833 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.540805+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:40.834 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.569324+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.834 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.570170+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.835 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.573767+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.835 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.574345+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.835 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.711056+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:40.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.447612+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:11:40.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.447828+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:11:40.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.448005+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:11:40.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.448194+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:11:40.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.448334+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:11:40.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: cluster 2021-03-10T20:11:39.449590+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba009.xiladd is now available 2021-03-10T20:11:40.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.540805+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:40.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.569324+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.570170+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:40.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.573767+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.574345+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:40.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.711056+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:40.839 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.890395+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:40.839 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.893181+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:40.840 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[30897]: audit 2021-03-10T20:11:39.895686+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:40.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.890395+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99604234, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151273Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372663910, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151387Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403596902, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151450Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49450844, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151508Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151678Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151809Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49639587, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.151936Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33365688, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152060Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25113395, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152125Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29769072, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152184Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:10:54.152240Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:40.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.893181+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:40.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:40 gibba004 bash[12967]: audit 2021-03-10T20:11:39.895686+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:41.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[30897]: cluster 2021-03-10T20:11:40.452327+0000 mon.a (mon.0) 27 : cluster [DBG] mgrmap e24: gibba009.xiladd(active, since 1.71722s), standbys: y, x 2021-03-10T20:11:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[30897]: cluster 2021-03-10T20:11:40.458131+0000 mgr.gibba009.xiladd (mgr.34457) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[30897]: cluster 2021-03-10T20:11:40.721846+0000 mgr.gibba009.xiladd (mgr.34457) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[12967]: cluster 2021-03-10T20:11:40.452327+0000 mon.a (mon.0) 27 : cluster [DBG] mgrmap e24: gibba009.xiladd(active, since 1.71722s), standbys: y, x 2021-03-10T20:11:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[12967]: cluster 2021-03-10T20:11:40.458131+0000 mgr.gibba009.xiladd (mgr.34457) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:41 gibba004 bash[12967]: cluster 2021-03-10T20:11:40.721846+0000 mgr.gibba009.xiladd (mgr.34457) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:41.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:41 gibba009 bash[9804]: cluster 2021-03-10T20:11:40.452327+0000 mon.a (mon.0) 27 : cluster [DBG] mgrmap e24: gibba009.xiladd(active, since 1.71722s), standbys: y, x 2021-03-10T20:11:41.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:41 gibba009 bash[9804]: cluster 2021-03-10T20:11:40.458131+0000 mgr.gibba009.xiladd (mgr.34457) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:41.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:41 gibba009 bash[9804]: cluster 2021-03-10T20:11:40.721846+0000 mgr.gibba009.xiladd (mgr.34457) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba009.xiladd: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[30897]: cluster 2021-03-10T20:11:41.442673+0000 mgr.gibba009.xiladd (mgr.34457) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[30897]: cluster 2021-03-10T20:11:41.450810+0000 mon.a (mon.0) 28 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:11:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[30897]: cluster 2021-03-10T20:11:41.465358+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:11:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[12967]: cluster 2021-03-10T20:11:41.442673+0000 mgr.gibba009.xiladd (mgr.34457) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[12967]: cluster 2021-03-10T20:11:41.450810+0000 mon.a (mon.0) 28 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:11:42.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:42 gibba004 bash[12967]: cluster 2021-03-10T20:11:41.465358+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:11:42.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:42 gibba009 bash[9804]: cluster 2021-03-10T20:11:41.442673+0000 mgr.gibba009.xiladd (mgr.34457) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:42.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:42 gibba009 bash[9804]: cluster 2021-03-10T20:11:41.450810+0000 mon.a (mon.0) 28 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:11:42.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:42 gibba009 bash[9804]: cluster 2021-03-10T20:11:41.465358+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 2s), standbys: y, x 2021-03-10T20:11:44.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:43.413323+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94476697, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411660Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.412419Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:43.416769+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: cephadm 2021-03-10T20:11:43.418748+0000 mgr.gibba009.xiladd (mgr.34457) 4 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:11:44.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: cluster 2021-03-10T20:11:43.443028+0000 mgr.gibba009.xiladd (mgr.34457) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:44.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:43.413323+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94476697, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411660Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.412419Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:43.416769+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: cephadm 2021-03-10T20:11:43.418748+0000 mgr.gibba009.xiladd (mgr.34457) 4 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:11:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: cluster 2021-03-10T20:11:43.443028+0000 mgr.gibba009.xiladd (mgr.34457) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:43.833548+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103012106, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831056Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373922201, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831194Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 404226048, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831274Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50237276, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831349Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48695869, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831548Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46567260, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831713Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831871Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34382807, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832031Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25302138, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832113Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30052188, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832186Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832259Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.832354Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:43.844787+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: cephadm 2021-03-10T20:11:43.846864+0000 mgr.gibba009.xiladd (mgr.34457) 6 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:11:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:44.050985+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:44.061870+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:44.068327+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:44.069620+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[30897]: audit 2021-03-10T20:11:44.070919+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:11:44.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:43.833548+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103012106, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831056Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373922201, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831194Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 404226048, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831274Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50237276, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831349Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48695869, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831548Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46567260, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831713Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831871Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34382807, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832031Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25302138, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832113Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30052188, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832186Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832259Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.832354Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:43.844787+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: cephadm 2021-03-10T20:11:43.846864+0000 mgr.gibba009.xiladd (mgr.34457) 6 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:11:44.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:44.050985+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:44.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:44.061870+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:44.068327+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:44.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:44.069620+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:44.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:44 gibba004 bash[12967]: audit 2021-03-10T20:11:44.070919+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:11:44.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:43.413323+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"a6ab2f2fedfc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94476697, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411660Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:01:47.294835Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:56.487935Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.412419Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:43.416769+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: cephadm 2021-03-10T20:11:43.418748+0000 mgr.gibba009.xiladd (mgr.34457) 4 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:11:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: cluster 2021-03-10T20:11:43.443028+0000 mgr.gibba009.xiladd (mgr.34457) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:43.833548+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba009","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"40c0351a70b1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 103012106, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831056Z\", \"created\": \"2021-03-10T20:02:01.043621Z\", \"started\": \"2021-03-10T20:02:01.066462Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba009\", \"container_id\": \"2c85c7c1673e\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373922201, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831194Z\", \"created\": \"2021-03-10T20:02:15.271621Z\", \"started\": \"2021-03-10T20:10:21.826714Z\"}, \"mgr.gibba009.xiladd\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba009.xiladd\", \"hostname\": \"gibba009\", \"container_id\": \"d88808aee843\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 404226048, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831274Z\", \"created\": \"2021-03-10T20:02:17.307621Z\", \"started\": \"2021-03-10T20:10:38.909007Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba009\", \"container_id\": \"5f2948809dc4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50237276, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831349Z\", \"created\": \"2021-03-10T20:04:00.369383Z\", \"started\": \"2021-03-10T20:04:03.318594Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba009\", \"container_id\": \"b9b0e6db0ba6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48695869, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831548Z\", \"created\": \"2021-03-10T20:04:21.549383Z\", \"started\": \"2021-03-10T20:04:24.298495Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba009\", \"container_id\": \"288548dd424e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46567260, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831713Z\", \"created\": \"2021-03-10T20:04:43.045384Z\", \"started\": \"2021-03-10T20:05:09.183774Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba009\", \"container_id\": \"6d72510e8ffd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50279219, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.831871Z\", \"created\": \"2021-03-10T20:05:09.369385Z\", \"started\": \"2021-03-10T20:05:13.042399Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"dd1b71522d82\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34382807, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832031Z\", \"created\": \"2021-03-10T20:05:30.021385Z\", \"started\": \"2021-03-10T20:06:09.232210Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba009\", \"container_id\": \"15d9b915a317\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25302138, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832113Z\", \"created\": \"2021-03-10T20:05:31.737385Z\", \"started\": \"2021-03-10T20:05:33.022735Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba009\", \"container_id\": \"1c5fbb372128\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30052188, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832186Z\", \"created\": \"2021-03-10T20:05:54.393386Z\", \"started\": \"2021-03-10T20:05:54.417503Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba009.xbhxrc\", \"hostname\": \"gibba009\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.832259Z\", \"created\": \"2021-03-10T20:07:33.517388Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f7402873-089f-44c1-b2ae-5feb0f0f7673\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"8kDtNF-vhZh-h5sp-SCTP-o19e-xI0K-SaKQTi\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cefd4740-1a5b-4325-96e2-cdbae970ab52\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"bOeDiD-8xT0-SOjw-qvxw-ZsOK-wQw2-HV20ZN\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3eea2b0c-0b1d-4976-8a42-a73218a8175b\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"7rMYne-WUdd-wXL9-kR4H-ltjh-iypZ-or36I9\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"aab97246-8453-48ec-94b9-b3cd470e8671\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"3AyLxI-NxOq-Dz8p-B9te-O9Xx-XSEy-F2Ayyo\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400KC375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K1F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:05.018382Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:08.949575Z\"}, \"mgr.gibba009.xiladd\": {\"deps\": [], \"last_config\": \"2021-03-10T20:10:26.274872Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:58.754318Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:04:19.797636Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:02.856255Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:07.031661Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:06:02.643350Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:31.327551Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:05:43.881757Z\"}, \"rgw.r.z.gibba009.xbhxrc\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:31.430173Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:43.832354Z\", \"last_device_update\": \"2021-03-10T20:05:16.897251Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.109\"], \"172.21.15.254\": [\"172.21.2.109\"]}, \"last_host_check\": \"2021-03-10T20:11:39.889416Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:43.844787+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: cephadm 2021-03-10T20:11:43.846864+0000 mgr.gibba009.xiladd (mgr.34457) 6 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:11:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:44.050985+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:44.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:44.061870+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:44.068327+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:44.069620+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:44 gibba009 bash[9804]: audit 2021-03-10T20:11:44.070919+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:11:45.710 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cluster 2021-03-10T20:11:44.050650+0000 mgr.gibba009.xiladd (mgr.34457) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:45.710 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.067652+0000 mgr.gibba009.xiladd (mgr.34457) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:45.711 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.069300+0000 mgr.gibba009.xiladd (mgr.34457) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:45.711 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.070514+0000 mgr.gibba009.xiladd (mgr.34457) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:45.711 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.070555+0000 mgr.gibba009.xiladd (mgr.34457) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:45.711 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.071669+0000 mgr.gibba009.xiladd (mgr.34457) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:11:45.712 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cephadm 2021-03-10T20:11:44.071742+0000 mgr.gibba009.xiladd (mgr.34457) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:11:45.712 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[30897]: cluster 2021-03-10T20:11:44.418630+0000 mon.a (mon.0) 33 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:11:45.712 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cluster 2021-03-10T20:11:44.050650+0000 mgr.gibba009.xiladd (mgr.34457) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:45.713 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.067652+0000 mgr.gibba009.xiladd (mgr.34457) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:45.713 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.069300+0000 mgr.gibba009.xiladd (mgr.34457) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:45.713 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.070514+0000 mgr.gibba009.xiladd (mgr.34457) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:45.713 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.070555+0000 mgr.gibba009.xiladd (mgr.34457) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:45.714 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.071669+0000 mgr.gibba009.xiladd (mgr.34457) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:11:45.714 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cephadm 2021-03-10T20:11:44.071742+0000 mgr.gibba009.xiladd (mgr.34457) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:11:45.714 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:45 gibba004 bash[12967]: cluster 2021-03-10T20:11:44.418630+0000 mon.a (mon.0) 33 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:11:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cluster 2021-03-10T20:11:44.050650+0000 mgr.gibba009.xiladd (mgr.34457) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.067652+0000 mgr.gibba009.xiladd (mgr.34457) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.069300+0000 mgr.gibba009.xiladd (mgr.34457) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.070514+0000 mgr.gibba009.xiladd (mgr.34457) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.070555+0000 mgr.gibba009.xiladd (mgr.34457) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.071669+0000 mgr.gibba009.xiladd (mgr.34457) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:11:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cephadm 2021-03-10T20:11:44.071742+0000 mgr.gibba009.xiladd (mgr.34457) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:11:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:45 gibba009 bash[9804]: cluster 2021-03-10T20:11:44.418630+0000 mon.a (mon.0) 33 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:11:46.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.236796+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T20:11:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.241532+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.249628+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.250643+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.251589+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:46.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[12967]: audit 2021-03-10T20:11:46.252762+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:11:46.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.236796+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T20:11:46.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.241532+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:46.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.249628+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:46.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.250643+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:46.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.251589+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:46.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:46 gibba004 bash[30897]: audit 2021-03-10T20:11:46.252762+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:11:46.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.236796+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T20:11:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.241532+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.249628+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.250643+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.251589+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:46.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:46 gibba009 bash[9804]: audit 2021-03-10T20:11:46.252762+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:11:47.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[30897]: cluster 2021-03-10T20:11:46.052880+0000 mgr.gibba009.xiladd (mgr.34457) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:47.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[30897]: cephadm 2021-03-10T20:11:46.235594+0000 mgr.gibba009.xiladd (mgr.34457) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:11:47.584 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[30897]: cephadm 2021-03-10T20:11:46.252425+0000 mgr.gibba009.xiladd (mgr.34457) 16 : cephadm [INF] Deploying daemon mon.c on gibba004 2021-03-10T20:11:47.585 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[12967]: cluster 2021-03-10T20:11:46.052880+0000 mgr.gibba009.xiladd (mgr.34457) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:47.585 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[12967]: cephadm 2021-03-10T20:11:46.235594+0000 mgr.gibba009.xiladd (mgr.34457) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:11:47.585 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:47 gibba004 bash[12967]: cephadm 2021-03-10T20:11:46.252425+0000 mgr.gibba009.xiladd (mgr.34457) 16 : cephadm [INF] Deploying daemon mon.c on gibba004 2021-03-10T20:11:47.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:47 gibba009 bash[9804]: cluster 2021-03-10T20:11:46.052880+0000 mgr.gibba009.xiladd (mgr.34457) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:47.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:47 gibba009 bash[9804]: cephadm 2021-03-10T20:11:46.235594+0000 mgr.gibba009.xiladd (mgr.34457) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:11:47.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:47 gibba009 bash[9804]: cephadm 2021-03-10T20:11:46.252425+0000 mgr.gibba009.xiladd (mgr.34457) 16 : cephadm [INF] Deploying daemon mon.c on gibba004 2021-03-10T20:11:48.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:48 gibba004 systemd[1]: Stopping Ceph mon.c for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:48.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:48 gibba004 bash[12967]: debug 2021-03-10T20:11:48.383+0000 7fce68008700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:11:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:48 gibba004 bash[12967]: debug 2021-03-10T20:11:48.383+0000 7fce68008700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-03-10T20:11:49.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:49 gibba004 docker[31792]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.c 2021-03-10T20:11:49.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:49 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.c.service: Succeeded. 2021-03-10T20:11:49.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:49 gibba004 systemd[1]: Stopped Ceph mon.c for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:49.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:49 gibba004 systemd[1]: Started Ceph mon.c for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:11:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.483+0000 7f94f59f9700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:11:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.483+0000 7f94f59f9700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:11:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.483+0000 7f94f59f9700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:11:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 0 load: jerasure load: lrc load: isa 2021-03-10T20:11:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:11:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:11:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:11:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: DB SUMMARY 2021-03-10T20:11:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:11:50.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:11:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T20:11:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T20:11:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000020.log size: 20281702 ; 2021-03-10T20:11:50.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:11:50.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:11:50.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:11:50.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.env: 0x5568237651c0 2021-03-10T20:11:50.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:11:50.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.info_log: 0x5568241191e0 2021-03-10T20:11:50.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:11:50.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:11:50.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:11:50.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:11:50.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:11:50.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:11:50.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:11:50.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:11:50.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:11:50.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:11:50.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:11:50.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:11:50.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:11:50.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:11:50.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:11:50.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T20:11:50.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:11:50.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:11:50.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:11:50.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:11:50.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:11:50.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:11:50.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:11:50.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:11:50.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:11:50.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:11:50.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.write_buffer_manager: 0x55682416dc50 2021-03-10T20:11:50.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:11:50.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:11:50.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:11:50.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:11:50.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:11:50.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:11:50.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:11:50.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:11:50.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:11:50.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:11:50.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:11:50.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:11:50.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:11:50.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:11:50.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.row_cache: None 2021-03-10T20:11:50.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:11:50.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:11:50.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:11:50.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:11:50.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:11:50.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:11:50.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:11:50.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:11:50.831 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:11:50.831 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:11:50.831 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:11:50.831 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:11:50.832 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:11:50.832 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:11:50.832 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:11:50.832 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:11:50.832 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:11:50.833 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:11:50.833 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:11:50.833 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:11:50.833 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:11:50.834 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:11:50.834 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:11:50.834 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:11:50.834 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:11:50.834 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:11:50.835 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:11:50.835 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:11:50.835 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:11:50.835 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:11:50.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:11:50.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:11:50.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:11:50.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:11:50.836 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:11:50.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:11:50.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:11:50.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-03-10T20:11:50.837 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:11:50.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:11:50.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.merge_operator: 2021-03-10T20:11:50.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:11:50.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:11:50.838 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:11:50.839 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:11:50.839 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5568240bc230) 2021-03-10T20:11:50.839 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: cache_index_and_filter_blocks: 1 2021-03-10T20:11:50.839 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:11:50.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:11:50.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: pin_top_level_index_and_filter: 1 2021-03-10T20:11:50.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: index_type: 0 2021-03-10T20:11:50.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: data_block_index_type: 0 2021-03-10T20:11:50.840 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: index_shortening: 1 2021-03-10T20:11:50.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:11:50.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: hash_index_allow_collision: 1 2021-03-10T20:11:50.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: checksum: 1 2021-03-10T20:11:50.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: no_block_cache: 0 2021-03-10T20:11:50.841 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_cache: 0x5568240f4510 2021-03-10T20:11:50.842 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_cache_name: BinnedLRUCache 2021-03-10T20:11:50.842 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_cache_options: 2021-03-10T20:11:50.842 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: capacity : 536870912 2021-03-10T20:11:50.842 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: num_shard_bits : 4 2021-03-10T20:11:50.843 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: strict_capacity_limit : 0 2021-03-10T20:11:50.843 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: high_pri_pool_ratio: 0.000 2021-03-10T20:11:50.843 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_cache_compressed: (nil) 2021-03-10T20:11:50.843 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: persistent_cache: (nil) 2021-03-10T20:11:50.844 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_size: 4096 2021-03-10T20:11:50.844 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_size_deviation: 10 2021-03-10T20:11:50.844 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_restart_interval: 16 2021-03-10T20:11:50.844 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: index_block_restart_interval: 1 2021-03-10T20:11:50.844 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: metadata_block_size: 4096 2021-03-10T20:11:50.845 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: partition_filters: 0 2021-03-10T20:11:50.845 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: use_delta_encoding: 1 2021-03-10T20:11:50.845 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:11:50.845 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: whole_key_filtering: 1 2021-03-10T20:11:50.845 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: verify_compression: 0 2021-03-10T20:11:50.846 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: read_amp_bytes_per_bit: 0 2021-03-10T20:11:50.846 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: format_version: 2 2021-03-10T20:11:50.846 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: enable_index_compression: 1 2021-03-10T20:11:50.846 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: block_align: 0 2021-03-10T20:11:50.847 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:11:50.847 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:11:50.847 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:11:50.847 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:11:50.847 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:11:50.848 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:11:50.848 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:11:50.848 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:11:50.848 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:11:50.848 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:11:50.849 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:11:50.849 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:11:50.849 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:11:50.849 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:11:50.850 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:11:50.850 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:11:50.850 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:11:50.850 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:11:50.850 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:11:50.851 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:11:50.851 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:11:50.851 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:11:50.851 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:11:50.852 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:11:50.852 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:11:50.852 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:11:50.852 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:11:50.852 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:11:50.853 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:11:50.853 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:11:50.853 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:11:50.853 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:11:50.854 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:11:50.854 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:11:50.854 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:11:50.854 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:11:50.854 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:11:50.855 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:11:50.855 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:11:50.855 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:11:50.855 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:11:50.856 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:11:50.856 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:11:50.856 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:11:50.856 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:11:50.856 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:11:50.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:11:50.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:11:50.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:11:50.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:11:50.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:11:50.858 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:11:50.858 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:11:50.858 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:11:50.858 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:11:50.858 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:11:50.859 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:11:50.859 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:11:50.859 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:11:50.859 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:11:50.860 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:11:50.860 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:11:50.860 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:11:50.860 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:11:50.860 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:11:50.861 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:11:50.861 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:11:50.861 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:11:50.861 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9286, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:11:50.861 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T20:11:50.862 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407110491544, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T20:11:50.862 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.487+0000 7f94f59f9700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T20:11:50.862 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.499+0000 7f94f59f9700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:11:50.862 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.507+0000 7f94f59f9700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407110513626, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 13419007, "table_properties": {"data_size": 13412404, "index_size": 5075, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 5747, "raw_average_key_size": 22, "raw_value_size": 13404608, "raw_average_value_size": 51556, "num_data_blocks": 159, "num_entries": 260, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615407110, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:11:50.863 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.507+0000 7f94f59f9700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T20:11:50.863 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407110514433, "job": 1, "event": "recovery_finished"} 2021-03-10T20:11:50.863 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 4 rocksdb: DB pointer 0x5568241b9800 2021-03-10T20:11:50.863 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94dc80c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:11:50.863 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94dc80c700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:11:50.864 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** DB Stats ** 2021-03-10T20:11:50.864 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:50.864 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:11:50.864 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:11:50.864 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:11:50.865 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:11:50.865 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:11:50.865 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:11:50.865 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** Compaction Stats [default] ** 2021-03-10T20:11:50.865 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:50.866 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:50.866 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: L0 1/0 12.80 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.866 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:50.866 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Sum 3/0 80.51 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.867 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.867 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** Compaction Stats [default] ** 2021-03-10T20:11:50.867 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:50.867 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:50.867 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.868 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:50.868 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Flush(GB): cumulative 0.012, interval 0.012 2021-03-10T20:11:50.868 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:11:50.868 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:11:50.868 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:11:50.869 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:11:50.869 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Cumulative compaction: 0.01 GB write, 504.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:50.869 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Interval compaction: 0.01 GB write, 504.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:50.869 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:11:50.870 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:11:50.870 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** Compaction Stats [default] ** 2021-03-10T20:11:50.870 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:50.870 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:50.870 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: L0 1/0 12.80 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.871 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:50.871 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Sum 3/0 80.51 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.871 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:11:50.871 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** Compaction Stats [default] ** 2021-03-10T20:11:50.871 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:11:50.872 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:11:50.872 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1140.8 0.01 0.00 1 0.011 0 0 2021-03-10T20:11:50.872 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:11:50.872 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Flush(GB): cumulative 0.012, interval 0.000 2021-03-10T20:11:50.872 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:11:50.873 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:11:50.873 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:11:50.873 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:11:50.873 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Cumulative compaction: 0.01 GB write, 504.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:50.874 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:11:50.874 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:11:50.874 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:11:50.874 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 starting mon.c rank 1 at public addrs [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] at bind addrs [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:11:50.874 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 1 mon.c@-1(???) e3 preinit fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:11:50.875 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).mds e1 new map 2021-03-10T20:11:50.875 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).mds e1 print_map 2021-03-10T20:11:50.875 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: e1 2021-03-10T20:11:50.875 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:11:50.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:11:50.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: legacy client fscid: -1 2021-03-10T20:11:50.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: 2021-03-10T20:11:50.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: No filesystems configured 2021-03-10T20:11:50.876 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).osd e66 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:11:50.877 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:50.877 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:50.877 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:11:50.877 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: cluster 2021-03-10T20:11:46.052880+0000 mgr.gibba009.xiladd (mgr.34457) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:50.877 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: cephadm 2021-03-10T20:11:46.235594+0000 mgr.gibba009.xiladd (mgr.34457) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:11:50.878 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: cephadm 2021-03-10T20:11:46.252425+0000 mgr.gibba009.xiladd (mgr.34457) 16 : cephadm [INF] Deploying daemon mon.c on gibba004 2021-03-10T20:11:50.878 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:50 gibba004 bash[31878]: debug 2021-03-10T20:11:50.511+0000 7f94f59f9700 1 mon.c@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-03-10T20:11:51.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:51.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:51.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:51 gibba004 bash[30897]: debug 2021-03-10T20:11:51.435+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:48.053928+0000 mgr.gibba009.xiladd (mgr.34457) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:48.053928+0000 mgr.gibba009.xiladd (mgr.34457) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: audit 2021-03-10T20:11:49.476116+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:50.054335+0000 mgr.gibba009.xiladd (mgr.34457) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:50.727579+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:11:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.416797+0000 mon.a (mon.0) 35 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.423220+0000 mon.a (mon.0) 36 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.435812+0000 mon.a (mon.0) 37 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.435842+0000 mon.a (mon.0) 38 : cluster [DBG] fsmap 2021-03-10T20:11:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.435862+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:52.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.436261+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 12s), standbys: y, x 2021-03-10T20:11:52.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440058+0000 mon.a (mon.0) 41 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: audit 2021-03-10T20:11:49.476116+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:50.054335+0000 mgr.gibba009.xiladd (mgr.34457) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:50.727579+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:11:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.416797+0000 mon.a (mon.0) 35 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.423220+0000 mon.a (mon.0) 36 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.435812+0000 mon.a (mon.0) 37 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:52.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.435842+0000 mon.a (mon.0) 38 : cluster [DBG] fsmap 2021-03-10T20:11:52.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.435862+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:52.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.436261+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 12s), standbys: y, x 2021-03-10T20:11:52.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440058+0000 mon.a (mon.0) 41 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440067+0000 mon.a (mon.0) 42 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:52.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440071+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:52.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440076+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:52.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440080+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: cluster 2021-03-10T20:11:51.440084+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: audit 2021-03-10T20:11:51.442243+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:11:52.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: audit 2021-03-10T20:11:51.444570+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:52.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[30897]: audit 2021-03-10T20:11:51.446085+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:52.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440067+0000 mon.a (mon.0) 42 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:52.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440071+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:52.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440076+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:52.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440080+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: cluster 2021-03-10T20:11:51.440084+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: audit 2021-03-10T20:11:51.442243+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:11:52.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: audit 2021-03-10T20:11:51.444570+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:52.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:52 gibba004 bash[31878]: audit 2021-03-10T20:11:51.446085+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:52.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:48.053928+0000 mgr.gibba009.xiladd (mgr.34457) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: audit 2021-03-10T20:11:49.476116+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38147194, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411473Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 376229068, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411600Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50551848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411714Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49629102, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411870Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.411999Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49765416, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412114Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412227Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12729712, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:11:43.412287Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:43.412341Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:52.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:50.054335+0000 mgr.gibba009.xiladd (mgr.34457) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:52.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:50.727579+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:11:52.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.416797+0000 mon.a (mon.0) 35 : cluster [INF] mon.a calling monitor election 2021-03-10T20:11:52.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.423220+0000 mon.a (mon.0) 36 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:11:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.435812+0000 mon.a (mon.0) 37 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:11:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.435842+0000 mon.a (mon.0) 38 : cluster [DBG] fsmap 2021-03-10T20:11:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.435862+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:11:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.436261+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 12s), standbys: y, x 2021-03-10T20:11:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440058+0000 mon.a (mon.0) 41 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440067+0000 mon.a (mon.0) 42 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:11:52.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440071+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:11:52.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440076+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:11:52.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440080+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: cluster 2021-03-10T20:11:51.440084+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:11:52.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: audit 2021-03-10T20:11:51.442243+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:11:52.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: audit 2021-03-10T20:11:51.444570+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:52.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:52 gibba009 bash[9804]: audit 2021-03-10T20:11:51.446085+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:53.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:53 gibba004 bash[30897]: cluster 2021-03-10T20:11:52.056281+0000 mgr.gibba009.xiladd (mgr.34457) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:53.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:53 gibba004 bash[31878]: cluster 2021-03-10T20:11:52.056281+0000 mgr.gibba009.xiladd (mgr.34457) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:53.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:53 gibba009 bash[9804]: cluster 2021-03-10T20:11:52.056281+0000 mgr.gibba009.xiladd (mgr.34457) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:55.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: cluster 2021-03-10T20:11:54.057372+0000 mgr.gibba009.xiladd (mgr.34457) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.227036+0000 mon.b (mon.2) 183 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43285217, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221265Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 377067929, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221760Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"eee0353850d9\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39741030, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222086Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:11:49.499420Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50541363, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222390Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223105Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47531950, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223761Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.224401Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225049Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12834570, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225383Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225683Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:55.226048Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.230001+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.233122+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:55.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.234972+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.241656+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:55.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.242907+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:55.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[30897]: audit 2021-03-10T20:11:55.244049+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:11:55.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: cluster 2021-03-10T20:11:54.057372+0000 mgr.gibba009.xiladd (mgr.34457) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:55.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.227036+0000 mon.b (mon.2) 183 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43285217, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221265Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 377067929, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221760Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"eee0353850d9\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39741030, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222086Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:11:49.499420Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50541363, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222390Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223105Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47531950, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223761Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.224401Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225049Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12834570, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225383Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225683Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:55.226048Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:55.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.230001+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.233122+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:55.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.234972+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.241656+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:55.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.242907+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:55.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:55 gibba004 bash[31878]: audit 2021-03-10T20:11:55.244049+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:11:55.834 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:11:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: cluster 2021-03-10T20:11:54.057372+0000 mgr.gibba009.xiladd (mgr.34457) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.227036+0000 mon.b (mon.2) 183 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba004","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"1e467460127d\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43285217, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221265Z\", \"created\": \"2021-03-10T20:00:34.686383Z\", \"started\": \"2021-03-10T20:11:32.420782Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba004\", \"container_id\": \"7e272ae0ba45\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 377067929, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.221760Z\", \"created\": \"2021-03-10T20:00:42.230383Z\", \"started\": \"2021-03-10T20:11:23.605729Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba004\", \"container_id\": \"eee0353850d9\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39741030, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222086Z\", \"created\": \"2021-03-10T20:01:47.270382Z\", \"started\": \"2021-03-10T20:11:49.499420Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba004\", \"container_id\": \"cbbf6dddd3e1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50541363, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.222390Z\", \"created\": \"2021-03-10T20:02:33.318381Z\", \"started\": \"2021-03-10T20:02:36.701989Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba004\", \"container_id\": \"256cde69c23e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49692016, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223105Z\", \"created\": \"2021-03-10T20:02:56.010381Z\", \"started\": \"2021-03-10T20:02:59.615574Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba004\", \"container_id\": \"dc3e2c708535\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47531950, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.223761Z\", \"created\": \"2021-03-10T20:03:17.962380Z\", \"started\": \"2021-03-10T20:03:21.995754Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba004\", \"container_id\": \"a483b521ef87\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50017075, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.224401Z\", \"created\": \"2021-03-10T20:03:41.346689Z\", \"started\": \"2021-03-10T20:03:44.651944Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"c4d7618d1b8a\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225049Z\", \"created\": \"2021-03-10T20:05:31.310687Z\", \"started\": \"2021-03-10T20:05:33.944063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba004\", \"container_id\": \"9cc27c92b598\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12834570, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225383Z\", \"created\": \"2021-03-10T20:05:41.606687Z\", \"started\": \"2021-03-10T20:11:05.009137Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba004.fosjgj\", \"hostname\": \"gibba004\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:11:55.225683Z\", \"created\": \"2021-03-10T20:07:36.194685Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fdbc8828-3bd2-4453-bf0e-9f16d052bbe0\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"W9ORKs-UV7G-ZZPD-I9gs-8ZO3-waLc-FQRvpN\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d2fcc45a-ea77-4424-82b2-630e2c9a2e90\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"LW8h2c-Eri9-HDTF-d5pA-BR3D-iWo4-891Z4p\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5615c721-c970-4d6c-9e75-6cfca4c38bef\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"ciRNOI-tREx-C7l8-xamy-UA9e-ArlG-ralew5\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5fa3f778-fb57-4629-9998-3af3a89cf491\", \"cluster_fsid\": \"37a23cfe-81db-11eb-9080-001a4aab830c\", \"block_uuid\": \"i3gEQ9-HLKA-oN7L-0DJc-A5hO-ttZZ-pqlRG4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400JX375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:46.252304Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:10.671519Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:31.571984Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:54.265926Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:16.218595Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:39.478636Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:30.936879Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba009.xiladd\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:10:58.383872Z\"}, \"rgw.r.z.gibba004.fosjgj\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:33.550215Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:11:29.588429Z\"}}, \"last_daemon_update\": \"2021-03-10T20:11:55.226048Z\", \"last_device_update\": \"2021-03-10T20:03:48.056286Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.104\"], \"172.21.15.254\": [\"172.21.2.104\"]}, \"last_host_check\": \"2021-03-10T20:11:23.775551Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:11:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.230001+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.233122+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:11:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.234972+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.241656+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.242907+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:55 gibba009 bash[9804]: audit 2021-03-10T20:11:55.244049+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:11:56.064 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:11:56.065 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (51s) 0s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:11:56.065 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (6m) 12s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:11:56.065 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (77s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:11:56.065 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (94s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:11:56.066 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (32s) 0s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:11:56.066 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (23s) 0s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:11:56.066 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (9m) 12s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 40c0351a70b1 2021-03-10T20:11:56.066 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (6s) 0s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:11:56.067 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (6m) 0s ago 6m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:11:56.067 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (6m) 12s ago 6m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:11:56.067 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (9m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:11:56.067 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (8m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:11:56.067 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (8m) 0s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:11:56.068 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (8m) 0s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:11:56.068 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:11:56.068 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:11:56.069 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (6m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:11:56.069 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (6m) 12s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:11:56.069 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (5m) 12s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:11:56.069 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 0s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:56.070 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 12s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:56.312 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:11:56.313 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:11:56.313 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:11:56.314 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:11:56.314 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:56.314 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:11:56.315 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:56.315 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:56.315 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:11:56.315 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:11:56.316 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:11:56.316 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:11:56.316 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:11:56.317 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2021-03-10T20:11:56.317 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T20:11:56.317 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:11:56.318 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:11:56.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.241017+0000 mgr.gibba009.xiladd (mgr.34457) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:56.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.242650+0000 mgr.gibba009.xiladd (mgr.34457) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:56.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.243710+0000 mgr.gibba009.xiladd (mgr.34457) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:56.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.243760+0000 mgr.gibba009.xiladd (mgr.34457) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:56.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.244728+0000 mgr.gibba009.xiladd (mgr.34457) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:11:56.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: cephadm 2021-03-10T20:11:55.244778+0000 mgr.gibba009.xiladd (mgr.34457) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:11:56.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: audit 2021-03-10T20:11:55.825771+0000 mgr.gibba009.xiladd (mgr.34457) 27 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:56.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:56 gibba009 bash[9804]: audit 2021-03-10T20:11:56.312623+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.104:0/1644242350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.241017+0000 mgr.gibba009.xiladd (mgr.34457) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.242650+0000 mgr.gibba009.xiladd (mgr.34457) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.243710+0000 mgr.gibba009.xiladd (mgr.34457) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.243760+0000 mgr.gibba009.xiladd (mgr.34457) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.244728+0000 mgr.gibba009.xiladd (mgr.34457) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:11:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: cephadm 2021-03-10T20:11:55.244778+0000 mgr.gibba009.xiladd (mgr.34457) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:11:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: audit 2021-03-10T20:11:55.825771+0000 mgr.gibba009.xiladd (mgr.34457) 27 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:56.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[30897]: audit 2021-03-10T20:11:56.312623+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.104:0/1644242350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:56.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.241017+0000 mgr.gibba009.xiladd (mgr.34457) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.242650+0000 mgr.gibba009.xiladd (mgr.34457) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.243710+0000 mgr.gibba009.xiladd (mgr.34457) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.243760+0000 mgr.gibba009.xiladd (mgr.34457) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:56.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.244728+0000 mgr.gibba009.xiladd (mgr.34457) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:11:56.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: cephadm 2021-03-10T20:11:55.244778+0000 mgr.gibba009.xiladd (mgr.34457) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:11:56.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: audit 2021-03-10T20:11:55.825771+0000 mgr.gibba009.xiladd (mgr.34457) 27 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:56.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:56 gibba004 bash[31878]: audit 2021-03-10T20:11:56.312623+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.104:0/1644242350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:57.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:56.052727+0000 mgr.gibba009.xiladd (mgr.34457) 28 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: cluster 2021-03-10T20:11:56.058841+0000 mgr.gibba009.xiladd (mgr.34457) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.010217+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T20:11:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.020099+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.022704+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.023492+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.024248+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[30897]: audit 2021-03-10T20:11:57.025208+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:57.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:56.052727+0000 mgr.gibba009.xiladd (mgr.34457) 28 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:57.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: cluster 2021-03-10T20:11:56.058841+0000 mgr.gibba009.xiladd (mgr.34457) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:57.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.010217+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T20:11:57.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.020099+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:57.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.022704+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:57.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.023492+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:57.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.024248+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:57.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:57 gibba004 bash[31878]: audit 2021-03-10T20:11:57.025208+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:57.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:56.052727+0000 mgr.gibba009.xiladd (mgr.34457) 28 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: cluster 2021-03-10T20:11:56.058841+0000 mgr.gibba009.xiladd (mgr.34457) 29 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:11:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.010217+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T20:11:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.020099+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:11:57.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.022704+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:11:57.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.023492+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:11:57.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.024248+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:11:57.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:57 gibba009 bash[9804]: audit 2021-03-10T20:11:57.025208+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:11:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:58 gibba004 bash[30897]: cephadm 2021-03-10T20:11:57.009875+0000 mgr.gibba009.xiladd (mgr.34457) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:11:58.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:11:58 gibba004 bash[30897]: cephadm 2021-03-10T20:11:57.024912+0000 mgr.gibba009.xiladd (mgr.34457) 31 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:11:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:58 gibba004 bash[31878]: cephadm 2021-03-10T20:11:57.009875+0000 mgr.gibba009.xiladd (mgr.34457) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:11:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:11:58 gibba004 bash[31878]: cephadm 2021-03-10T20:11:57.024912+0000 mgr.gibba009.xiladd (mgr.34457) 31 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:11:58.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:58 gibba009 bash[9804]: cephadm 2021-03-10T20:11:57.009875+0000 mgr.gibba009.xiladd (mgr.34457) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:11:58.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:58 gibba009 bash[9804]: cephadm 2021-03-10T20:11:57.024912+0000 mgr.gibba009.xiladd (mgr.34457) 31 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:11:58.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:58 gibba009 systemd[1]: Stopping Ceph mon.b for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:11:59.220 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:58 gibba009 bash[9804]: debug 2021-03-10T20:11:58.892+0000 7f3cb265f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:11:59.220 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:58 gibba009 bash[9804]: debug 2021-03-10T20:11:58.892+0000 7f3cb265f700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-03-10T20:12:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:59 gibba009 docker[26046]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-mon.b 2021-03-10T20:12:00.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:59 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@mon.b.service: Succeeded. 2021-03-10T20:12:00.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:59 gibba009 systemd[1]: Stopped Ceph mon.b for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:12:00.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:11:59 gibba009 systemd[1]: Started Ceph mon.b for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:12:00.990 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.780+0000 7f8e3119d700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:12:00.991 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.780+0000 7f8e3119d700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:12:00.991 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.780+0000 7f8e3119d700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:12:00.991 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 0 load: jerasure load: lrc load: isa 2021-03-10T20:12:00.992 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:12:00.992 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:12:00.992 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:12:00.992 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: DB SUMMARY 2021-03-10T20:12:00.992 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:12:00.993 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:12:00.993 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T20:12:00.993 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T20:12:00.993 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000020.log size: 22036482 ; 2021-03-10T20:12:00.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:12:00.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:12:00.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:12:00.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.env: 0x557be6a961c0 2021-03-10T20:12:00.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:12:00.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.info_log: 0x557be87791e0 2021-03-10T20:12:00.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:12:00.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:12:00.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:12:00.996 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:12:00.996 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:12:00.996 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:12:00.996 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:12:00.997 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:12:00.998 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:12:00.999 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:12:00.999 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:12:00.999 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:12:00.999 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:12:01.000 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:12:01.000 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:12:01.000 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T20:12:01.000 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:12:01.001 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:12:01.001 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:12:01.001 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:12:01.001 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:12:01.002 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:12:01.002 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:12:01.002 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:12:01.002 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:12:01.002 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:12:01.003 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.write_buffer_manager: 0x557be87cdc50 2021-03-10T20:12:01.003 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:12:01.003 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:12:01.003 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:12:01.003 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:12:01.004 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:12:01.004 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:12:01.004 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:12:01.004 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:12:01.005 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:12:01.005 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:12:01.005 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:12:01.005 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:12:01.005 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:12:01.006 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:12:01.006 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.row_cache: None 2021-03-10T20:12:01.006 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:12:01.006 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:12:01.007 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:12:01.007 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:12:01.007 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:12:01.007 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:12:01.007 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:12:01.008 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:12:01.008 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:12:01.008 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:12:01.008 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:12:01.009 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:12:01.009 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:12:01.009 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:12:01.009 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:12:01.009 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:12:01.010 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:12:01.010 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:12:01.010 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:12:01.010 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:12:01.011 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:12:01.011 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:12:01.011 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:12:01.011 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:12:01.012 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:12:01.012 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:12:01.012 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:12:01.012 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:12:01.012 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:12:01.013 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:12:01.013 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:12:01.013 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:12:01.013 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:12:01.014 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:12:01.014 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:12:01.014 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:12:01.014 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:12:01.014 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-03-10T20:12:01.015 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:12:01.015 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:12:01.015 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.merge_operator: 2021-03-10T20:12:01.015 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:12:01.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:12:01.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:12:01.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:12:01.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557be871c230) 2021-03-10T20:12:01.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: cache_index_and_filter_blocks: 1 2021-03-10T20:12:01.017 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:12:01.017 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:12:01.017 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: pin_top_level_index_and_filter: 1 2021-03-10T20:12:01.017 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: index_type: 0 2021-03-10T20:12:01.018 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: data_block_index_type: 0 2021-03-10T20:12:01.018 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: index_shortening: 1 2021-03-10T20:12:01.018 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:12:01.018 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: hash_index_allow_collision: 1 2021-03-10T20:12:01.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: checksum: 1 2021-03-10T20:12:01.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: no_block_cache: 0 2021-03-10T20:12:01.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_cache: 0x557be8754510 2021-03-10T20:12:01.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_cache_name: BinnedLRUCache 2021-03-10T20:12:01.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_cache_options: 2021-03-10T20:12:01.020 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: capacity : 536870912 2021-03-10T20:12:01.020 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: num_shard_bits : 4 2021-03-10T20:12:01.020 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: strict_capacity_limit : 0 2021-03-10T20:12:01.020 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: high_pri_pool_ratio: 0.000 2021-03-10T20:12:01.020 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_cache_compressed: (nil) 2021-03-10T20:12:01.021 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: persistent_cache: (nil) 2021-03-10T20:12:01.021 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_size: 4096 2021-03-10T20:12:01.021 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_size_deviation: 10 2021-03-10T20:12:01.021 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_restart_interval: 16 2021-03-10T20:12:01.022 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: index_block_restart_interval: 1 2021-03-10T20:12:01.022 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: metadata_block_size: 4096 2021-03-10T20:12:01.022 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: partition_filters: 0 2021-03-10T20:12:01.022 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: use_delta_encoding: 1 2021-03-10T20:12:01.022 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:12:01.023 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: whole_key_filtering: 1 2021-03-10T20:12:01.023 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: verify_compression: 0 2021-03-10T20:12:01.023 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: read_amp_bytes_per_bit: 0 2021-03-10T20:12:01.023 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: format_version: 2 2021-03-10T20:12:01.024 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: enable_index_compression: 1 2021-03-10T20:12:01.024 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: block_align: 0 2021-03-10T20:12:01.024 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:12:01.024 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:12:01.024 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:12:01.025 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:12:01.025 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:12:01.025 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:12:01.025 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:12:01.026 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:12:01.026 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:12:01.026 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:12:01.026 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:12:01.026 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:12:01.027 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:12:01.027 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:12:01.027 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:12:01.028 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:12:01.028 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:12:01.028 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:12:01.028 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:12:01.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:12:01.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:12:01.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:12:01.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:12:01.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:12:01.030 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:12:01.030 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:12:01.030 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:12:01.030 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:12:01.031 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:12:01.031 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:12:01.031 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:12:01.031 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:12:01.031 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:12:01.032 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:12:01.032 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:12:01.032 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:12:01.032 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:12:01.033 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:12:01.033 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:12:01.033 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:12:01.033 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:12:01.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:12:01.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:12:01.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:12:01.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:12:01.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:12:01.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:12:01.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:12:01.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:12:01.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:12:01.036 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:12:01.036 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:12:01.036 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:12:01.036 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:12:01.037 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:12:01.037 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:12:01.037 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:12:01.037 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:12:01.037 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:12:01.038 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:12:01.038 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:12:01.038 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:12:01.038 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:12:01.039 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:12:01.039 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:12:01.039 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:12:01.039 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:12:01.040 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:12:01.040 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9209, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:12:01.040 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T20:12:01.040 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407120787320, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T20:12:01.041 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.784+0000 7f8e3119d700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T20:12:01.041 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.796+0000 7f8e3119d700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:12:01.041 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e3119d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407120809342, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 14563049, "table_properties": {"data_size": 14555468, "index_size": 5925, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 837, "raw_key_size": 6607, "raw_average_key_size": 21, "raw_value_size": 14546459, "raw_average_value_size": 48008, "num_data_blocks": 186, "num_entries": 303, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615407120, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:12:01.041 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e3119d700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T20:12:01.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e3119d700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615407120810309, "job": 1, "event": "recovery_finished"} 2021-03-10T20:12:01.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e3119d700 4 rocksdb: DB pointer 0x557be8819800 2021-03-10T20:12:01.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e17fb0700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:12:01.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e17fb0700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:12:01.042 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** DB Stats ** 2021-03-10T20:12:01.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:12:01.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:12:01.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:12:01.043 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:12:01.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:12:01.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:12:01.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:12:01.044 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** Compaction Stats [default] ** 2021-03-10T20:12:01.045 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:12:01.045 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:12:01.045 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: L0 1/0 13.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.045 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:12:01.045 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Sum 3/0 81.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.046 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.046 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** Compaction Stats [default] ** 2021-03-10T20:12:01.046 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:12:01.046 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:12:01.047 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.047 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:12:01.047 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Flush(GB): cumulative 0.014, interval 0.014 2021-03-10T20:12:01.047 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:12:01.047 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:12:01.048 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:12:01.048 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:12:01.048 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Cumulative compaction: 0.01 GB write, 549.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:12:01.048 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Interval compaction: 0.01 GB write, 549.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:12:01.049 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:12:01.049 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:12:01.049 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** Compaction Stats [default] ** 2021-03-10T20:12:01.049 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:12:01.050 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:12:01.050 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: L0 1/0 13.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.050 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: L6 2/0 67.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:12:01.050 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Sum 3/0 81.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.050 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:12:01.051 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** Compaction Stats [default] ** 2021-03-10T20:12:01.051 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:12:01.051 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:12:01.051 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1192.6 0.01 0.00 1 0.012 0 0 2021-03-10T20:12:01.052 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:12:01.052 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Flush(GB): cumulative 0.014, interval 0.000 2021-03-10T20:12:01.052 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:12:01.052 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:12:01.053 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:12:01.053 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:12:01.053 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Cumulative compaction: 0.01 GB write, 548.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:12:01.053 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:12:01.053 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:12:01.054 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:12:01.054 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.808+0000 7f8e3119d700 0 starting mon.b rank 2 at public addrs [v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0] at bind addrs [v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:12:01.054 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 1 mon.b@-1(???) e3 preinit fsid 37a23cfe-81db-11eb-9080-001a4aab830c 2021-03-10T20:12:01.054 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).mds e1 new map 2021-03-10T20:12:01.055 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).mds e1 print_map 2021-03-10T20:12:01.055 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: e1 2021-03-10T20:12:01.055 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:12:01.055 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:12:01.056 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: legacy client fscid: -1 2021-03-10T20:12:01.056 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: 2021-03-10T20:12:01.056 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: No filesystems configured 2021-03-10T20:12:01.056 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).osd e66 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:12:01.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:12:01.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:12:01.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:12:01.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: cephadm 2021-03-10T20:11:57.009875+0000 mgr.gibba009.xiladd (mgr.34457) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:12:01.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: cephadm 2021-03-10T20:11:57.024912+0000 mgr.gibba009.xiladd (mgr.34457) 31 : cephadm [INF] Deploying daemon mon.b on gibba009 2021-03-10T20:12:01.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 1 mon.b@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2021-03-10T20:12:01.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expand map: {default=false} 2021-03-10T20:12:01.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T20:12:01.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T20:12:01.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expand map: {default=info} 2021-03-10T20:12:01.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T20:12:01.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T20:12:01.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T20:12:01.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T20:12:01.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T20:12:01.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T20:12:01.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T20:12:01.061 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: debug 2021-03-10T20:12:00.812+0000 7f8e3119d700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T20:12:01.061 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:00 gibba009 bash[26136]: cluster 2021-03-10T20:11:58.059187+0000 mgr.gibba009.xiladd (mgr.34457) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:01.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[31878]: cluster 2021-03-10T20:11:58.059187+0000 mgr.gibba009.xiladd (mgr.34457) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:01.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: cluster 2021-03-10T20:11:58.059187+0000 mgr.gibba009.xiladd (mgr.34457) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:01.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:01.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:01.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:01.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:01.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:01.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:00 gibba004 bash[30897]: debug 2021-03-10T20:12:00.991+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:01.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:01.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:01.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:01.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:01.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:01.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:01 gibba004 bash[30897]: debug 2021-03-10T20:12:00.999+0000 7f2f72edd700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997858+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997869+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997874+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997878+0000 mon.a (mon.0) 60 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997883+0000 mon.a (mon.0) 61 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.997888+0000 mon.a (mon.0) 62 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.998324+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:12:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.998347+0000 mon.a (mon.0) 63 : cluster [INF] mon.a calling monitor election 2021-03-10T20:12:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.999477+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:12:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:00.999788+0000 mon.a (mon.0) 64 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:12:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.002127+0000 mon.a (mon.0) 65 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:12:02.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.002157+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T20:12:02.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.002172+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:12:02.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.002434+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 22s), standbys: y, x 2021-03-10T20:12:02.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004923+0000 mon.a (mon.0) 69 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004937+0000 mon.a (mon.0) 70 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004945+0000 mon.a (mon.0) 71 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004950+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004955+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: cluster 2021-03-10T20:12:01.004960+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: audit 2021-03-10T20:12:01.007314+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:12:02.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: audit 2021-03-10T20:12:01.008722+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:02.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[31878]: audit 2021-03-10T20:12:01.010463+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:02.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997858+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997869+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997874+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997878+0000 mon.a (mon.0) 60 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997883+0000 mon.a (mon.0) 61 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.997888+0000 mon.a (mon.0) 62 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.998324+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:12:02.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.998347+0000 mon.a (mon.0) 63 : cluster [INF] mon.a calling monitor election 2021-03-10T20:12:02.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.999477+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:12:02.328 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:00.999788+0000 mon.a (mon.0) 64 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:12:02.328 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.002127+0000 mon.a (mon.0) 65 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:12:02.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.002157+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T20:12:02.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.002172+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:12:02.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.002434+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 22s), standbys: y, x 2021-03-10T20:12:02.330 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004923+0000 mon.a (mon.0) 69 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.330 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004937+0000 mon.a (mon.0) 70 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.331 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004945+0000 mon.a (mon.0) 71 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.331 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004950+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004955+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: cluster 2021-03-10T20:12:01.004960+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.332 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: audit 2021-03-10T20:12:01.007314+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:12:02.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: audit 2021-03-10T20:12:01.008722+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:02.333 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:02 gibba004 bash[30897]: audit 2021-03-10T20:12:01.010463+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997858+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997869+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997874+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997878+0000 mon.a (mon.0) 60 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997883+0000 mon.a (mon.0) 61 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.997888+0000 mon.a (mon.0) 62 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.998324+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:12:02.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.998347+0000 mon.a (mon.0) 63 : cluster [INF] mon.a calling monitor election 2021-03-10T20:12:02.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.999477+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:12:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:00.999788+0000 mon.a (mon.0) 64 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:12:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.002127+0000 mon.a (mon.0) 65 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0],b=[v2:172.21.2.109:3300/0,v1:172.21.2.109:6789/0],c=[v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0]} 2021-03-10T20:12:02.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.002157+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T20:12:02.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.002172+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:12:02.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.002434+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba009.xiladd(active, since 22s), standbys: y, x 2021-03-10T20:12:02.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004923+0000 mon.a (mon.0) 69 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004937+0000 mon.a (mon.0) 70 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:12:02.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004945+0000 mon.a (mon.0) 71 : cluster [ERR] daemon rgw.r.z.gibba004.fosjgj on gibba004 is in error state 2021-03-10T20:12:02.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004950+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba009.xbhxrc on gibba009 is in error state 2021-03-10T20:12:02.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004955+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: cluster 2021-03-10T20:12:01.004960+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:12:02.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: audit 2021-03-10T20:12:01.007314+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.34457 ' entity='' 2021-03-10T20:12:02.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: audit 2021-03-10T20:12:01.008722+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:02.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:02 gibba009 bash[26136]: audit 2021-03-10T20:12:01.010463+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:03.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:03 gibba004 bash[30897]: cluster 2021-03-10T20:12:02.061903+0000 mgr.gibba009.xiladd (mgr.34457) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:03.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:03 gibba004 bash[31878]: cluster 2021-03-10T20:12:02.061903+0000 mgr.gibba009.xiladd (mgr.34457) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:03 gibba009 bash[26136]: cluster 2021-03-10T20:12:02.061903+0000 mgr.gibba009.xiladd (mgr.34457) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:06.084 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: cluster 2021-03-10T20:12:04.062308+0000 mgr.gibba009.xiladd (mgr.34457) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:06.084 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.831932+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.085 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.837260+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.085 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.841062+0000 mon.c (mon.1) 6 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:06.085 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: cephadm 2021-03-10T20:12:04.841512+0000 mgr.gibba009.xiladd (mgr.34457) 36 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:12:06.085 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.842509+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:06.086 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.844150+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:06.086 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: audit 2021-03-10T20:12:04.846095+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:12:06.086 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[30897]: cephadm 2021-03-10T20:12:04.846600+0000 mgr.gibba009.xiladd (mgr.34457) 37 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:12:06.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: cluster 2021-03-10T20:12:04.062308+0000 mgr.gibba009.xiladd (mgr.34457) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:06.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.831932+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.837260+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.841062+0000 mon.c (mon.1) 6 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:06.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: cephadm 2021-03-10T20:12:04.841512+0000 mgr.gibba009.xiladd (mgr.34457) 36 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:12:06.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.842509+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:06.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.844150+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:06.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: audit 2021-03-10T20:12:04.846095+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:12:06.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:05 gibba004 bash[31878]: cephadm 2021-03-10T20:12:04.846600+0000 mgr.gibba009.xiladd (mgr.34457) 37 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:12:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: cluster 2021-03-10T20:12:04.062308+0000 mgr.gibba009.xiladd (mgr.34457) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.831932+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.837260+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.841062+0000 mon.c (mon.1) 6 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: cephadm 2021-03-10T20:12:04.841512+0000 mgr.gibba009.xiladd (mgr.34457) 36 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:12:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.842509+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.844150+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:06.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: audit 2021-03-10T20:12:04.846095+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:12:06.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:05 gibba009 bash[26136]: cephadm 2021-03-10T20:12:04.846600+0000 mgr.gibba009.xiladd (mgr.34457) 37 : cephadm [INF] Reconfiguring daemon mon.a on gibba004 2021-03-10T20:12:08.143 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: cluster 2021-03-10T20:12:06.064300+0000 mgr.gibba009.xiladd (mgr.34457) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:08.143 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.856185+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:08.143 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.859429+0000 mon.c (mon.1) 10 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.144 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.859786+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.144 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: cephadm 2021-03-10T20:12:06.859857+0000 mgr.gibba009.xiladd (mgr.34457) 39 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:12:08.144 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.862194+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:08.144 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.864890+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:08.145 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: cephadm 2021-03-10T20:12:06.868015+0000 mgr.gibba009.xiladd (mgr.34457) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:12:08.145 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[30897]: audit 2021-03-10T20:12:06.868088+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:12:08.145 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: cluster 2021-03-10T20:12:06.064300+0000 mgr.gibba009.xiladd (mgr.34457) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:08.146 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.856185+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:08.146 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.859429+0000 mon.c (mon.1) 10 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.147 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.859786+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.147 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: cephadm 2021-03-10T20:12:06.859857+0000 mgr.gibba009.xiladd (mgr.34457) 39 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:12:08.147 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.862194+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:08.147 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.864890+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:08.148 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: cephadm 2021-03-10T20:12:06.868015+0000 mgr.gibba009.xiladd (mgr.34457) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:12:08.148 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:07 gibba004 bash[31878]: audit 2021-03-10T20:12:06.868088+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:12:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: cluster 2021-03-10T20:12:06.064300+0000 mgr.gibba009.xiladd (mgr.34457) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.856185+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.859429+0000 mon.c (mon.1) 10 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.859786+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: cephadm 2021-03-10T20:12:06.859857+0000 mgr.gibba009.xiladd (mgr.34457) 39 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:12:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.862194+0000 mon.c (mon.1) 11 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.864890+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: cephadm 2021-03-10T20:12:06.868015+0000 mgr.gibba009.xiladd (mgr.34457) 40 : cephadm [INF] Reconfiguring daemon mgr.y on gibba004 2021-03-10T20:12:08.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:07 gibba009 bash[26136]: audit 2021-03-10T20:12:06.868088+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:12:09.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: cluster 2021-03-10T20:12:08.065397+0000 mgr.gibba009.xiladd (mgr.34457) 41 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:09.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: audit 2021-03-10T20:12:08.645019+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:09.926 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: audit 2021-03-10T20:12:08.648144+0000 mon.c (mon.1) 14 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:09.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: cephadm 2021-03-10T20:12:08.648632+0000 mgr.gibba009.xiladd (mgr.34457) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:12:09.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: audit 2021-03-10T20:12:08.650169+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:09.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: audit 2021-03-10T20:12:08.652013+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:09.927 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: audit 2021-03-10T20:12:08.654002+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:12:09.928 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[30897]: cephadm 2021-03-10T20:12:08.654610+0000 mgr.gibba009.xiladd (mgr.34457) 43 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:12:09.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: cluster 2021-03-10T20:12:08.065397+0000 mgr.gibba009.xiladd (mgr.34457) 41 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:09.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: audit 2021-03-10T20:12:08.645019+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:09.928 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: audit 2021-03-10T20:12:08.648144+0000 mon.c (mon.1) 14 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:09.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: cephadm 2021-03-10T20:12:08.648632+0000 mgr.gibba009.xiladd (mgr.34457) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:12:09.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: audit 2021-03-10T20:12:08.650169+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:09.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: audit 2021-03-10T20:12:08.652013+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:09.929 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: audit 2021-03-10T20:12:08.654002+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:12:09.930 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:09 gibba004 bash[31878]: cephadm 2021-03-10T20:12:08.654610+0000 mgr.gibba009.xiladd (mgr.34457) 43 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:12:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: cluster 2021-03-10T20:12:08.065397+0000 mgr.gibba009.xiladd (mgr.34457) 41 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: audit 2021-03-10T20:12:08.645019+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: audit 2021-03-10T20:12:08.648144+0000 mon.c (mon.1) 14 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: cephadm 2021-03-10T20:12:08.648632+0000 mgr.gibba009.xiladd (mgr.34457) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:12:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: audit 2021-03-10T20:12:08.650169+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: audit 2021-03-10T20:12:08.652013+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: audit 2021-03-10T20:12:08.654002+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:12:10.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:09 gibba009 bash[26136]: cephadm 2021-03-10T20:12:08.654610+0000 mgr.gibba009.xiladd (mgr.34457) 43 : cephadm [INF] Reconfiguring daemon mon.c on gibba004 2021-03-10T20:12:11.715 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[31878]: cluster 2021-03-10T20:12:10.066409+0000 mgr.gibba009.xiladd (mgr.34457) 44 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:11.716 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[31878]: audit 2021-03-10T20:12:10.434403+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:11.716 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[31878]: cephadm 2021-03-10T20:12:10.438331+0000 mgr.gibba009.xiladd (mgr.34457) 45 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:12:11.716 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[31878]: audit 2021-03-10T20:12:10.439521+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:11.716 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[31878]: cephadm 2021-03-10T20:12:10.440196+0000 mgr.gibba009.xiladd (mgr.34457) 46 : cephadm [INF] Reconfiguring daemon osd.0 on gibba004 2021-03-10T20:12:11.717 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[30897]: cluster 2021-03-10T20:12:10.066409+0000 mgr.gibba009.xiladd (mgr.34457) 44 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:11.717 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[30897]: audit 2021-03-10T20:12:10.434403+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:11.717 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[30897]: cephadm 2021-03-10T20:12:10.438331+0000 mgr.gibba009.xiladd (mgr.34457) 45 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:12:11.718 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[30897]: audit 2021-03-10T20:12:10.439521+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:11.718 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:11 gibba004 bash[30897]: cephadm 2021-03-10T20:12:10.440196+0000 mgr.gibba009.xiladd (mgr.34457) 46 : cephadm [INF] Reconfiguring daemon osd.0 on gibba004 2021-03-10T20:12:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:11 gibba009 bash[26136]: cluster 2021-03-10T20:12:10.066409+0000 mgr.gibba009.xiladd (mgr.34457) 44 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:11 gibba009 bash[26136]: audit 2021-03-10T20:12:10.434403+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:11 gibba009 bash[26136]: cephadm 2021-03-10T20:12:10.438331+0000 mgr.gibba009.xiladd (mgr.34457) 45 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:12:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:11 gibba009 bash[26136]: audit 2021-03-10T20:12:10.439521+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:11 gibba009 bash[26136]: cephadm 2021-03-10T20:12:10.440196+0000 mgr.gibba009.xiladd (mgr.34457) 46 : cephadm [INF] Reconfiguring daemon osd.0 on gibba004 2021-03-10T20:12:13.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[30897]: cluster 2021-03-10T20:12:12.068422+0000 mgr.gibba009.xiladd (mgr.34457) 47 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:13.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[30897]: audit 2021-03-10T20:12:12.271833+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:13.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[30897]: cephadm 2021-03-10T20:12:12.275931+0000 mgr.gibba009.xiladd (mgr.34457) 48 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:12:13.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[30897]: audit 2021-03-10T20:12:12.277221+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:12:13.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[30897]: cephadm 2021-03-10T20:12:12.277888+0000 mgr.gibba009.xiladd (mgr.34457) 49 : cephadm [INF] Reconfiguring daemon osd.1 on gibba004 2021-03-10T20:12:13.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[31878]: cluster 2021-03-10T20:12:12.068422+0000 mgr.gibba009.xiladd (mgr.34457) 47 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:13.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[31878]: audit 2021-03-10T20:12:12.271833+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:13.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[31878]: cephadm 2021-03-10T20:12:12.275931+0000 mgr.gibba009.xiladd (mgr.34457) 48 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:12:13.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[31878]: audit 2021-03-10T20:12:12.277221+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:12:13.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:13 gibba004 bash[31878]: cephadm 2021-03-10T20:12:12.277888+0000 mgr.gibba009.xiladd (mgr.34457) 49 : cephadm [INF] Reconfiguring daemon osd.1 on gibba004 2021-03-10T20:12:13.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:13 gibba009 bash[26136]: cluster 2021-03-10T20:12:12.068422+0000 mgr.gibba009.xiladd (mgr.34457) 47 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:13.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:13 gibba009 bash[26136]: audit 2021-03-10T20:12:12.271833+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:13.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:13 gibba009 bash[26136]: cephadm 2021-03-10T20:12:12.275931+0000 mgr.gibba009.xiladd (mgr.34457) 48 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:12:13.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:13 gibba009 bash[26136]: audit 2021-03-10T20:12:12.277221+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:12:13.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:13 gibba009 bash[26136]: cephadm 2021-03-10T20:12:12.277888+0000 mgr.gibba009.xiladd (mgr.34457) 49 : cephadm [INF] Reconfiguring daemon osd.1 on gibba004 2021-03-10T20:12:15.426 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[30897]: cluster 2021-03-10T20:12:14.069574+0000 mgr.gibba009.xiladd (mgr.34457) 50 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:15.426 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[30897]: audit 2021-03-10T20:12:14.109623+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:15.426 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[30897]: cephadm 2021-03-10T20:12:14.113244+0000 mgr.gibba009.xiladd (mgr.34457) 51 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:12:15.427 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[30897]: audit 2021-03-10T20:12:14.115316+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:12:15.427 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[30897]: cephadm 2021-03-10T20:12:14.115480+0000 mgr.gibba009.xiladd (mgr.34457) 52 : cephadm [INF] Reconfiguring daemon osd.2 on gibba004 2021-03-10T20:12:15.427 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[31878]: cluster 2021-03-10T20:12:14.069574+0000 mgr.gibba009.xiladd (mgr.34457) 50 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:15.428 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[31878]: audit 2021-03-10T20:12:14.109623+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:15.428 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[31878]: cephadm 2021-03-10T20:12:14.113244+0000 mgr.gibba009.xiladd (mgr.34457) 51 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:12:15.428 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[31878]: audit 2021-03-10T20:12:14.115316+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:12:15.428 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:15 gibba004 bash[31878]: cephadm 2021-03-10T20:12:14.115480+0000 mgr.gibba009.xiladd (mgr.34457) 52 : cephadm [INF] Reconfiguring daemon osd.2 on gibba004 2021-03-10T20:12:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:15 gibba009 bash[26136]: cluster 2021-03-10T20:12:14.069574+0000 mgr.gibba009.xiladd (mgr.34457) 50 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:15 gibba009 bash[26136]: audit 2021-03-10T20:12:14.109623+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:15 gibba009 bash[26136]: cephadm 2021-03-10T20:12:14.113244+0000 mgr.gibba009.xiladd (mgr.34457) 51 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:12:15.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:15 gibba009 bash[26136]: audit 2021-03-10T20:12:14.115316+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:12:15.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:15 gibba009 bash[26136]: cephadm 2021-03-10T20:12:14.115480+0000 mgr.gibba009.xiladd (mgr.34457) 52 : cephadm [INF] Reconfiguring daemon osd.2 on gibba004 2021-03-10T20:12:17.292 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[30897]: audit 2021-03-10T20:12:15.978692+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:17.293 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[30897]: cephadm 2021-03-10T20:12:15.982623+0000 mgr.gibba009.xiladd (mgr.34457) 53 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:12:17.293 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[30897]: audit 2021-03-10T20:12:15.984694+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:12:17.293 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[30897]: cephadm 2021-03-10T20:12:15.985315+0000 mgr.gibba009.xiladd (mgr.34457) 54 : cephadm [INF] Reconfiguring daemon osd.3 on gibba004 2021-03-10T20:12:17.294 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[30897]: cluster 2021-03-10T20:12:16.071545+0000 mgr.gibba009.xiladd (mgr.34457) 55 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:17.294 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[31878]: audit 2021-03-10T20:12:15.978692+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:17.294 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[31878]: cephadm 2021-03-10T20:12:15.982623+0000 mgr.gibba009.xiladd (mgr.34457) 53 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:12:17.294 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[31878]: audit 2021-03-10T20:12:15.984694+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:12:17.295 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[31878]: cephadm 2021-03-10T20:12:15.985315+0000 mgr.gibba009.xiladd (mgr.34457) 54 : cephadm [INF] Reconfiguring daemon osd.3 on gibba004 2021-03-10T20:12:17.295 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:16 gibba004 bash[31878]: cluster 2021-03-10T20:12:16.071545+0000 mgr.gibba009.xiladd (mgr.34457) 55 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:17.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:16 gibba009 bash[26136]: audit 2021-03-10T20:12:15.978692+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:17.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:16 gibba009 bash[26136]: cephadm 2021-03-10T20:12:15.982623+0000 mgr.gibba009.xiladd (mgr.34457) 53 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:12:17.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:16 gibba009 bash[26136]: audit 2021-03-10T20:12:15.984694+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:12:17.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:16 gibba009 bash[26136]: cephadm 2021-03-10T20:12:15.985315+0000 mgr.gibba009.xiladd (mgr.34457) 54 : cephadm [INF] Reconfiguring daemon osd.3 on gibba004 2021-03-10T20:12:17.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:16 gibba009 bash[26136]: cluster 2021-03-10T20:12:16.071545+0000 mgr.gibba009.xiladd (mgr.34457) 55 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:19.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.795808+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:19.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.800680+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.800955+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: cephadm 2021-03-10T20:12:17.801063+0000 mgr.gibba009.xiladd (mgr.34457) 56 : cephadm [INF] Reconfiguring rgw.r.z.gibba004.fosjgj (monmap changed)... 2021-03-10T20:12:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.803174+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba004.fosjgj"}]: dispatch 2021-03-10T20:12:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.805421+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: cephadm 2021-03-10T20:12:17.808960+0000 mgr.gibba009.xiladd (mgr.34457) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:12:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[30897]: audit 2021-03-10T20:12:17.809476+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba004.fosjgj","key": "container_image"}]: dispatch 2021-03-10T20:12:19.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.795808+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:19.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.800680+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.800955+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: cephadm 2021-03-10T20:12:17.801063+0000 mgr.gibba009.xiladd (mgr.34457) 56 : cephadm [INF] Reconfiguring rgw.r.z.gibba004.fosjgj (monmap changed)... 2021-03-10T20:12:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.803174+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba004.fosjgj"}]: dispatch 2021-03-10T20:12:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.805421+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: cephadm 2021-03-10T20:12:17.808960+0000 mgr.gibba009.xiladd (mgr.34457) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:12:19.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:18 gibba004 bash[31878]: audit 2021-03-10T20:12:17.809476+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba004.fosjgj","key": "container_image"}]: dispatch 2021-03-10T20:12:19.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.795808+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:19.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.800680+0000 mon.c (mon.1) 22 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.800955+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba004.fosjgj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:19.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: cephadm 2021-03-10T20:12:17.801063+0000 mgr.gibba009.xiladd (mgr.34457) 56 : cephadm [INF] Reconfiguring rgw.r.z.gibba004.fosjgj (monmap changed)... 2021-03-10T20:12:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.803174+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba004.fosjgj"}]: dispatch 2021-03-10T20:12:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.805421+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: cephadm 2021-03-10T20:12:17.808960+0000 mgr.gibba009.xiladd (mgr.34457) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba004.fosjgj on gibba004 2021-03-10T20:12:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:18 gibba009 bash[26136]: audit 2021-03-10T20:12:17.809476+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba004.fosjgj","key": "container_image"}]: dispatch 2021-03-10T20:12:20.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:19 gibba009 bash[26136]: cluster 2021-03-10T20:12:18.072642+0000 mgr.gibba009.xiladd (mgr.34457) 58 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:19 gibba004 bash[30897]: cluster 2021-03-10T20:12:18.072642+0000 mgr.gibba009.xiladd (mgr.34457) 58 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:19 gibba004 bash[31878]: cluster 2021-03-10T20:12:18.072642+0000 mgr.gibba009.xiladd (mgr.34457) 58 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:21.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: audit 2021-03-10T20:12:19.858829+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: audit 2021-03-10T20:12:19.860437+0000 mon.c (mon.1) 26 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: cephadm 2021-03-10T20:12:19.861245+0000 mgr.gibba009.xiladd (mgr.34457) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:12:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: audit 2021-03-10T20:12:19.861692+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: audit 2021-03-10T20:12:19.862590+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: audit 2021-03-10T20:12:19.863705+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:12:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:20 gibba009 bash[26136]: cephadm 2021-03-10T20:12:19.864428+0000 mgr.gibba009.xiladd (mgr.34457) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:12:21.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: audit 2021-03-10T20:12:19.858829+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:21.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: audit 2021-03-10T20:12:19.860437+0000 mon.c (mon.1) 26 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:21.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: cephadm 2021-03-10T20:12:19.861245+0000 mgr.gibba009.xiladd (mgr.34457) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:12:21.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: audit 2021-03-10T20:12:19.861692+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:21.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: audit 2021-03-10T20:12:19.862590+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:21.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: audit 2021-03-10T20:12:19.863705+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:12:21.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[30897]: cephadm 2021-03-10T20:12:19.864428+0000 mgr.gibba009.xiladd (mgr.34457) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:12:21.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: audit 2021-03-10T20:12:19.858829+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:21.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: audit 2021-03-10T20:12:19.860437+0000 mon.c (mon.1) 26 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:12:21.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: cephadm 2021-03-10T20:12:19.861245+0000 mgr.gibba009.xiladd (mgr.34457) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:12:21.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: audit 2021-03-10T20:12:19.861692+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:12:21.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: audit 2021-03-10T20:12:19.862590+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:21.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: audit 2021-03-10T20:12:19.863705+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:12:21.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:20 gibba004 bash[31878]: cephadm 2021-03-10T20:12:19.864428+0000 mgr.gibba009.xiladd (mgr.34457) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba009 2021-03-10T20:12:22.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: cluster 2021-03-10T20:12:20.073196+0000 mgr.gibba009.xiladd (mgr.34457) 61 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:22.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.560251+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:22.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.561584+0000 mon.c (mon.1) 30 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.561822+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.562551+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:22.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.563103+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:22.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:21 gibba009 bash[26136]: audit 2021-03-10T20:12:21.563687+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:12:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: cluster 2021-03-10T20:12:20.073196+0000 mgr.gibba009.xiladd (mgr.34457) 61 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.560251+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.561584+0000 mon.c (mon.1) 30 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.561822+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.562551+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.563103+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[30897]: audit 2021-03-10T20:12:21.563687+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:12:22.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: cluster 2021-03-10T20:12:20.073196+0000 mgr.gibba009.xiladd (mgr.34457) 61 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.560251+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.561584+0000 mon.c (mon.1) 30 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.561822+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.562551+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.563103+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:21 gibba004 bash[31878]: audit 2021-03-10T20:12:21.563687+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:12:23.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:22 gibba009 bash[26136]: cephadm 2021-03-10T20:12:21.562416+0000 mgr.gibba009.xiladd (mgr.34457) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:12:23.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:22 gibba009 bash[26136]: cephadm 2021-03-10T20:12:21.564507+0000 mgr.gibba009.xiladd (mgr.34457) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba009 2021-03-10T20:12:23.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:22 gibba004 bash[30897]: cephadm 2021-03-10T20:12:21.562416+0000 mgr.gibba009.xiladd (mgr.34457) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:12:23.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:22 gibba004 bash[30897]: cephadm 2021-03-10T20:12:21.564507+0000 mgr.gibba009.xiladd (mgr.34457) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba009 2021-03-10T20:12:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:22 gibba004 bash[31878]: cephadm 2021-03-10T20:12:21.562416+0000 mgr.gibba009.xiladd (mgr.34457) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:12:23.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:22 gibba004 bash[31878]: cephadm 2021-03-10T20:12:21.564507+0000 mgr.gibba009.xiladd (mgr.34457) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba009 2021-03-10T20:12:24.241 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: cluster 2021-03-10T20:12:22.074989+0000 mgr.gibba009.xiladd (mgr.34457) 64 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:24.241 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.281238+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:24.241 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.283106+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.283397+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.284727+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:24.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.285625+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:24.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:23 gibba009 bash[26136]: audit 2021-03-10T20:12:23.287000+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.gibba009.xiladd","key": "container_image"}]: dispatch 2021-03-10T20:12:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: cluster 2021-03-10T20:12:22.074989+0000 mgr.gibba009.xiladd (mgr.34457) 64 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.281238+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.283106+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.283397+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.284727+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.285625+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[30897]: audit 2021-03-10T20:12:23.287000+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.gibba009.xiladd","key": "container_image"}]: dispatch 2021-03-10T20:12:24.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: cluster 2021-03-10T20:12:22.074989+0000 mgr.gibba009.xiladd (mgr.34457) 64 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.281238+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.283106+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.283397+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba009.xiladd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:12:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.284727+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:12:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.285625+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:23 gibba004 bash[31878]: audit 2021-03-10T20:12:23.287000+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mgr.gibba009.xiladd","key": "container_image"}]: dispatch 2021-03-10T20:12:25.183 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:24 gibba009 bash[26136]: cephadm 2021-03-10T20:12:23.283690+0000 mgr.gibba009.xiladd (mgr.34457) 65 : cephadm [INF] Reconfiguring mgr.gibba009.xiladd (monmap changed)... 2021-03-10T20:12:25.183 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:24 gibba009 bash[26136]: cephadm 2021-03-10T20:12:23.287591+0000 mgr.gibba009.xiladd (mgr.34457) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:12:25.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:24 gibba004 bash[30897]: cephadm 2021-03-10T20:12:23.283690+0000 mgr.gibba009.xiladd (mgr.34457) 65 : cephadm [INF] Reconfiguring mgr.gibba009.xiladd (monmap changed)... 2021-03-10T20:12:25.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:24 gibba004 bash[30897]: cephadm 2021-03-10T20:12:23.287591+0000 mgr.gibba009.xiladd (mgr.34457) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:12:25.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:24 gibba004 bash[31878]: cephadm 2021-03-10T20:12:23.283690+0000 mgr.gibba009.xiladd (mgr.34457) 65 : cephadm [INF] Reconfiguring mgr.gibba009.xiladd (monmap changed)... 2021-03-10T20:12:25.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:24 gibba004 bash[31878]: cephadm 2021-03-10T20:12:23.287591+0000 mgr.gibba009.xiladd (mgr.34457) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba009.xiladd on gibba009 2021-03-10T20:12:26.242 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:25 gibba009 bash[26136]: cluster 2021-03-10T20:12:24.075929+0000 mgr.gibba009.xiladd (mgr.34457) 67 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:26.243 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:25 gibba009 bash[26136]: audit 2021-03-10T20:12:24.992550+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:26.243 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:25 gibba009 bash[26136]: audit 2021-03-10T20:12:24.994646+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[30897]: cluster 2021-03-10T20:12:24.075929+0000 mgr.gibba009.xiladd (mgr.34457) 67 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:26.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[30897]: audit 2021-03-10T20:12:24.992550+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:26.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[30897]: audit 2021-03-10T20:12:24.994646+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[31878]: cluster 2021-03-10T20:12:24.075929+0000 mgr.gibba009.xiladd (mgr.34457) 67 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:26.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[31878]: audit 2021-03-10T20:12:24.992550+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:26.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:25 gibba004 bash[31878]: audit 2021-03-10T20:12:24.994646+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:26.556 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:12:26.790 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:12:26.790 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (81s) 31s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:12:26.791 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (6m) 21s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:12:26.791 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (107s) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:12:26.791 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (2m) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:12:26.791 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (63s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:12:26.792 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (54s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:12:26.792 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (26s) 21s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:12:26.792 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (37s) 31s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:12:26.793 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (6m) 31s ago 6m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:12:26.793 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (6m) 21s ago 6m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:12:26.793 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbbf6dddd3e1 2021-03-10T20:12:26.793 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:12:26.793 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:12:26.794 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:12:26.794 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (8m) 21s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:12:26.794 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (8m) 21s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:12:26.794 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (7m) 21s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:12:26.795 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (7m) 21s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:12:26.795 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (6m) 21s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:12:26.795 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 31s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:26.795 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 21s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:27.044 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:12:27.045 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:12:27.045 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:27.045 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:27.045 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:12:27.046 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:27.046 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:27.046 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:12:27.046 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:12:27.046 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:27.047 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:12:27.047 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:12:27.047 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2021-03-10T20:12:27.047 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T20:12:27.048 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:12:27.048 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:12:27.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: cephadm 2021-03-10T20:12:24.994810+0000 mgr.gibba009.xiladd (mgr.34457) 68 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:12:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: cephadm 2021-03-10T20:12:24.995284+0000 mgr.gibba009.xiladd (mgr.34457) 69 : cephadm [INF] Reconfiguring daemon osd.4 on gibba009 2021-03-10T20:12:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: cluster 2021-03-10T20:12:26.077858+0000 mgr.gibba009.xiladd (mgr.34457) 70 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: audit 2021-03-10T20:12:26.548151+0000 mgr.gibba009.xiladd (mgr.34457) 71 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: audit 2021-03-10T20:12:26.775976+0000 mgr.gibba009.xiladd (mgr.34457) 72 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[30897]: audit 2021-03-10T20:12:26.896852+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:27.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: cephadm 2021-03-10T20:12:24.994810+0000 mgr.gibba009.xiladd (mgr.34457) 68 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:12:27.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: cephadm 2021-03-10T20:12:24.995284+0000 mgr.gibba009.xiladd (mgr.34457) 69 : cephadm [INF] Reconfiguring daemon osd.4 on gibba009 2021-03-10T20:12:27.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: cluster 2021-03-10T20:12:26.077858+0000 mgr.gibba009.xiladd (mgr.34457) 70 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:27.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: audit 2021-03-10T20:12:26.548151+0000 mgr.gibba009.xiladd (mgr.34457) 71 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: audit 2021-03-10T20:12:26.775976+0000 mgr.gibba009.xiladd (mgr.34457) 72 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:26 gibba004 bash[31878]: audit 2021-03-10T20:12:26.896852+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:27.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: cephadm 2021-03-10T20:12:24.994810+0000 mgr.gibba009.xiladd (mgr.34457) 68 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:12:27.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: cephadm 2021-03-10T20:12:24.995284+0000 mgr.gibba009.xiladd (mgr.34457) 69 : cephadm [INF] Reconfiguring daemon osd.4 on gibba009 2021-03-10T20:12:27.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: cluster 2021-03-10T20:12:26.077858+0000 mgr.gibba009.xiladd (mgr.34457) 70 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:27.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: audit 2021-03-10T20:12:26.548151+0000 mgr.gibba009.xiladd (mgr.34457) 71 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: audit 2021-03-10T20:12:26.775976+0000 mgr.gibba009.xiladd (mgr.34457) 72 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:27.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:26 gibba009 bash[26136]: audit 2021-03-10T20:12:26.896852+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:28.179 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:27 gibba009 bash[26136]: cephadm 2021-03-10T20:12:26.899180+0000 mgr.gibba009.xiladd (mgr.34457) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:12:28.179 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:27 gibba009 bash[26136]: audit 2021-03-10T20:12:26.899257+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:28.180 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:27 gibba009 bash[26136]: cephadm 2021-03-10T20:12:26.899787+0000 mgr.gibba009.xiladd (mgr.34457) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba009 2021-03-10T20:12:28.180 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:27 gibba009 bash[26136]: audit 2021-03-10T20:12:27.044882+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.104:0/1960558584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[30897]: cephadm 2021-03-10T20:12:26.899180+0000 mgr.gibba009.xiladd (mgr.34457) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:12:28.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[30897]: audit 2021-03-10T20:12:26.899257+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:28.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[30897]: cephadm 2021-03-10T20:12:26.899787+0000 mgr.gibba009.xiladd (mgr.34457) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba009 2021-03-10T20:12:28.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[30897]: audit 2021-03-10T20:12:27.044882+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.104:0/1960558584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[31878]: cephadm 2021-03-10T20:12:26.899180+0000 mgr.gibba009.xiladd (mgr.34457) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:12:28.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[31878]: audit 2021-03-10T20:12:26.899257+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:28.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[31878]: cephadm 2021-03-10T20:12:26.899787+0000 mgr.gibba009.xiladd (mgr.34457) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba009 2021-03-10T20:12:28.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:27 gibba004 bash[31878]: audit 2021-03-10T20:12:27.044882+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.104:0/1960558584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:29.979 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:29 gibba009 bash[26136]: cluster 2021-03-10T20:12:28.078691+0000 mgr.gibba009.xiladd (mgr.34457) 75 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:29.979 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:29 gibba009 bash[26136]: audit 2021-03-10T20:12:28.663911+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:29.979 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:29 gibba009 bash[26136]: audit 2021-03-10T20:12:28.666170+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:12:29.979 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:29 gibba009 bash[26136]: cephadm 2021-03-10T20:12:28.666401+0000 mgr.gibba009.xiladd (mgr.34457) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:12:29.980 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:29 gibba009 bash[26136]: cephadm 2021-03-10T20:12:28.666887+0000 mgr.gibba009.xiladd (mgr.34457) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba009 2021-03-10T20:12:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[30897]: cluster 2021-03-10T20:12:28.078691+0000 mgr.gibba009.xiladd (mgr.34457) 75 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[30897]: audit 2021-03-10T20:12:28.663911+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[30897]: audit 2021-03-10T20:12:28.666170+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:12:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[30897]: cephadm 2021-03-10T20:12:28.666401+0000 mgr.gibba009.xiladd (mgr.34457) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:12:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[30897]: cephadm 2021-03-10T20:12:28.666887+0000 mgr.gibba009.xiladd (mgr.34457) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba009 2021-03-10T20:12:30.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[31878]: cluster 2021-03-10T20:12:28.078691+0000 mgr.gibba009.xiladd (mgr.34457) 75 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:30.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[31878]: audit 2021-03-10T20:12:28.663911+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:30.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[31878]: audit 2021-03-10T20:12:28.666170+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:12:30.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[31878]: cephadm 2021-03-10T20:12:28.666401+0000 mgr.gibba009.xiladd (mgr.34457) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:12:30.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:29 gibba004 bash[31878]: cephadm 2021-03-10T20:12:28.666887+0000 mgr.gibba009.xiladd (mgr.34457) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba009 2021-03-10T20:12:31.653 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:31 gibba009 bash[26136]: cluster 2021-03-10T20:12:30.079694+0000 mgr.gibba009.xiladd (mgr.34457) 78 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:31.654 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:31 gibba009 bash[26136]: audit 2021-03-10T20:12:30.419226+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:31.654 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:31 gibba009 bash[26136]: audit 2021-03-10T20:12:30.421503+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:12:31.654 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:31 gibba009 bash[26136]: cephadm 2021-03-10T20:12:30.421734+0000 mgr.gibba009.xiladd (mgr.34457) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:12:31.654 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:31 gibba009 bash[26136]: cephadm 2021-03-10T20:12:30.422227+0000 mgr.gibba009.xiladd (mgr.34457) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba009 2021-03-10T20:12:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[30897]: cluster 2021-03-10T20:12:30.079694+0000 mgr.gibba009.xiladd (mgr.34457) 78 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[30897]: audit 2021-03-10T20:12:30.419226+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[30897]: audit 2021-03-10T20:12:30.421503+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:12:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[30897]: cephadm 2021-03-10T20:12:30.421734+0000 mgr.gibba009.xiladd (mgr.34457) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:12:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[30897]: cephadm 2021-03-10T20:12:30.422227+0000 mgr.gibba009.xiladd (mgr.34457) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba009 2021-03-10T20:12:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[31878]: cluster 2021-03-10T20:12:30.079694+0000 mgr.gibba009.xiladd (mgr.34457) 78 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[31878]: audit 2021-03-10T20:12:30.419226+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[31878]: audit 2021-03-10T20:12:30.421503+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:12:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[31878]: cephadm 2021-03-10T20:12:30.421734+0000 mgr.gibba009.xiladd (mgr.34457) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:12:31.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:31 gibba004 bash[31878]: cephadm 2021-03-10T20:12:30.422227+0000 mgr.gibba009.xiladd (mgr.34457) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba009 2021-03-10T20:12:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: cluster 2021-03-10T20:12:32.080656+0000 mgr.gibba009.xiladd (mgr.34457) 81 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.091047+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.096417+0000 mon.c (mon.1) 43 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: cephadm 2021-03-10T20:12:32.096514+0000 mgr.gibba009.xiladd (mgr.34457) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba009.xbhxrc (monmap changed)... 2021-03-10T20:12:33.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.097622+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.101228+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba009.xbhxrc"}]: dispatch 2021-03-10T20:12:33.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.103500+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:33.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: audit 2021-03-10T20:12:32.105804+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba009.xbhxrc","key": "container_image"}]: dispatch 2021-03-10T20:12:33.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:33 gibba009 bash[26136]: cephadm 2021-03-10T20:12:32.106160+0000 mgr.gibba009.xiladd (mgr.34457) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:12:33.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: cluster 2021-03-10T20:12:32.080656+0000 mgr.gibba009.xiladd (mgr.34457) 81 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.091047+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.096417+0000 mon.c (mon.1) 43 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: cephadm 2021-03-10T20:12:32.096514+0000 mgr.gibba009.xiladd (mgr.34457) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba009.xbhxrc (monmap changed)... 2021-03-10T20:12:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.097622+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.101228+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba009.xbhxrc"}]: dispatch 2021-03-10T20:12:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.103500+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: audit 2021-03-10T20:12:32.105804+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba009.xbhxrc","key": "container_image"}]: dispatch 2021-03-10T20:12:33.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[30897]: cephadm 2021-03-10T20:12:32.106160+0000 mgr.gibba009.xiladd (mgr.34457) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:12:33.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: cluster 2021-03-10T20:12:32.080656+0000 mgr.gibba009.xiladd (mgr.34457) 81 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:33.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.091047+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:33.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.096417+0000 mon.c (mon.1) 43 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: cephadm 2021-03-10T20:12:32.096514+0000 mgr.gibba009.xiladd (mgr.34457) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba009.xbhxrc (monmap changed)... 2021-03-10T20:12:33.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.097622+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba009.xbhxrc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:12:33.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.101228+0000 mon.c (mon.1) 44 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba009.xbhxrc"}]: dispatch 2021-03-10T20:12:33.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.103500+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:12:33.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: audit 2021-03-10T20:12:32.105804+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba009.xbhxrc","key": "container_image"}]: dispatch 2021-03-10T20:12:33.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:33 gibba004 bash[31878]: cephadm 2021-03-10T20:12:32.106160+0000 mgr.gibba009.xiladd (mgr.34457) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba009.xbhxrc on gibba009 2021-03-10T20:12:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.763347+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.765280+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.765535+0000 mgr.gibba009.xiladd (mgr.34457) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.766800+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.767502+0000 mgr.gibba009.xiladd (mgr.34457) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.768343+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.768903+0000 mgr.gibba009.xiladd (mgr.34457) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:35.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.768948+0000 mgr.gibba009.xiladd (mgr.34457) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:35.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.770446+0000 mgr.gibba009.xiladd (mgr.34457) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:12:35.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.773006+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.774371+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.774630+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.777667+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:12:35.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.779145+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.779455+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.782999+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:12:35.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.784552+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.784879+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.763347+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.765280+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:35.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.765535+0000 mgr.gibba009.xiladd (mgr.34457) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:35.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.766800+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.767502+0000 mgr.gibba009.xiladd (mgr.34457) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:35.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.768343+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.768903+0000 mgr.gibba009.xiladd (mgr.34457) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:35.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.768948+0000 mgr.gibba009.xiladd (mgr.34457) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:35.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.770446+0000 mgr.gibba009.xiladd (mgr.34457) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:12:35.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.773006+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.774371+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.774630+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.777667+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:12:35.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.779145+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.779455+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.782999+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:12:35.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.784552+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.784879+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.787890+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:12:35.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.789489+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.790126+0000 mgr.gibba009.xiladd (mgr.34457) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:35.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.790338+0000 mgr.gibba009.xiladd (mgr.34457) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:35.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.791380+0000 mgr.gibba009.xiladd (mgr.34457) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:35.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.794047+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.796213+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.796474+0000 mgr.gibba009.xiladd (mgr.34457) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:35.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.796582+0000 mgr.gibba009.xiladd (mgr.34457) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:35.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: audit 2021-03-10T20:12:33.797563+0000 mgr.gibba009.xiladd (mgr.34457) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[30897]: cephadm 2021-03-10T20:12:33.799102+0000 mgr.gibba009.xiladd (mgr.34457) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:12:35.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.787890+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:12:35.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.789489+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.790126+0000 mgr.gibba009.xiladd (mgr.34457) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:35.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.790338+0000 mgr.gibba009.xiladd (mgr.34457) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:35.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.791380+0000 mgr.gibba009.xiladd (mgr.34457) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:35.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.794047+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.796213+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.796474+0000 mgr.gibba009.xiladd (mgr.34457) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:35.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.796582+0000 mgr.gibba009.xiladd (mgr.34457) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:35.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: audit 2021-03-10T20:12:33.797563+0000 mgr.gibba009.xiladd (mgr.34457) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:34 gibba004 bash[31878]: cephadm 2021-03-10T20:12:33.799102+0000 mgr.gibba009.xiladd (mgr.34457) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:12:35.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.763347+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.765280+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:35.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.765535+0000 mgr.gibba009.xiladd (mgr.34457) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.766800+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.767502+0000 mgr.gibba009.xiladd (mgr.34457) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.768343+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.768903+0000 mgr.gibba009.xiladd (mgr.34457) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.768948+0000 mgr.gibba009.xiladd (mgr.34457) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.770446+0000 mgr.gibba009.xiladd (mgr.34457) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:12:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.773006+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.774371+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.774630+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:12:35.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.777667+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:12:35.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.779145+0000 mon.c (mon.1) 51 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.779455+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:12:35.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.782999+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:12:35.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.784552+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.784879+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:12:35.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.787890+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:12:35.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.789489+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:35.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.790126+0000 mgr.gibba009.xiladd (mgr.34457) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:35.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.790338+0000 mgr.gibba009.xiladd (mgr.34457) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:35.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.791380+0000 mgr.gibba009.xiladd (mgr.34457) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:35.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.794047+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:35.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.796213+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.796474+0000 mgr.gibba009.xiladd (mgr.34457) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:35.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.796582+0000 mgr.gibba009.xiladd (mgr.34457) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:35.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: audit 2021-03-10T20:12:33.797563+0000 mgr.gibba009.xiladd (mgr.34457) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:12:35.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:34 gibba009 bash[26136]: cephadm 2021-03-10T20:12:33.799102+0000 mgr.gibba009.xiladd (mgr.34457) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:12:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[30897]: cluster 2021-03-10T20:12:34.081703+0000 mgr.gibba009.xiladd (mgr.34457) 96 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[30897]: audit 2021-03-10T20:12:35.737496+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[30897]: audit 2021-03-10T20:12:35.743258+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[31878]: cluster 2021-03-10T20:12:34.081703+0000 mgr.gibba009.xiladd (mgr.34457) 96 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[31878]: audit 2021-03-10T20:12:35.737496+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:35 gibba004 bash[31878]: audit 2021-03-10T20:12:35.743258+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:35 gibba009 bash[26136]: cluster 2021-03-10T20:12:34.081703+0000 mgr.gibba009.xiladd (mgr.34457) 96 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:35 gibba009 bash[26136]: audit 2021-03-10T20:12:35.737496+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:35 gibba009 bash[26136]: audit 2021-03-10T20:12:35.743258+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:12:37.009 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:36 gibba004 bash[30897]: cephadm 2021-03-10T20:12:35.732582+0000 mgr.gibba009.xiladd (mgr.34457) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:12:37.009 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:36 gibba004 bash[30897]: cephadm 2021-03-10T20:12:35.742980+0000 mgr.gibba009.xiladd (mgr.34457) 98 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:12:37.010 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:36 gibba004 bash[31878]: cephadm 2021-03-10T20:12:35.732582+0000 mgr.gibba009.xiladd (mgr.34457) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:12:37.010 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:36 gibba004 bash[31878]: cephadm 2021-03-10T20:12:35.742980+0000 mgr.gibba009.xiladd (mgr.34457) 98 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:12:37.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:36 gibba009 bash[26136]: cephadm 2021-03-10T20:12:35.732582+0000 mgr.gibba009.xiladd (mgr.34457) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:12:37.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:36 gibba009 bash[26136]: cephadm 2021-03-10T20:12:35.742980+0000 mgr.gibba009.xiladd (mgr.34457) 98 : cephadm [INF] Deploying daemon osd.0 on gibba004 2021-03-10T20:12:37.806 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:37 gibba004 systemd[1]: Stopping Ceph osd.0 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:12:37.806 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:37 gibba004 bash[14889]: debug 2021-03-10T20:12:37.711+0000 7efc696b7700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:12:37.807 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:37 gibba004 bash[14889]: debug 2021-03-10T20:12:37.711+0000 7efc696b7700 -1 osd.0 66 *** Got signal Terminated *** 2021-03-10T20:12:37.807 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:37 gibba004 bash[14889]: debug 2021-03-10T20:12:37.711+0000 7efc696b7700 -1 osd.0 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:12:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:37 gibba004 bash[30897]: cluster 2021-03-10T20:12:36.083490+0000 mgr.gibba009.xiladd (mgr.34457) 99 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:37 gibba004 bash[31878]: cluster 2021-03-10T20:12:36.083490+0000 mgr.gibba009.xiladd (mgr.34457) 99 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:37 gibba009 bash[26136]: cluster 2021-03-10T20:12:36.083490+0000 mgr.gibba009.xiladd (mgr.34457) 99 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:38.812 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:38 gibba004 docker[33389]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.0 2021-03-10T20:12:39.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815344+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815387+0000 mon.a (mon.0) 109 : cluster [INF] osd.0 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:12:39.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815605+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815730+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815871+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.815976+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.816141+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:37.816275+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.013396+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.013737+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.014548+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.014949+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.015600+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.016216+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.016518+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017009+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017149+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017219+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017374+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017404+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017583+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.017668+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.411283+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.411493+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.412107+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.412379+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815344+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815387+0000 mon.a (mon.0) 109 : cluster [INF] osd.0 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:12:39.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815605+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815730+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815871+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.815976+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.816141+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:37.816275+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.013396+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.013737+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.014548+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.014949+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.015600+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.016216+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.016518+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017009+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017149+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017219+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017374+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017404+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017583+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.017668+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.411283+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.411493+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.412107+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.412379+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.412885+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.413157+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.416960+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.417416+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.417600+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.418141+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.418372+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.418916+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.419344+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.419614+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.412885+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.413157+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.416960+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.417416+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.417600+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.418141+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.418372+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.418916+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.419344+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:38 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.419614+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815344+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815387+0000 mon.a (mon.0) 109 : cluster [INF] osd.0 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:12:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815605+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815730+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815871+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.815976+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.816141+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:37.816275+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.013396+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.013737+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.014548+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.014949+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.015600+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.016216+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.016518+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017009+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017149+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017219+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017374+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017404+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017583+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.017668+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.411283+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.411493+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:12:39.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.412107+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.412379+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:12:39.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.412885+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.413157+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:12:39.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.416960+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.417416+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:12:39.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.417600+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.418141+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.418372+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:12:39.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.418916+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:12:39.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.419344+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:39.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:38 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.419614+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:12:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.084600+0000 mgr.gibba009.xiladd (mgr.34457) 100 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.808997+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: cluster 2021-03-10T20:12:38.820805+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T20:12:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:38.821631+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:38.821860+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:38.823782+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:38.824113+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.457534+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.457705+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.457905+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458015+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458111+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458319+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458351+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458561+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458632+0000 mon.c (mon.1) 63 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458739+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458776+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.458958+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459003+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459144+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459149+0000 mon.c (mon.1) 66 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459265+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459352+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459562+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459738+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.459927+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.572909+0000 mon.c (mon.1) 68 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.573284+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.577396+0000 mon.c (mon.1) 69 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:40.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:39 gibba009 bash[26136]: audit 2021-03-10T20:12:39.577705+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:40.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.084600+0000 mgr.gibba009.xiladd (mgr.34457) 100 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:40.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.808997+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:40.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: cluster 2021-03-10T20:12:38.820805+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T20:12:40.094 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:38.821631+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.095 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:38.821860+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.095 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:38.823782+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.095 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:38.824113+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.095 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.457534+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.457705+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.457905+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458015+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458111+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.096 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458319+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458351+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458561+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.097 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.084600+0000 mgr.gibba009.xiladd (mgr.34457) 100 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:40.097 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.808997+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:40.098 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: cluster 2021-03-10T20:12:38.820805+0000 mon.a (mon.0) 145 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2021-03-10T20:12:40.098 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:38.821631+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.098 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:38.821860+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:12:40.098 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:38.823782+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.099 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:38.824113+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:12:40.099 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.457534+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.099 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.457705+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.099 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.457905+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.099 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458015+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 4]}]: dispatch 2021-03-10T20:12:40.100 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458111+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.100 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458319+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.100 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458351+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.100 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458561+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458632+0000 mon.c (mon.1) 63 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458739+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458776+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.458958+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459003+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459144+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459149+0000 mon.c (mon.1) 66 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459265+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459352+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459562+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459738+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.459927+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.572909+0000 mon.c (mon.1) 68 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.573284+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.577396+0000 mon.c (mon.1) 69 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:40.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[31878]: audit 2021-03-10T20:12:39.577705+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:40.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458632+0000 mon.c (mon.1) 63 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458739+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:12:40.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458776+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.458958+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.106 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459003+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.106 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459144+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 0]}]: dispatch 2021-03-10T20:12:40.106 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459149+0000 mon.c (mon.1) 66 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.106 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459265+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.106 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459352+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.107 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459562+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.107 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459738+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 0]}]: dispatch 2021-03-10T20:12:40.107 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.459927+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [3, 5]}]: dispatch 2021-03-10T20:12:40.107 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.572909+0000 mon.c (mon.1) 68 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.108 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.573284+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:40.108 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.577396+0000 mon.c (mon.1) 69 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:40.108 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:39 gibba004 bash[30897]: audit 2021-03-10T20:12:39.577705+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:41.062 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:40 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.0.service: Succeeded. 2021-03-10T20:12:41.063 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:40 gibba004 systemd[1]: Stopped Ceph osd.0 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:12:41.063 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:40 gibba004 systemd[1]: Started Ceph osd.0 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:12:41.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[30897]: audit 2021-03-10T20:12:39.824653+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:12:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[30897]: cluster 2021-03-10T20:12:39.824781+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:12:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[30897]: audit 2021-03-10T20:12:40.762374+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[30897]: audit 2021-03-10T20:12:40.764633+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[30897]: audit 2021-03-10T20:12:40.769666+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[31878]: audit 2021-03-10T20:12:39.824653+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:12:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[31878]: cluster 2021-03-10T20:12:39.824781+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:12:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[31878]: audit 2021-03-10T20:12:40.762374+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[31878]: audit 2021-03-10T20:12:40.764633+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:40 gibba004 bash[31878]: audit 2021-03-10T20:12:40.769666+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:41.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:40 gibba009 bash[26136]: audit 2021-03-10T20:12:39.824653+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:12:41.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:40 gibba009 bash[26136]: cluster 2021-03-10T20:12:39.824781+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:12:41.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:40 gibba009 bash[26136]: audit 2021-03-10T20:12:40.762374+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:41.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:40 gibba009 bash[26136]: audit 2021-03-10T20:12:40.764633+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:41.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:40 gibba009 bash[26136]: audit 2021-03-10T20:12:40.769666+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:41 gibba004 bash[30897]: cluster 2021-03-10T20:12:40.085541+0000 mgr.gibba009.xiladd (mgr.34457) 101 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:41 gibba004 bash[31878]: cluster 2021-03-10T20:12:40.085541+0000 mgr.gibba009.xiladd (mgr.34457) 101 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:41 gibba009 bash[26136]: cluster 2021-03-10T20:12:40.085541+0000 mgr.gibba009.xiladd (mgr.34457) 101 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.8 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:12:42.562 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:12:42.562 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T20:12:42.563 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:12:42.563 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:12:42.563 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:12:42.563 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:12:42.564 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[33560]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T20:12:43.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[30897]: cluster 2021-03-10T20:12:42.831783+0000 mon.a (mon.0) 163 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:43.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:42 gibba004 bash[31878]: cluster 2021-03-10T20:12:42.831783+0000 mon.a (mon.0) 163 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:43.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:42 gibba009 bash[26136]: cluster 2021-03-10T20:12:42.831783+0000 mon.a (mon.0) 163 : cluster [WRN] Health check failed: Degraded data redundancy: 24/195 objects degraded (12.308%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:43.890 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:43 gibba004 bash[33688]: debug 2021-03-10T20:12:43.647+0000 7fb6dc662700 1 -- 172.21.2.104:0/3470794607 <== mon.0 v2:172.21.2.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cf633b64e0 con 0x55cf63433400 2021-03-10T20:12:44.206 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:43 gibba004 bash[30897]: cluster 2021-03-10T20:12:42.088115+0000 mgr.gibba009.xiladd (mgr.34457) 102 : cluster [DBG] pgmap v37: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:44.207 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:43 gibba004 bash[31878]: cluster 2021-03-10T20:12:42.088115+0000 mgr.gibba009.xiladd (mgr.34457) 102 : cluster [DBG] pgmap v37: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:44.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:43 gibba009 bash[26136]: cluster 2021-03-10T20:12:42.088115+0000 mgr.gibba009.xiladd (mgr.34457) 102 : cluster [DBG] pgmap v37: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:44.561 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:44 gibba004 bash[33688]: debug 2021-03-10T20:12:44.203+0000 7fb6e40f7080 -1 Falling back to public interface 2021-03-10T20:12:45.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cluster 2021-03-10T20:12:44.089479+0000 mgr.gibba009.xiladd (mgr.34457) 103 : cluster [DBG] pgmap v38: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:45.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.449642+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.451886+0000 mgr.gibba009.xiladd (mgr.34457) 104 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:12:45.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.649323+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.659118+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:45.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.659224+0000 mgr.gibba009.xiladd (mgr.34457) 105 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:45.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.660706+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.661308+0000 mgr.gibba009.xiladd (mgr.34457) 106 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:45.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.661858+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.662511+0000 mgr.gibba009.xiladd (mgr.34457) 107 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:45.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.662583+0000 mgr.gibba009.xiladd (mgr.34457) 108 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:45.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.663013+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.663717+0000 mgr.gibba009.xiladd (mgr.34457) 109 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:45.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.663757+0000 mgr.gibba009.xiladd (mgr.34457) 110 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:45.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.664901+0000 mgr.gibba009.xiladd (mgr.34457) 111 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:45.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.666023+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.666467+0000 mgr.gibba009.xiladd (mgr.34457) 112 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:45.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.666576+0000 mgr.gibba009.xiladd (mgr.34457) 113 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:45.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: audit 2021-03-10T20:12:44.667290+0000 mgr.gibba009.xiladd (mgr.34457) 114 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[30897]: cephadm 2021-03-10T20:12:44.668589+0000 mgr.gibba009.xiladd (mgr.34457) 115 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:12:45.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cluster 2021-03-10T20:12:44.089479+0000 mgr.gibba009.xiladd (mgr.34457) 103 : cluster [DBG] pgmap v38: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:45.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.449642+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.451886+0000 mgr.gibba009.xiladd (mgr.34457) 104 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:12:45.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.649323+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.659118+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:45.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.659224+0000 mgr.gibba009.xiladd (mgr.34457) 105 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:45.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.660706+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.661308+0000 mgr.gibba009.xiladd (mgr.34457) 106 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:45.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.661858+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.662511+0000 mgr.gibba009.xiladd (mgr.34457) 107 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:45.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.662583+0000 mgr.gibba009.xiladd (mgr.34457) 108 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:45.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.663013+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.663717+0000 mgr.gibba009.xiladd (mgr.34457) 109 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:45.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.663757+0000 mgr.gibba009.xiladd (mgr.34457) 110 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:45.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.664901+0000 mgr.gibba009.xiladd (mgr.34457) 111 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:45.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.666023+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.666467+0000 mgr.gibba009.xiladd (mgr.34457) 112 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:45.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.666576+0000 mgr.gibba009.xiladd (mgr.34457) 113 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:45.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: audit 2021-03-10T20:12:44.667290+0000 mgr.gibba009.xiladd (mgr.34457) 114 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:45 gibba004 bash[31878]: cephadm 2021-03-10T20:12:44.668589+0000 mgr.gibba009.xiladd (mgr.34457) 115 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:12:45.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cluster 2021-03-10T20:12:44.089479+0000 mgr.gibba009.xiladd (mgr.34457) 103 : cluster [DBG] pgmap v38: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.449642+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.451886+0000 mgr.gibba009.xiladd (mgr.34457) 104 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:12:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.649323+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.659118+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.659224+0000 mgr.gibba009.xiladd (mgr.34457) 105 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.660706+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.661308+0000 mgr.gibba009.xiladd (mgr.34457) 106 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.661858+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.662511+0000 mgr.gibba009.xiladd (mgr.34457) 107 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:45.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.662583+0000 mgr.gibba009.xiladd (mgr.34457) 108 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:45.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.663013+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:45.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.663717+0000 mgr.gibba009.xiladd (mgr.34457) 109 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:45.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.663757+0000 mgr.gibba009.xiladd (mgr.34457) 110 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.664901+0000 mgr.gibba009.xiladd (mgr.34457) 111 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.666023+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.666467+0000 mgr.gibba009.xiladd (mgr.34457) 112 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.666576+0000 mgr.gibba009.xiladd (mgr.34457) 113 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:45.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: audit 2021-03-10T20:12:44.667290+0000 mgr.gibba009.xiladd (mgr.34457) 114 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:12:45.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:45 gibba009 bash[26136]: cephadm 2021-03-10T20:12:44.668589+0000 mgr.gibba009.xiladd (mgr.34457) 115 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:12:47.812 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[33688]: debug 2021-03-10T20:12:47.319+0000 7fb6e40f7080 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:12:47.813 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[33688]: debug 2021-03-10T20:12:47.319+0000 7fb6cebbb700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:12:47.813 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[33688]: debug 2021-03-10T20:12:47.319+0000 7fb6cebbb700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #1:96c0328a:::INTEL_SSDPEL1K375GA_PHKM913400JX375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:12:47.813 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[33688]: debug 2021-03-10T20:12:47.443+0000 7fb6e40f7080 -1 osd.0 66 log_to_monitors {default=true} 2021-03-10T20:12:47.814 INFO:journalctl@ceph.osd.0.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[33688]: debug 2021-03-10T20:12:47.471+0000 7fb6d45d5700 -1 osd.0 66 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:12:47.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[30897]: cluster 2021-03-10T20:12:46.091726+0000 mgr.gibba009.xiladd (mgr.34457) 116 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:47.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[30897]: audit 2021-03-10T20:12:47.452002+0000 mon.c (mon.1) 77 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:47.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[30897]: audit 2021-03-10T20:12:47.452306+0000 mon.a (mon.0) 166 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:47.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[31878]: cluster 2021-03-10T20:12:46.091726+0000 mgr.gibba009.xiladd (mgr.34457) 116 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:47.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[31878]: audit 2021-03-10T20:12:47.452002+0000 mon.c (mon.1) 77 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:47.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:47 gibba004 bash[31878]: audit 2021-03-10T20:12:47.452306+0000 mon.a (mon.0) 166 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:47.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:47 gibba009 bash[26136]: cluster 2021-03-10T20:12:46.091726+0000 mgr.gibba009.xiladd (mgr.34457) 116 : cluster [DBG] pgmap v39: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 664 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:47.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:47 gibba009 bash[26136]: audit 2021-03-10T20:12:47.452002+0000 mon.c (mon.1) 77 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:47.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:47 gibba009 bash[26136]: audit 2021-03-10T20:12:47.452306+0000 mon.a (mon.0) 166 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:12:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[30897]: audit 2021-03-10T20:12:47.461916+0000 mon.a (mon.0) 167 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:12:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[30897]: cluster 2021-03-10T20:12:47.461975+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:12:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[30897]: audit 2021-03-10T20:12:47.462653+0000 mon.c (mon.1) 78 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[30897]: audit 2021-03-10T20:12:47.470141+0000 mon.a (mon.0) 169 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[31878]: audit 2021-03-10T20:12:47.461916+0000 mon.a (mon.0) 167 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:12:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[31878]: cluster 2021-03-10T20:12:47.461975+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:12:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[31878]: audit 2021-03-10T20:12:47.462653+0000 mon.c (mon.1) 78 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:48.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:48 gibba004 bash[31878]: audit 2021-03-10T20:12:47.470141+0000 mon.a (mon.0) 169 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:48.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:48 gibba009 bash[26136]: audit 2021-03-10T20:12:47.461916+0000 mon.a (mon.0) 167 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:12:48.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:48 gibba009 bash[26136]: cluster 2021-03-10T20:12:47.461975+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:12:48.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:48 gibba009 bash[26136]: audit 2021-03-10T20:12:47.462653+0000 mon.c (mon.1) 78 : audit [INF] from='osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:48.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:48 gibba009 bash[26136]: audit 2021-03-10T20:12:47.470141+0000 mon.a (mon.0) 169 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:12:49.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[30897]: cluster 2021-03-10T20:12:48.093097+0000 mgr.gibba009.xiladd (mgr.34457) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[30897]: cluster 2021-03-10T20:12:48.468812+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[30897]: cluster 2021-03-10T20:12:48.473672+0000 mon.a (mon.0) 171 : cluster [INF] osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493] boot 2021-03-10T20:12:49.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[30897]: cluster 2021-03-10T20:12:48.473715+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T20:12:49.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[30897]: audit 2021-03-10T20:12:48.474957+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:12:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[31878]: cluster 2021-03-10T20:12:48.093097+0000 mgr.gibba009.xiladd (mgr.34457) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[31878]: cluster 2021-03-10T20:12:48.468812+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:49.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[31878]: cluster 2021-03-10T20:12:48.473672+0000 mon.a (mon.0) 171 : cluster [INF] osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493] boot 2021-03-10T20:12:49.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[31878]: cluster 2021-03-10T20:12:48.473715+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T20:12:49.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:49 gibba004 bash[31878]: audit 2021-03-10T20:12:48.474957+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:12:49.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:49 gibba009 bash[26136]: cluster 2021-03-10T20:12:48.093097+0000 mgr.gibba009.xiladd (mgr.34457) 117 : cluster [DBG] pgmap v41: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:49.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:49 gibba009 bash[26136]: cluster 2021-03-10T20:12:48.468812+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:49.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:49 gibba009 bash[26136]: cluster 2021-03-10T20:12:48.473672+0000 mon.a (mon.0) 171 : cluster [INF] osd.0 [v2:172.21.2.104:6800/440950493,v1:172.21.2.104:6801/440950493] boot 2021-03-10T20:12:49.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:49 gibba009 bash[26136]: cluster 2021-03-10T20:12:48.473715+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-03-10T20:12:49.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:49 gibba009 bash[26136]: audit 2021-03-10T20:12:48.474957+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:12:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:50 gibba004 bash[30897]: cluster 2021-03-10T20:12:49.482155+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:12:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:50 gibba004 bash[31878]: cluster 2021-03-10T20:12:49.482155+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:12:50.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:50 gibba009 bash[26136]: cluster 2021-03-10T20:12:49.482155+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:12:51.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:51 gibba004 bash[30897]: cluster 2021-03-10T20:12:50.093809+0000 mgr.gibba009.xiladd (mgr.34457) 118 : cluster [DBG] pgmap v44: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:51.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:51 gibba004 bash[31878]: cluster 2021-03-10T20:12:50.093809+0000 mgr.gibba009.xiladd (mgr.34457) 118 : cluster [DBG] pgmap v44: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:51.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:51 gibba009 bash[26136]: cluster 2021-03-10T20:12:50.093809+0000 mgr.gibba009.xiladd (mgr.34457) 118 : cluster [DBG] pgmap v44: 129 pgs: 17 active+undersized+degraded, 32 active+undersized, 80 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:12:52.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:52 gibba004 bash[30897]: cluster 2021-03-10T20:12:52.502991+0000 mon.a (mon.0) 174 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:52 gibba004 bash[31878]: cluster 2021-03-10T20:12:52.502991+0000 mon.a (mon.0) 174 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:52.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:52 gibba009 bash[26136]: cluster 2021-03-10T20:12:52.502991+0000 mon.a (mon.0) 174 : cluster [WRN] Health check update: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:53.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:53 gibba009 bash[26136]: cluster 2021-03-10T20:12:52.095975+0000 mgr.gibba009.xiladd (mgr.34457) 119 : cluster [DBG] pgmap v45: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:53 gibba004 bash[30897]: cluster 2021-03-10T20:12:52.095975+0000 mgr.gibba009.xiladd (mgr.34457) 119 : cluster [DBG] pgmap v45: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:53 gibba004 bash[31878]: cluster 2021-03-10T20:12:52.095975+0000 mgr.gibba009.xiladd (mgr.34457) 119 : cluster [DBG] pgmap v45: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:54 gibba004 bash[30897]: cluster 2021-03-10T20:12:54.562110+0000 mon.a (mon.0) 175 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T20:12:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:54 gibba004 bash[31878]: cluster 2021-03-10T20:12:54.562110+0000 mon.a (mon.0) 175 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T20:12:55.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:54 gibba009 bash[26136]: cluster 2021-03-10T20:12:54.562110+0000 mon.a (mon.0) 175 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 6 pgs degraded) 2021-03-10T20:12:56.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:55 gibba004 bash[30897]: cluster 2021-03-10T20:12:54.097238+0000 mgr.gibba009.xiladd (mgr.34457) 120 : cluster [DBG] pgmap v46: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:56.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:55 gibba004 bash[31878]: cluster 2021-03-10T20:12:54.097238+0000 mgr.gibba009.xiladd (mgr.34457) 120 : cluster [DBG] pgmap v46: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:56.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:55 gibba009 bash[26136]: cluster 2021-03-10T20:12:54.097238+0000 mgr.gibba009.xiladd (mgr.34457) 120 : cluster [DBG] pgmap v46: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:57.289 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:12:57.520 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:12:57.520 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (112s) 13s ago 7m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:12:57.521 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (7m) 52s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:12:57.521 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (2m) 52s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:12:57.521 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (2m) 52s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:12:57.521 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (93s) 13s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:12:57.521 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (85s) 13s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:12:57.522 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (57s) 52s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:12:57.522 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (68s) 13s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:12:57.522 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (7m) 13s ago 7m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:12:57.522 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (7m) 52s ago 7m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:12:57.523 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (14s) 13s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:12:57.523 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (9m) 13s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 256cde69c23e 2021-03-10T20:12:57.523 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (9m) 13s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:12:57.523 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (9m) 13s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:12:57.523 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (8m) 52s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:12:57.524 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (8m) 52s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:12:57.524 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (7m) 52s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:12:57.524 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (7m) 52s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:12:57.524 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (6m) 52s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:12:57.525 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 13s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:57.525 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 52s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:57.805 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:12:57.805 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:12:57.805 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:57.806 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:57.806 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:12:57.806 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:57.806 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:57.807 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:12:57.807 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T20:12:57.807 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 1 2021-03-10T20:12:57.807 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:12:57.808 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:12:57.808 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:12:57.808 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T20:12:57.809 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T20:12:57.809 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:12:57.809 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:12:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:57 gibba004 bash[30897]: cluster 2021-03-10T20:12:56.099179+0000 mgr.gibba009.xiladd (mgr.34457) 121 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:58.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:57 gibba004 bash[31878]: cluster 2021-03-10T20:12:56.099179+0000 mgr.gibba009.xiladd (mgr.34457) 121 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:58.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:57 gibba009 bash[26136]: cluster 2021-03-10T20:12:56.099179+0000 mgr.gibba009.xiladd (mgr.34457) 121 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[30897]: audit 2021-03-10T20:12:57.281160+0000 mgr.gibba009.xiladd (mgr.34457) 122 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[30897]: audit 2021-03-10T20:12:57.508734+0000 mgr.gibba009.xiladd (mgr.34457) 123 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[30897]: audit 2021-03-10T20:12:57.805307+0000 mon.a (mon.0) 176 : audit [DBG] from='client.? 172.21.2.104:0/996338401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:59.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[31878]: audit 2021-03-10T20:12:57.281160+0000 mgr.gibba009.xiladd (mgr.34457) 122 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[31878]: audit 2021-03-10T20:12:57.508734+0000 mgr.gibba009.xiladd (mgr.34457) 123 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:58 gibba004 bash[31878]: audit 2021-03-10T20:12:57.805307+0000 mon.a (mon.0) 176 : audit [DBG] from='client.? 172.21.2.104:0/996338401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:59.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:58 gibba009 bash[26136]: audit 2021-03-10T20:12:57.281160+0000 mgr.gibba009.xiladd (mgr.34457) 122 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:58 gibba009 bash[26136]: audit 2021-03-10T20:12:57.508734+0000 mgr.gibba009.xiladd (mgr.34457) 123 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:59.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:58 gibba009 bash[26136]: audit 2021-03-10T20:12:57.805307+0000 mon.a (mon.0) 176 : audit [DBG] from='client.? 172.21.2.104:0/996338401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:59.892 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:59 gibba004 bash[31878]: cluster 2021-03-10T20:12:58.100429+0000 mgr.gibba009.xiladd (mgr.34457) 124 : cluster [DBG] pgmap v48: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:59.892 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:12:59 gibba004 bash[31878]: audit 2021-03-10T20:12:59.580644+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:12:59.892 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:59 gibba004 bash[30897]: cluster 2021-03-10T20:12:58.100429+0000 mgr.gibba009.xiladd (mgr.34457) 124 : cluster [DBG] pgmap v48: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:12:59.893 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:12:59 gibba004 bash[30897]: audit 2021-03-10T20:12:59.580644+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:59 gibba009 bash[26136]: cluster 2021-03-10T20:12:58.100429+0000 mgr.gibba009.xiladd (mgr.34457) 124 : cluster [DBG] pgmap v48: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:12:59 gibba009 bash[26136]: audit 2021-03-10T20:12:59.580644+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:00.909 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[30897]: audit 2021-03-10T20:12:59.683912+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:00.909 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[30897]: audit 2021-03-10T20:12:59.685888+0000 mgr.gibba009.xiladd (mgr.34457) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:00.909 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[30897]: cephadm 2021-03-10T20:12:59.690984+0000 mgr.gibba009.xiladd (mgr.34457) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:13:00.910 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[31878]: audit 2021-03-10T20:12:59.683912+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:00.910 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[31878]: audit 2021-03-10T20:12:59.685888+0000 mgr.gibba009.xiladd (mgr.34457) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:00.910 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:00 gibba004 bash[31878]: cephadm 2021-03-10T20:12:59.690984+0000 mgr.gibba009.xiladd (mgr.34457) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:13:01.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:00 gibba009 bash[26136]: audit 2021-03-10T20:12:59.683912+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:01.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:00 gibba009 bash[26136]: audit 2021-03-10T20:12:59.685888+0000 mgr.gibba009.xiladd (mgr.34457) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:13:01.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:00 gibba009 bash[26136]: cephadm 2021-03-10T20:12:59.690984+0000 mgr.gibba009.xiladd (mgr.34457) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:13:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[30897]: cluster 2021-03-10T20:13:00.101581+0000 mgr.gibba009.xiladd (mgr.34457) 127 : cluster [DBG] pgmap v49: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[30897]: audit 2021-03-10T20:13:01.580489+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[30897]: audit 2021-03-10T20:13:01.582636+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:13:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[31878]: cluster 2021-03-10T20:13:00.101581+0000 mgr.gibba009.xiladd (mgr.34457) 127 : cluster [DBG] pgmap v49: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[31878]: audit 2021-03-10T20:13:01.580489+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:01 gibba004 bash[31878]: audit 2021-03-10T20:13:01.582636+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:13:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:01 gibba009 bash[26136]: cluster 2021-03-10T20:13:00.101581+0000 mgr.gibba009.xiladd (mgr.34457) 127 : cluster [DBG] pgmap v49: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:01 gibba009 bash[26136]: audit 2021-03-10T20:13:01.580489+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:02.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:01 gibba009 bash[26136]: audit 2021-03-10T20:13:01.582636+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:13:02.918 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:02 gibba004 bash[30897]: cephadm 2021-03-10T20:13:01.571249+0000 mgr.gibba009.xiladd (mgr.34457) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:13:02.918 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:02 gibba004 bash[30897]: cephadm 2021-03-10T20:13:01.583369+0000 mgr.gibba009.xiladd (mgr.34457) 129 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:13:02.919 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:02 gibba004 bash[31878]: cephadm 2021-03-10T20:13:01.571249+0000 mgr.gibba009.xiladd (mgr.34457) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:13:02.919 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:02 gibba004 bash[31878]: cephadm 2021-03-10T20:13:01.583369+0000 mgr.gibba009.xiladd (mgr.34457) 129 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:13:03.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:02 gibba009 bash[26136]: cephadm 2021-03-10T20:13:01.571249+0000 mgr.gibba009.xiladd (mgr.34457) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:13:03.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:02 gibba009 bash[26136]: cephadm 2021-03-10T20:13:01.583369+0000 mgr.gibba009.xiladd (mgr.34457) 129 : cephadm [INF] Deploying daemon osd.1 on gibba004 2021-03-10T20:13:03.672 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:03 gibba004 systemd[1]: Stopping Ceph osd.1 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:13:03.672 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:03 gibba004 bash[16413]: debug 2021-03-10T20:13:03.575+0000 7fb6a8255700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:13:03.672 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:03 gibba004 bash[16413]: debug 2021-03-10T20:13:03.575+0000 7fb6a8255700 -1 osd.1 71 *** Got signal Terminated *** 2021-03-10T20:13:03.673 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:03 gibba004 bash[16413]: debug 2021-03-10T20:13:03.575+0000 7fb6a8255700 -1 osd.1 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:13:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:03 gibba004 bash[30897]: cluster 2021-03-10T20:13:02.103566+0000 mgr.gibba009.xiladd (mgr.34457) 130 : cluster [DBG] pgmap v50: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:03 gibba004 bash[31878]: cluster 2021-03-10T20:13:02.103566+0000 mgr.gibba009.xiladd (mgr.34457) 130 : cluster [DBG] pgmap v50: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:03 gibba009 bash[26136]: cluster 2021-03-10T20:13:02.103566+0000 mgr.gibba009.xiladd (mgr.34457) 130 : cluster [DBG] pgmap v50: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:04.678 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:04 gibba004 docker[34598]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.1 2021-03-10T20:13:05.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683283+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683311+0000 mon.a (mon.0) 180 : cluster [INF] osd.1 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:05.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683436+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683514+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683729+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.683846+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.684041+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.684126+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.684279+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.884322+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.884603+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.885489+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.886086+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.886708+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.887018+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.887716+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.888120+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.888780+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.889311+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.889840+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.890397+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.890803+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:03.891462+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.285115+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.285375+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.286181+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683283+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683311+0000 mon.a (mon.0) 180 : cluster [INF] osd.1 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:05.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683436+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683514+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683729+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.683846+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.684041+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.684126+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.684279+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.884322+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.884603+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.885489+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.886086+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.886708+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.887018+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.887716+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.888120+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.888780+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.889311+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.889840+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.890397+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.890803+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:03.891462+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.285115+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.285375+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.286181+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.287048+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.287381+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.287965+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.288425+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.289080+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.289617+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.290058+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.290195+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.290317+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.290555+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.290637+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.287048+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.287381+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.287965+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.288425+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.289080+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.289617+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.290058+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.290195+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.290317+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.290555+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:04 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.290637+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683283+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683311+0000 mon.a (mon.0) 180 : cluster [INF] osd.1 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683436+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683514+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683729+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.683846+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.684041+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.684126+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.684279+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.884322+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.884603+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.885489+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.886086+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.886708+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.887018+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.887716+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.888120+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.888780+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.889311+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.889840+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.890397+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.890803+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:03.891462+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.285115+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.285375+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:13:05.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.286181+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.287048+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.287381+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:13:05.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.287965+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.288425+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.289080+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.289617+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:13:05.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.290058+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:05.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.290195+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:13:05.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.290317+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:13:05.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.290555+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:13:05.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:04 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.290637+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:13:06.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.104684+0000 mgr.gibba009.xiladd (mgr.34457) 131 : cluster [DBG] pgmap v51: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:06.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.675272+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:06.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[30897]: cluster 2021-03-10T20:13:04.693959+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T20:13:06.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.104684+0000 mgr.gibba009.xiladd (mgr.34457) 131 : cluster [DBG] pgmap v51: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:06.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.675272+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:06.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:05 gibba004 bash[31878]: cluster 2021-03-10T20:13:04.693959+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T20:13:06.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:05 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.104684+0000 mgr.gibba009.xiladd (mgr.34457) 131 : cluster [DBG] pgmap v51: 129 pgs: 14 active+clean+wait, 115 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:06.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:05 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.675272+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:06.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:05 gibba009 bash[26136]: cluster 2021-03-10T20:13:04.693959+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2021-03-10T20:13:06.561 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:06 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T20:13:06.562 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:06 gibba004 systemd[1]: Stopped Ceph osd.1 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:06.562 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:06 gibba004 systemd[1]: Started Ceph osd.1 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[30897]: cluster 2021-03-10T20:13:05.698838+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:13:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[30897]: audit 2021-03-10T20:13:06.394594+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:07.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[30897]: audit 2021-03-10T20:13:06.396858+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:07.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[30897]: audit 2021-03-10T20:13:06.400200+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[31878]: cluster 2021-03-10T20:13:05.698838+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:13:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[31878]: audit 2021-03-10T20:13:06.394594+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:07.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[31878]: audit 2021-03-10T20:13:06.396858+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:07.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:06 gibba004 bash[31878]: audit 2021-03-10T20:13:06.400200+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:07.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:06 gibba009 bash[26136]: cluster 2021-03-10T20:13:05.698838+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:13:07.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:06 gibba009 bash[26136]: audit 2021-03-10T20:13:06.394594+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:07.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:06 gibba009 bash[26136]: audit 2021-03-10T20:13:06.396858+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:07.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:06 gibba009 bash[26136]: audit 2021-03-10T20:13:06.400200+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:08.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[30897]: cluster 2021-03-10T20:13:06.105909+0000 mgr.gibba009.xiladd (mgr.34457) 132 : cluster [DBG] pgmap v54: 129 pgs: 1 stale+active+clean, 51 peering, 14 active+clean+wait, 63 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[30897]: cephadm 2021-03-10T20:13:06.401298+0000 mgr.gibba009.xiladd (mgr.34457) 133 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:13:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[30897]: cluster 2021-03-10T20:13:06.695402+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:08.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[31878]: cluster 2021-03-10T20:13:06.105909+0000 mgr.gibba009.xiladd (mgr.34457) 132 : cluster [DBG] pgmap v54: 129 pgs: 1 stale+active+clean, 51 peering, 14 active+clean+wait, 63 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[31878]: cephadm 2021-03-10T20:13:06.401298+0000 mgr.gibba009.xiladd (mgr.34457) 133 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:13:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[31878]: cluster 2021-03-10T20:13:06.695402+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:08.064 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:13:08.064 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T20:13:08.065 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:13:08.065 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:13:08.065 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:13:08.065 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:13:08.066 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:07 gibba004 bash[34800]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T20:13:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:07 gibba009 bash[26136]: cluster 2021-03-10T20:13:06.105909+0000 mgr.gibba009.xiladd (mgr.34457) 132 : cluster [DBG] pgmap v54: 129 pgs: 1 stale+active+clean, 51 peering, 14 active+clean+wait, 63 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:07 gibba009 bash[26136]: cephadm 2021-03-10T20:13:06.401298+0000 mgr.gibba009.xiladd (mgr.34457) 133 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:13:08.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:07 gibba009 bash[26136]: cluster 2021-03-10T20:13:06.695402+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:09.312 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:09 gibba004 bash[34970]: debug 2021-03-10T20:13:09.107+0000 7f9e43d4f700 1 -- 172.21.2.104:0/744879955 <== mon.0 v2:172.21.2.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd53fae4e0 con 0x55fd5402b400 2021-03-10T20:13:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:09 gibba004 bash[30897]: cluster 2021-03-10T20:13:08.107402+0000 mgr.gibba009.xiladd (mgr.34457) 134 : cluster [DBG] pgmap v55: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:10.063 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:09 gibba004 bash[34970]: debug 2021-03-10T20:13:09.667+0000 7f9e4b7e4080 -1 Falling back to public interface 2021-03-10T20:13:10.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:09 gibba004 bash[31878]: cluster 2021-03-10T20:13:08.107402+0000 mgr.gibba009.xiladd (mgr.34457) 134 : cluster [DBG] pgmap v55: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:10.073 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:09 gibba009 bash[26136]: cluster 2021-03-10T20:13:08.107402+0000 mgr.gibba009.xiladd (mgr.34457) 134 : cluster [DBG] pgmap v55: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:11.056 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.046949+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.051147+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.059816+0000 mgr.gibba009.xiladd (mgr.34457) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:11.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.060212+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:11.057 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.062630+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.062938+0000 mgr.gibba009.xiladd (mgr.34457) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:11.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.064930+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.065165+0000 mgr.gibba009.xiladd (mgr.34457) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:11.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.065353+0000 mgr.gibba009.xiladd (mgr.34457) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:11.058 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.067076+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.067513+0000 mgr.gibba009.xiladd (mgr.34457) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:11.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.067638+0000 mgr.gibba009.xiladd (mgr.34457) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:11.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.069746+0000 mgr.gibba009.xiladd (mgr.34457) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:11.059 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.072442+0000 mgr.gibba009.xiladd (mgr.34457) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:11.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.072723+0000 mgr.gibba009.xiladd (mgr.34457) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:11.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.073141+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: audit 2021-03-10T20:13:10.074667+0000 mgr.gibba009.xiladd (mgr.34457) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cephadm 2021-03-10T20:13:10.077064+0000 mgr.gibba009.xiladd (mgr.34457) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:11.060 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:11 gibba009 bash[26136]: cluster 2021-03-10T20:13:10.108588+0000 mgr.gibba009.xiladd (mgr.34457) 146 : cluster [DBG] pgmap v56: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:11.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.046949+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.051147+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.059816+0000 mgr.gibba009.xiladd (mgr.34457) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:11.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.060212+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:11.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.062630+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.062938+0000 mgr.gibba009.xiladd (mgr.34457) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.064930+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.065165+0000 mgr.gibba009.xiladd (mgr.34457) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.065353+0000 mgr.gibba009.xiladd (mgr.34457) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.067076+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.067513+0000 mgr.gibba009.xiladd (mgr.34457) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.067638+0000 mgr.gibba009.xiladd (mgr.34457) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.069746+0000 mgr.gibba009.xiladd (mgr.34457) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.072442+0000 mgr.gibba009.xiladd (mgr.34457) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:11.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.072723+0000 mgr.gibba009.xiladd (mgr.34457) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:11.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.073141+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: audit 2021-03-10T20:13:10.074667+0000 mgr.gibba009.xiladd (mgr.34457) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cephadm 2021-03-10T20:13:10.077064+0000 mgr.gibba009.xiladd (mgr.34457) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:11.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[30897]: cluster 2021-03-10T20:13:10.108588+0000 mgr.gibba009.xiladd (mgr.34457) 146 : cluster [DBG] pgmap v56: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:11.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.046949+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.051147+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:11.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.059816+0000 mgr.gibba009.xiladd (mgr.34457) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:11.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.060212+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:11.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.062630+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.062938+0000 mgr.gibba009.xiladd (mgr.34457) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:11.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.064930+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.065165+0000 mgr.gibba009.xiladd (mgr.34457) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:11.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.065353+0000 mgr.gibba009.xiladd (mgr.34457) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:11.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.067076+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:11.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.067513+0000 mgr.gibba009.xiladd (mgr.34457) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:11.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.067638+0000 mgr.gibba009.xiladd (mgr.34457) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:11.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.069746+0000 mgr.gibba009.xiladd (mgr.34457) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:11.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.072442+0000 mgr.gibba009.xiladd (mgr.34457) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:11.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.072723+0000 mgr.gibba009.xiladd (mgr.34457) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:11.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.073141+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: audit 2021-03-10T20:13:10.074667+0000 mgr.gibba009.xiladd (mgr.34457) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:11.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cephadm 2021-03-10T20:13:10.077064+0000 mgr.gibba009.xiladd (mgr.34457) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:11.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:11 gibba004 bash[31878]: cluster 2021-03-10T20:13:10.108588+0000 mgr.gibba009.xiladd (mgr.34457) 146 : cluster [DBG] pgmap v56: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:13:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[30897]: cluster 2021-03-10T20:13:12.163569+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 32/195 objects degraded (16.410%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:12.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[30897]: cluster 2021-03-10T20:13:12.163702+0000 mon.a (mon.0) 224 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T20:13:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[31878]: cluster 2021-03-10T20:13:12.163569+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 32/195 objects degraded (16.410%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[31878]: cluster 2021-03-10T20:13:12.163702+0000 mon.a (mon.0) 224 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T20:13:12.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:12 gibba009 bash[26136]: cluster 2021-03-10T20:13:12.163569+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 32/195 objects degraded (16.410%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:12.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:12 gibba009 bash[26136]: cluster 2021-03-10T20:13:12.163702+0000 mon.a (mon.0) 224 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T20:13:13.231 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[34970]: debug 2021-03-10T20:13:12.855+0000 7f9e4b7e4080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:13:13.232 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[34970]: debug 2021-03-10T20:13:12.855+0000 7f9e362a8700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:13:13.232 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:12 gibba004 bash[34970]: debug 2021-03-10T20:13:12.983+0000 7f9e4b7e4080 -1 osd.1 71 log_to_monitors {default=true} 2021-03-10T20:13:13.562 INFO:journalctl@ceph.osd.1.gibba004.stdout:Mar 10 20:13:13 gibba004 bash[34970]: debug 2021-03-10T20:13:13.231+0000 7f9e3bcc2700 -1 osd.1 71 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:13:13.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:13 gibba004 bash[30897]: cluster 2021-03-10T20:13:12.110960+0000 mgr.gibba009.xiladd (mgr.34457) 147 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 12 MiB used, 665 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:13.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:13 gibba004 bash[30897]: audit 2021-03-10T20:13:12.989970+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:13:13.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:13 gibba004 bash[31878]: cluster 2021-03-10T20:13:12.110960+0000 mgr.gibba009.xiladd (mgr.34457) 147 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 12 MiB used, 665 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:13.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:13 gibba004 bash[31878]: audit 2021-03-10T20:13:12.989970+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:13:13.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:13 gibba009 bash[26136]: cluster 2021-03-10T20:13:12.110960+0000 mgr.gibba009.xiladd (mgr.34457) 147 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 12 MiB used, 665 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:13.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:13 gibba009 bash[26136]: audit 2021-03-10T20:13:12.989970+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:13:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[30897]: audit 2021-03-10T20:13:13.229473+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:13:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[30897]: cluster 2021-03-10T20:13:13.229649+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:13:14.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[30897]: audit 2021-03-10T20:13:13.230346+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[31878]: audit 2021-03-10T20:13:13.229473+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:13:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[31878]: cluster 2021-03-10T20:13:13.229649+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:13:14.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:14 gibba004 bash[31878]: audit 2021-03-10T20:13:13.230346+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:14.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:14 gibba009 bash[26136]: audit 2021-03-10T20:13:13.229473+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:13:14.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:14 gibba009 bash[26136]: cluster 2021-03-10T20:13:13.229649+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:13:14.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:14 gibba009 bash[26136]: audit 2021-03-10T20:13:13.230346+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:15.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[30897]: cluster 2021-03-10T20:13:14.112395+0000 mgr.gibba009.xiladd (mgr.34457) 148 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[30897]: cluster 2021-03-10T20:13:14.233752+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[30897]: cluster 2021-03-10T20:13:14.243912+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248] boot 2021-03-10T20:13:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[30897]: cluster 2021-03-10T20:13:14.243950+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T20:13:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[30897]: audit 2021-03-10T20:13:14.244345+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:13:15.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[31878]: cluster 2021-03-10T20:13:14.112395+0000 mgr.gibba009.xiladd (mgr.34457) 148 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:15.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[31878]: cluster 2021-03-10T20:13:14.233752+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:15.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[31878]: cluster 2021-03-10T20:13:14.243912+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248] boot 2021-03-10T20:13:15.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[31878]: cluster 2021-03-10T20:13:14.243950+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T20:13:15.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:15 gibba004 bash[31878]: audit 2021-03-10T20:13:14.244345+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:13:15.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:15 gibba009 bash[26136]: cluster 2021-03-10T20:13:14.112395+0000 mgr.gibba009.xiladd (mgr.34457) 148 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 32/195 objects degraded (16.410%) 2021-03-10T20:13:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:15 gibba009 bash[26136]: cluster 2021-03-10T20:13:14.233752+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:15 gibba009 bash[26136]: cluster 2021-03-10T20:13:14.243912+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.104:6808/3995962248,v1:172.21.2.104:6809/3995962248] boot 2021-03-10T20:13:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:15 gibba009 bash[26136]: cluster 2021-03-10T20:13:14.243950+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-03-10T20:13:15.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:15 gibba009 bash[26136]: audit 2021-03-10T20:13:14.244345+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:13:16.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:16 gibba004 bash[30897]: cluster 2021-03-10T20:13:15.248284+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:13:16.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:16 gibba004 bash[31878]: cluster 2021-03-10T20:13:15.248284+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:13:16.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:16 gibba009 bash[26136]: cluster 2021-03-10T20:13:15.248284+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:13:17.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:17 gibba004 bash[30897]: cluster 2021-03-10T20:13:16.114444+0000 mgr.gibba009.xiladd (mgr.34457) 149 : cluster [DBG] pgmap v62: 129 pgs: 6 active+undersized+degraded, 16 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:17.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:17 gibba004 bash[31878]: cluster 2021-03-10T20:13:16.114444+0000 mgr.gibba009.xiladd (mgr.34457) 149 : cluster [DBG] pgmap v62: 129 pgs: 6 active+undersized+degraded, 16 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:17.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:17 gibba009 bash[26136]: cluster 2021-03-10T20:13:16.114444+0000 mgr.gibba009.xiladd (mgr.34457) 149 : cluster [DBG] pgmap v62: 129 pgs: 6 active+undersized+degraded, 16 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:19.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:19 gibba004 bash[30897]: cluster 2021-03-10T20:13:18.115899+0000 mgr.gibba009.xiladd (mgr.34457) 150 : cluster [DBG] pgmap v63: 129 pgs: 6 active+undersized+degraded, 12 active+undersized, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:19.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:19 gibba004 bash[30897]: cluster 2021-03-10T20:13:18.450016+0000 mon.a (mon.0) 233 : cluster [WRN] Health check update: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:19.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:19 gibba004 bash[31878]: cluster 2021-03-10T20:13:18.115899+0000 mgr.gibba009.xiladd (mgr.34457) 150 : cluster [DBG] pgmap v63: 129 pgs: 6 active+undersized+degraded, 12 active+undersized, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:19.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:19 gibba004 bash[31878]: cluster 2021-03-10T20:13:18.450016+0000 mon.a (mon.0) 233 : cluster [WRN] Health check update: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:19.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:19 gibba009 bash[26136]: cluster 2021-03-10T20:13:18.115899+0000 mgr.gibba009.xiladd (mgr.34457) 150 : cluster [DBG] pgmap v63: 129 pgs: 6 active+undersized+degraded, 12 active+undersized, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:13:19.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:19 gibba009 bash[26136]: cluster 2021-03-10T20:13:18.450016+0000 mon.a (mon.0) 233 : cluster [WRN] Health check update: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:20.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:20 gibba009 bash[26136]: cluster 2021-03-10T20:13:20.276348+0000 mon.a (mon.0) 234 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded) 2021-03-10T20:13:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:20 gibba004 bash[30897]: cluster 2021-03-10T20:13:20.276348+0000 mon.a (mon.0) 234 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded) 2021-03-10T20:13:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:20 gibba004 bash[31878]: cluster 2021-03-10T20:13:20.276348+0000 mon.a (mon.0) 234 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/195 objects degraded (5.128%), 6 pgs degraded) 2021-03-10T20:13:21.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:21 gibba004 bash[30897]: cluster 2021-03-10T20:13:20.117299+0000 mgr.gibba009.xiladd (mgr.34457) 151 : cluster [DBG] pgmap v64: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:21.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:21 gibba004 bash[31878]: cluster 2021-03-10T20:13:20.117299+0000 mgr.gibba009.xiladd (mgr.34457) 151 : cluster [DBG] pgmap v64: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:21.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:21 gibba009 bash[26136]: cluster 2021-03-10T20:13:20.117299+0000 mgr.gibba009.xiladd (mgr.34457) 151 : cluster [DBG] pgmap v64: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:23.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:23 gibba004 bash[30897]: cluster 2021-03-10T20:13:22.119299+0000 mgr.gibba009.xiladd (mgr.34457) 152 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:23.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:23 gibba004 bash[31878]: cluster 2021-03-10T20:13:22.119299+0000 mgr.gibba009.xiladd (mgr.34457) 152 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:23.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:23 gibba009 bash[26136]: cluster 2021-03-10T20:13:22.119299+0000 mgr.gibba009.xiladd (mgr.34457) 152 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[30897]: cluster 2021-03-10T20:13:24.120889+0000 mgr.gibba009.xiladd (mgr.34457) 153 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[30897]: audit 2021-03-10T20:13:24.595101+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[30897]: audit 2021-03-10T20:13:25.092704+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[31878]: cluster 2021-03-10T20:13:24.120889+0000 mgr.gibba009.xiladd (mgr.34457) 153 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[31878]: audit 2021-03-10T20:13:24.595101+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:25 gibba004 bash[31878]: audit 2021-03-10T20:13:25.092704+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:26.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:25 gibba009 bash[26136]: cluster 2021-03-10T20:13:24.120889+0000 mgr.gibba009.xiladd (mgr.34457) 153 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:26.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:25 gibba009 bash[26136]: audit 2021-03-10T20:13:24.595101+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:26.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:25 gibba009 bash[26136]: audit 2021-03-10T20:13:25.092704+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:26 gibba004 bash[30897]: audit 2021-03-10T20:13:25.094569+0000 mgr.gibba009.xiladd (mgr.34457) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:26 gibba004 bash[30897]: cephadm 2021-03-10T20:13:25.099726+0000 mgr.gibba009.xiladd (mgr.34457) 155 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:13:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:26 gibba004 bash[31878]: audit 2021-03-10T20:13:25.094569+0000 mgr.gibba009.xiladd (mgr.34457) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:26 gibba004 bash[31878]: cephadm 2021-03-10T20:13:25.099726+0000 mgr.gibba009.xiladd (mgr.34457) 155 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:13:27.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:26 gibba009 bash[26136]: audit 2021-03-10T20:13:25.094569+0000 mgr.gibba009.xiladd (mgr.34457) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:13:27.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:26 gibba009 bash[26136]: cephadm 2021-03-10T20:13:25.099726+0000 mgr.gibba009.xiladd (mgr.34457) 155 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:13:27.994 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[30897]: cluster 2021-03-10T20:13:26.122544+0000 mgr.gibba009.xiladd (mgr.34457) 156 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:27.995 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[30897]: audit 2021-03-10T20:13:27.054114+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:27.995 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[30897]: audit 2021-03-10T20:13:27.059348+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:13:27.996 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[31878]: cluster 2021-03-10T20:13:26.122544+0000 mgr.gibba009.xiladd (mgr.34457) 156 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:27.996 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[31878]: audit 2021-03-10T20:13:27.054114+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:27.996 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:27 gibba004 bash[31878]: audit 2021-03-10T20:13:27.059348+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:13:28.056 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:13:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:27 gibba009 bash[26136]: cluster 2021-03-10T20:13:26.122544+0000 mgr.gibba009.xiladd (mgr.34457) 156 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:27 gibba009 bash[26136]: audit 2021-03-10T20:13:27.054114+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:28.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:27 gibba009 bash[26136]: audit 2021-03-10T20:13:27.059348+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:13:28.288 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:13:28.289 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (2m) 18s ago 7m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:13:28.289 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (7m) 83s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:13:28.289 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (2m) 83s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:13:28.290 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (3m) 83s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:13:28.290 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (2m) 18s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:13:28.290 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (115s) 18s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:13:28.290 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (88s) 83s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:13:28.291 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (98s) 18s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:13:28.291 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (7m) 18s ago 7m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:13:28.291 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (7m) 83s ago 7m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:13:28.292 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (45s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:13:28.292 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (20s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:13:28.292 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (10m) 18s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc3e2c708535 2021-03-10T20:13:28.292 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (9m) 18s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a483b521ef87 2021-03-10T20:13:28.293 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (9m) 83s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:13:28.293 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (9m) 83s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:13:28.293 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (8m) 83s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:13:28.293 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (8m) 83s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:13:28.293 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (7m) 83s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:13:28.294 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 18s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:28.294 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 83s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:28.543 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:13:28.543 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:13:28.544 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:28.544 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:28.544 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:13:28.544 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:28.544 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:28.545 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:13:28.545 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T20:13:28.545 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:13:28.545 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:28.546 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:13:28.546 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:13:28.546 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T20:13:28.546 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:13:28.546 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:13:28.547 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:13:28.892 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[30897]: cephadm 2021-03-10T20:13:27.049802+0000 mgr.gibba009.xiladd (mgr.34457) 157 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:13:28.892 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[30897]: cephadm 2021-03-10T20:13:27.059711+0000 mgr.gibba009.xiladd (mgr.34457) 158 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:13:28.893 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[30897]: audit 2021-03-10T20:13:28.543526+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.104:0/113922460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:28.893 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:28 gibba004 systemd[1]: Stopping Ceph osd.2 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:13:28.893 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[31878]: cephadm 2021-03-10T20:13:27.049802+0000 mgr.gibba009.xiladd (mgr.34457) 157 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:13:28.894 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[31878]: cephadm 2021-03-10T20:13:27.059711+0000 mgr.gibba009.xiladd (mgr.34457) 158 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:13:28.894 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[31878]: audit 2021-03-10T20:13:28.543526+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.104:0/113922460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:29.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:28 gibba009 bash[26136]: cephadm 2021-03-10T20:13:27.049802+0000 mgr.gibba009.xiladd (mgr.34457) 157 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:13:29.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:28 gibba009 bash[26136]: cephadm 2021-03-10T20:13:27.059711+0000 mgr.gibba009.xiladd (mgr.34457) 158 : cephadm [INF] Deploying daemon osd.2 on gibba004 2021-03-10T20:13:29.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:28 gibba009 bash[26136]: audit 2021-03-10T20:13:28.543526+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.104:0/113922460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:29.143 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[17904]: debug 2021-03-10T20:13:28.887+0000 7f36de5be700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:13:29.143 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[17904]: debug 2021-03-10T20:13:28.887+0000 7f36de5be700 -1 osd.2 76 *** Got signal Terminated *** 2021-03-10T20:13:29.144 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:28 gibba004 bash[17904]: debug 2021-03-10T20:13:28.887+0000 7f36de5be700 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:13:30.062 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:29 gibba004 docker[35886]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.2 2021-03-10T20:13:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: audit 2021-03-10T20:13:28.047583+0000 mgr.gibba009.xiladd (mgr.34457) 159 : audit [DBG] from='client.44187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.123759+0000 mgr.gibba009.xiladd (mgr.34457) 160 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: audit 2021-03-10T20:13:28.277859+0000 mgr.gibba009.xiladd (mgr.34457) 161 : audit [DBG] from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.996624+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.996653+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.996794+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.996877+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.996972+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.997059+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.997151+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.997238+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:28.997299+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.197474+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.197894+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.198436+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.198727+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.199151+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.199330+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.199829+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.200106+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.200593+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.200866+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.201362+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.201674+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: audit 2021-03-10T20:13:28.047583+0000 mgr.gibba009.xiladd (mgr.34457) 159 : audit [DBG] from='client.44187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.123759+0000 mgr.gibba009.xiladd (mgr.34457) 160 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:30.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: audit 2021-03-10T20:13:28.277859+0000 mgr.gibba009.xiladd (mgr.34457) 161 : audit [DBG] from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.996624+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.996653+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:30.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.996794+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.996877+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.996972+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.997059+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.997151+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.997238+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:28.997299+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.197474+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.197894+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.198436+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.198727+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.199151+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.199330+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.199829+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.200106+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.200593+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.200866+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.201362+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.201674+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.202232+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.202531+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.488976+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.492108+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.596128+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.598572+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.598841+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.599291+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.599571+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.599993+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.600274+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.600740+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.601024+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.601457+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.601742+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.602314+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.602639+0000 mon.a (mon.0) 274 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.603156+0000 mon.a (mon.0) 275 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.202232+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.202531+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.488976+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.492108+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.596128+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.598572+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.598841+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.599291+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.599571+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.599993+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.600274+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.600740+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.601024+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.601457+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.082 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.601742+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.602314+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.602639+0000 mon.a (mon.0) 274 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:29 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.603156+0000 mon.a (mon.0) 275 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: audit 2021-03-10T20:13:28.047583+0000 mgr.gibba009.xiladd (mgr.34457) 159 : audit [DBG] from='client.44187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.123759+0000 mgr.gibba009.xiladd (mgr.34457) 160 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:30.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: audit 2021-03-10T20:13:28.277859+0000 mgr.gibba009.xiladd (mgr.34457) 161 : audit [DBG] from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:30.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.996624+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.996653+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba004) (connection refused reported by osd.4) 2021-03-10T20:13:30.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.996794+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.996877+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.996972+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.997059+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.997151+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.997238+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:28.997299+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.197474+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.197894+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.198436+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.198727+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.199151+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.199330+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.199829+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.200106+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.200593+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.200866+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.201362+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.201674+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.202232+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.202531+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.488976+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.492108+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.596128+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.598572+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.598841+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:13:30.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.599291+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.101 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.599571+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.101 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.599993+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:13:30.101 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.600274+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:13:30.101 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.600740+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.102 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.601024+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:13:30.102 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.601457+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:13:30.102 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.601742+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.102 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.602314+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:13:30.103 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.602639+0000 mon.a (mon.0) 274 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.103 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:29 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.603156+0000 mon.a (mon.0) 275 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:13:30.943 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:30 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.614442+0000 mon.a (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:30.943 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:30 gibba004 bash[30897]: cluster 2021-03-10T20:13:29.618981+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T20:13:30.944 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:30 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.614442+0000 mon.a (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:30.944 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:30 gibba004 bash[31878]: cluster 2021-03-10T20:13:29.618981+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T20:13:31.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:30 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.614442+0000 mon.a (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:31.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:30 gibba009 bash[26136]: cluster 2021-03-10T20:13:29.618981+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2021-03-10T20:13:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:31 gibba004 bash[30897]: cluster 2021-03-10T20:13:30.124713+0000 mgr.gibba009.xiladd (mgr.34457) 162 : cluster [DBG] pgmap v70: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:31 gibba004 bash[30897]: cluster 2021-03-10T20:13:30.628050+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:13:31.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:31 gibba004 bash[31878]: cluster 2021-03-10T20:13:30.124713+0000 mgr.gibba009.xiladd (mgr.34457) 162 : cluster [DBG] pgmap v70: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:31.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:31 gibba004 bash[31878]: cluster 2021-03-10T20:13:30.628050+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:13:31.813 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:31 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.2.service: Succeeded. 2021-03-10T20:13:31.813 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:31 gibba004 systemd[1]: Stopped Ceph osd.2 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:31.814 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:31 gibba004 systemd[1]: Started Ceph osd.2 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:32.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:31 gibba009 bash[26136]: cluster 2021-03-10T20:13:30.124713+0000 mgr.gibba009.xiladd (mgr.34457) 162 : cluster [DBG] pgmap v70: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:32.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:31 gibba009 bash[26136]: cluster 2021-03-10T20:13:30.628050+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:13:32.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[30897]: audit 2021-03-10T20:13:31.679206+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:32.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[30897]: audit 2021-03-10T20:13:31.680605+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:32.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[30897]: audit 2021-03-10T20:13:31.682927+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[31878]: audit 2021-03-10T20:13:31.679206+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[31878]: audit 2021-03-10T20:13:31.680605+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[31878]: audit 2021-03-10T20:13:31.682927+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:33.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:32 gibba009 bash[26136]: audit 2021-03-10T20:13:31.679206+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:33.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:32 gibba009 bash[26136]: audit 2021-03-10T20:13:31.680605+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:33.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:32 gibba009 bash[26136]: audit 2021-03-10T20:13:31.682927+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:33.312 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:13:33.312 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T20:13:33.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:13:33.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:13:33.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:13:33.313 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:13:33.314 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:32 gibba004 bash[36068]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T20:13:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:33 gibba004 bash[30897]: cluster 2021-03-10T20:13:32.125777+0000 mgr.gibba009.xiladd (mgr.34457) 163 : cluster [DBG] pgmap v72: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:33 gibba004 bash[30897]: cluster 2021-03-10T20:13:32.679114+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:34.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:33 gibba004 bash[31878]: cluster 2021-03-10T20:13:32.125777+0000 mgr.gibba009.xiladd (mgr.34457) 163 : cluster [DBG] pgmap v72: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:34.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:33 gibba004 bash[31878]: cluster 2021-03-10T20:13:32.679114+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:34.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:33 gibba009 bash[26136]: cluster 2021-03-10T20:13:32.125777+0000 mgr.gibba009.xiladd (mgr.34457) 163 : cluster [DBG] pgmap v72: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:13:34.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:33 gibba009 bash[26136]: cluster 2021-03-10T20:13:32.679114+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-03-10T20:13:34.811 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:34 gibba004 bash[30897]: cluster 2021-03-10T20:13:34.684991+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:34.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:34 gibba004 bash[31878]: cluster 2021-03-10T20:13:34.684991+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:34.813 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:34 gibba004 bash[36190]: debug 2021-03-10T20:13:34.595+0000 7f8170e99700 1 -- 172.21.2.104:0/3217630264 <== mon.0 v2:172.21.2.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557420eb44e0 con 0x557420f31000 2021-03-10T20:13:35.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:34 gibba009 bash[26136]: cluster 2021-03-10T20:13:34.684991+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:35.562 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[36190]: debug 2021-03-10T20:13:35.207+0000 7f817892e080 -1 Falling back to public interface 2021-03-10T20:13:35.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: cluster 2021-03-10T20:13:34.127442+0000 mgr.gibba009.xiladd (mgr.34457) 164 : cluster [DBG] pgmap v73: 129 pgs: 3 active+undersized+degraded, 21 peering, 8 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:35.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.512060+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:35.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.517889+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:35.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.523333+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:35.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.525195+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:35.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.526923+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:35.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.528624+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:35.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:35 gibba009 bash[26136]: audit 2021-03-10T20:13:35.532716+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: cluster 2021-03-10T20:13:34.127442+0000 mgr.gibba009.xiladd (mgr.34457) 164 : cluster [DBG] pgmap v73: 129 pgs: 3 active+undersized+degraded, 21 peering, 8 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.512060+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.517889+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.523333+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.525195+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.526923+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.528624+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[30897]: audit 2021-03-10T20:13:35.532716+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: cluster 2021-03-10T20:13:34.127442+0000 mgr.gibba009.xiladd (mgr.34457) 164 : cluster [DBG] pgmap v73: 129 pgs: 3 active+undersized+degraded, 21 peering, 8 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.512060+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.517889+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.523333+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.525195+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.526923+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.528624+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:36.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:35 gibba004 bash[31878]: audit 2021-03-10T20:13:35.532716+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.523626+0000 mgr.gibba009.xiladd (mgr.34457) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:37.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.525818+0000 mgr.gibba009.xiladd (mgr.34457) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:37.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.527481+0000 mgr.gibba009.xiladd (mgr.34457) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:37.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.527532+0000 mgr.gibba009.xiladd (mgr.34457) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:37.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.529277+0000 mgr.gibba009.xiladd (mgr.34457) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:37.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.529330+0000 mgr.gibba009.xiladd (mgr.34457) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:37.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.530833+0000 mgr.gibba009.xiladd (mgr.34457) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:37.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.533139+0000 mgr.gibba009.xiladd (mgr.34457) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:37.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.533196+0000 mgr.gibba009.xiladd (mgr.34457) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:37.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: audit 2021-03-10T20:13:35.534112+0000 mgr.gibba009.xiladd (mgr.34457) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:37.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[30897]: cephadm 2021-03-10T20:13:35.535536+0000 mgr.gibba009.xiladd (mgr.34457) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:37.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.523626+0000 mgr.gibba009.xiladd (mgr.34457) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:37.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.525818+0000 mgr.gibba009.xiladd (mgr.34457) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:37.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.527481+0000 mgr.gibba009.xiladd (mgr.34457) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:37.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.527532+0000 mgr.gibba009.xiladd (mgr.34457) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:37.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.529277+0000 mgr.gibba009.xiladd (mgr.34457) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:37.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.529330+0000 mgr.gibba009.xiladd (mgr.34457) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:37.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.530833+0000 mgr.gibba009.xiladd (mgr.34457) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:37.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.533139+0000 mgr.gibba009.xiladd (mgr.34457) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:37.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.533196+0000 mgr.gibba009.xiladd (mgr.34457) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:37.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: audit 2021-03-10T20:13:35.534112+0000 mgr.gibba009.xiladd (mgr.34457) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:37.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:36 gibba004 bash[31878]: cephadm 2021-03-10T20:13:35.535536+0000 mgr.gibba009.xiladd (mgr.34457) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:37.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.523626+0000 mgr.gibba009.xiladd (mgr.34457) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:37.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.525818+0000 mgr.gibba009.xiladd (mgr.34457) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:37.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.527481+0000 mgr.gibba009.xiladd (mgr.34457) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:37.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.527532+0000 mgr.gibba009.xiladd (mgr.34457) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:37.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.529277+0000 mgr.gibba009.xiladd (mgr.34457) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.529330+0000 mgr.gibba009.xiladd (mgr.34457) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.530833+0000 mgr.gibba009.xiladd (mgr.34457) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.533139+0000 mgr.gibba009.xiladd (mgr.34457) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:37.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.533196+0000 mgr.gibba009.xiladd (mgr.34457) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:37.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: audit 2021-03-10T20:13:35.534112+0000 mgr.gibba009.xiladd (mgr.34457) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:37.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:36 gibba009 bash[26136]: cephadm 2021-03-10T20:13:35.535536+0000 mgr.gibba009.xiladd (mgr.34457) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:13:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:37 gibba004 bash[30897]: cluster 2021-03-10T20:13:36.129557+0000 mgr.gibba009.xiladd (mgr.34457) 176 : cluster [DBG] pgmap v74: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:37 gibba004 bash[30897]: cluster 2021-03-10T20:13:36.742101+0000 mon.a (mon.0) 284 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2021-03-10T20:13:38.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:37 gibba004 bash[31878]: cluster 2021-03-10T20:13:36.129557+0000 mgr.gibba009.xiladd (mgr.34457) 176 : cluster [DBG] pgmap v74: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:38.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:37 gibba004 bash[31878]: cluster 2021-03-10T20:13:36.742101+0000 mon.a (mon.0) 284 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2021-03-10T20:13:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:37 gibba009 bash[26136]: cluster 2021-03-10T20:13:36.129557+0000 mgr.gibba009.xiladd (mgr.34457) 176 : cluster [DBG] pgmap v74: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:37 gibba009 bash[26136]: cluster 2021-03-10T20:13:36.742101+0000 mon.a (mon.0) 284 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2021-03-10T20:13:38.812 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:38 gibba004 bash[36190]: debug 2021-03-10T20:13:38.439+0000 7f817892e080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:13:38.812 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:38 gibba004 bash[36190]: debug 2021-03-10T20:13:38.443+0000 7f8164bf5700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:13:38.812 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:38 gibba004 bash[36190]: debug 2021-03-10T20:13:38.567+0000 7f817892e080 -1 osd.2 76 log_to_monitors {default=true} 2021-03-10T20:13:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:39 gibba004 bash[30897]: cluster 2021-03-10T20:13:38.130952+0000 mgr.gibba009.xiladd (mgr.34457) 177 : cluster [DBG] pgmap v75: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:39.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:39 gibba004 bash[30897]: audit 2021-03-10T20:13:38.572886+0000 mon.a (mon.0) 285 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:13:39.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:39 gibba004 bash[31878]: cluster 2021-03-10T20:13:38.130952+0000 mgr.gibba009.xiladd (mgr.34457) 177 : cluster [DBG] pgmap v75: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:39.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:39 gibba004 bash[31878]: audit 2021-03-10T20:13:38.572886+0000 mon.a (mon.0) 285 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:13:39.814 INFO:journalctl@ceph.osd.2.gibba004.stdout:Mar 10 20:13:39 gibba004 bash[36190]: debug 2021-03-10T20:13:39.475+0000 7f816ae10700 -1 osd.2 76 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:13:39.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:39 gibba009 bash[26136]: cluster 2021-03-10T20:13:38.130952+0000 mgr.gibba009.xiladd (mgr.34457) 177 : cluster [DBG] pgmap v75: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:39.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:39 gibba009 bash[26136]: audit 2021-03-10T20:13:38.572886+0000 mon.a (mon.0) 285 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:13:40.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.474626+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:13:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: cluster 2021-03-10T20:13:39.474676+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:13:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.475099+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.576944+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.577258+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.583139+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[30897]: audit 2021-03-10T20:13:39.583413+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:40.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.474626+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:13:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: cluster 2021-03-10T20:13:39.474676+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:13:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.475099+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.576944+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.577258+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.583139+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:40 gibba004 bash[31878]: audit 2021-03-10T20:13:39.583413+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:40.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.474626+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:13:40.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: cluster 2021-03-10T20:13:39.474676+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:13:40.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.475099+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:13:40.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.576944+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.577258+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:40.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.583139+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:40.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:40 gibba009 bash[26136]: audit 2021-03-10T20:13:39.583413+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:41.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[30897]: cluster 2021-03-10T20:13:40.132046+0000 mgr.gibba009.xiladd (mgr.34457) 178 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:41.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[30897]: cluster 2021-03-10T20:13:40.474759+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[30897]: cluster 2021-03-10T20:13:40.485093+0000 mon.a (mon.0) 292 : cluster [INF] osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658] boot 2021-03-10T20:13:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[30897]: cluster 2021-03-10T20:13:40.485130+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T20:13:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[30897]: audit 2021-03-10T20:13:40.485525+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:13:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[31878]: cluster 2021-03-10T20:13:40.132046+0000 mgr.gibba009.xiladd (mgr.34457) 178 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[31878]: cluster 2021-03-10T20:13:40.474759+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[31878]: cluster 2021-03-10T20:13:40.485093+0000 mon.a (mon.0) 292 : cluster [INF] osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658] boot 2021-03-10T20:13:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[31878]: cluster 2021-03-10T20:13:40.485130+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T20:13:41.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:41 gibba004 bash[31878]: audit 2021-03-10T20:13:40.485525+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:13:41.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:41 gibba009 bash[26136]: cluster 2021-03-10T20:13:40.132046+0000 mgr.gibba009.xiladd (mgr.34457) 178 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:41.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:41 gibba009 bash[26136]: cluster 2021-03-10T20:13:40.474759+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:41.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:41 gibba009 bash[26136]: cluster 2021-03-10T20:13:40.485093+0000 mon.a (mon.0) 292 : cluster [INF] osd.2 [v2:172.21.2.104:6816/2224144658,v1:172.21.2.104:6817/2224144658] boot 2021-03-10T20:13:41.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:41 gibba009 bash[26136]: cluster 2021-03-10T20:13:40.485130+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-03-10T20:13:41.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:41 gibba009 bash[26136]: audit 2021-03-10T20:13:40.485525+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:13:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:42 gibba004 bash[30897]: cluster 2021-03-10T20:13:41.489208+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:13:42.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:42 gibba004 bash[31878]: cluster 2021-03-10T20:13:41.489208+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:13:42.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:42 gibba009 bash[26136]: cluster 2021-03-10T20:13:41.489208+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:13:43.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:43 gibba004 bash[30897]: cluster 2021-03-10T20:13:42.133422+0000 mgr.gibba009.xiladd (mgr.34457) 179 : cluster [DBG] pgmap v80: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:43.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:43 gibba004 bash[30897]: cluster 2021-03-10T20:13:43.459157+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:43.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:43 gibba004 bash[31878]: cluster 2021-03-10T20:13:42.133422+0000 mgr.gibba009.xiladd (mgr.34457) 179 : cluster [DBG] pgmap v80: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:43.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:43 gibba004 bash[31878]: cluster 2021-03-10T20:13:43.459157+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:43.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:43 gibba009 bash[26136]: cluster 2021-03-10T20:13:42.133422+0000 mgr.gibba009.xiladd (mgr.34457) 179 : cluster [DBG] pgmap v80: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:43.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:43 gibba009 bash[26136]: cluster 2021-03-10T20:13:43.459157+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:45.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:45 gibba004 bash[30897]: cluster 2021-03-10T20:13:44.135209+0000 mgr.gibba009.xiladd (mgr.34457) 180 : cluster [DBG] pgmap v81: 129 pgs: 5 active+undersized+degraded, 20 active+undersized, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:13:45.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:45 gibba004 bash[31878]: cluster 2021-03-10T20:13:44.135209+0000 mgr.gibba009.xiladd (mgr.34457) 180 : cluster [DBG] pgmap v81: 129 pgs: 5 active+undersized+degraded, 20 active+undersized, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:13:45.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:45 gibba009 bash[26136]: cluster 2021-03-10T20:13:44.135209+0000 mgr.gibba009.xiladd (mgr.34457) 180 : cluster [DBG] pgmap v81: 129 pgs: 5 active+undersized+degraded, 20 active+undersized, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:13:46.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:46 gibba009 bash[26136]: cluster 2021-03-10T20:13:46.514583+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T20:13:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:46 gibba004 bash[30897]: cluster 2021-03-10T20:13:46.514583+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T20:13:47.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:46 gibba004 bash[31878]: cluster 2021-03-10T20:13:46.514583+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded) 2021-03-10T20:13:47.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:47 gibba009 bash[26136]: cluster 2021-03-10T20:13:46.137316+0000 mgr.gibba009.xiladd (mgr.34457) 181 : cluster [DBG] pgmap v82: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:47 gibba004 bash[30897]: cluster 2021-03-10T20:13:46.137316+0000 mgr.gibba009.xiladd (mgr.34457) 181 : cluster [DBG] pgmap v82: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:48.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:47 gibba004 bash[31878]: cluster 2021-03-10T20:13:46.137316+0000 mgr.gibba009.xiladd (mgr.34457) 181 : cluster [DBG] pgmap v82: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:49.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:49 gibba009 bash[26136]: cluster 2021-03-10T20:13:48.138580+0000 mgr.gibba009.xiladd (mgr.34457) 182 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:49 gibba004 bash[30897]: cluster 2021-03-10T20:13:48.138580+0000 mgr.gibba009.xiladd (mgr.34457) 182 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:49 gibba004 bash[31878]: cluster 2021-03-10T20:13:48.138580+0000 mgr.gibba009.xiladd (mgr.34457) 182 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:51.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:50 gibba004 bash[30897]: audit 2021-03-10T20:13:49.602809+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:51.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:50 gibba004 bash[30897]: audit 2021-03-10T20:13:50.551011+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:51.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:50 gibba004 bash[31878]: audit 2021-03-10T20:13:49.602809+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:51.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:50 gibba004 bash[31878]: audit 2021-03-10T20:13:50.551011+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:51.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:50 gibba009 bash[26136]: audit 2021-03-10T20:13:49.602809+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:51.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:50 gibba009 bash[26136]: audit 2021-03-10T20:13:50.551011+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:51.951 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[30897]: cluster 2021-03-10T20:13:50.139355+0000 mgr.gibba009.xiladd (mgr.34457) 183 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:51.952 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[30897]: audit 2021-03-10T20:13:50.553094+0000 mgr.gibba009.xiladd (mgr.34457) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:51.952 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[30897]: cephadm 2021-03-10T20:13:50.557795+0000 mgr.gibba009.xiladd (mgr.34457) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:13:51.952 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[31878]: cluster 2021-03-10T20:13:50.139355+0000 mgr.gibba009.xiladd (mgr.34457) 183 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:51.953 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[31878]: audit 2021-03-10T20:13:50.553094+0000 mgr.gibba009.xiladd (mgr.34457) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:51.953 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:51 gibba004 bash[31878]: cephadm 2021-03-10T20:13:50.557795+0000 mgr.gibba009.xiladd (mgr.34457) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:13:52.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:51 gibba009 bash[26136]: cluster 2021-03-10T20:13:50.139355+0000 mgr.gibba009.xiladd (mgr.34457) 183 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:52.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:51 gibba009 bash[26136]: audit 2021-03-10T20:13:50.553094+0000 mgr.gibba009.xiladd (mgr.34457) 184 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:13:52.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:51 gibba009 bash[26136]: cephadm 2021-03-10T20:13:50.557795+0000 mgr.gibba009.xiladd (mgr.34457) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:13:53.685 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[30897]: cluster 2021-03-10T20:13:52.141256+0000 mgr.gibba009.xiladd (mgr.34457) 186 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:53.685 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[30897]: cephadm 2021-03-10T20:13:52.420620+0000 mgr.gibba009.xiladd (mgr.34457) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:13:53.685 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[30897]: audit 2021-03-10T20:13:52.425319+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:53.686 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[30897]: audit 2021-03-10T20:13:52.430753+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:13:53.686 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[30897]: cephadm 2021-03-10T20:13:52.430911+0000 mgr.gibba009.xiladd (mgr.34457) 188 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:13:53.686 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[31878]: cluster 2021-03-10T20:13:52.141256+0000 mgr.gibba009.xiladd (mgr.34457) 186 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:53.687 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[31878]: cephadm 2021-03-10T20:13:52.420620+0000 mgr.gibba009.xiladd (mgr.34457) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:13:53.687 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[31878]: audit 2021-03-10T20:13:52.425319+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:53.687 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[31878]: audit 2021-03-10T20:13:52.430753+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:13:53.687 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:53 gibba004 bash[31878]: cephadm 2021-03-10T20:13:52.430911+0000 mgr.gibba009.xiladd (mgr.34457) 188 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:13:53.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:53 gibba009 bash[26136]: cluster 2021-03-10T20:13:52.141256+0000 mgr.gibba009.xiladd (mgr.34457) 186 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:53.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:53 gibba009 bash[26136]: cephadm 2021-03-10T20:13:52.420620+0000 mgr.gibba009.xiladd (mgr.34457) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:13:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:53 gibba009 bash[26136]: audit 2021-03-10T20:13:52.425319+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:53 gibba009 bash[26136]: audit 2021-03-10T20:13:52.430753+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:13:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:53 gibba009 bash[26136]: cephadm 2021-03-10T20:13:52.430911+0000 mgr.gibba009.xiladd (mgr.34457) 188 : cephadm [INF] Deploying daemon osd.3 on gibba004 2021-03-10T20:13:54.561 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:54 gibba004 systemd[1]: Stopping Ceph osd.3 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:13:54.561 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:54 gibba004 bash[19295]: debug 2021-03-10T20:13:54.407+0000 7fbfac7bd700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:13:54.562 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:54 gibba004 bash[19295]: debug 2021-03-10T20:13:54.407+0000 7fbfac7bd700 -1 osd.3 81 *** Got signal Terminated *** 2021-03-10T20:13:54.562 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:54 gibba004 bash[19295]: debug 2021-03-10T20:13:54.407+0000 7fbfac7bd700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:13:55.475 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:55 gibba004 docker[37032]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.3 2021-03-10T20:13:55.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.141763+0000 mgr.gibba009.xiladd (mgr.34457) 189 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:55.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.701878+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.701984+0000 mon.a (mon.0) 300 : cluster [INF] osd.3 failed (root=default,host=gibba004) (connection refused reported by osd.1) 2021-03-10T20:13:55.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.702637+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.702815+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.703186+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.703347+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.703841+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.704118+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.704558+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.704847+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.705365+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.705638+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.706143+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.706484+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:54.706995+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.101207+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.101591+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.101755+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.102145+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.102388+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.102886+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.103307+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.103671+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.104231+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.141763+0000 mgr.gibba009.xiladd (mgr.34457) 189 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:55.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.701878+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.701984+0000 mon.a (mon.0) 300 : cluster [INF] osd.3 failed (root=default,host=gibba004) (connection refused reported by osd.1) 2021-03-10T20:13:55.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.702637+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.702815+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.703186+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.703347+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.703841+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.704118+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.704558+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.704847+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.705365+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.705638+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.706143+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.706484+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:54.706995+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.101207+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.101591+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.101755+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.102145+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.102388+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.102886+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.103307+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.103671+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.104231+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.104544+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.105075+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.105544+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.105814+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.577 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.106110+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.257144+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.258003+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.259369+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.578 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.458537+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.104544+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.105075+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.105544+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.105814+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.106110+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.257144+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.258003+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.259369+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.581 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:55 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.458537+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.141763+0000 mgr.gibba009.xiladd (mgr.34457) 189 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.701878+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.701984+0000 mon.a (mon.0) 300 : cluster [INF] osd.3 failed (root=default,host=gibba004) (connection refused reported by osd.1) 2021-03-10T20:13:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.702637+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.702815+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.703186+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.703347+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.703841+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.704118+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.704558+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.704847+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.705365+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.705638+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.706143+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.706484+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:54.706995+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.101207+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.101591+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.101755+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.102145+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.102388+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:13:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.102886+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.103307+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.103671+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.104231+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.104544+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.105075+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:13:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.105544+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:13:55.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.105814+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.106110+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:13:55.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.257144+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:13:55.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.258003+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:55.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.259369+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:13:55.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:55 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.458537+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:13:56.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:56 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.472669+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:56 gibba004 bash[30897]: cluster 2021-03-10T20:13:55.485044+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T20:13:56.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:56 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.472669+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:56 gibba004 bash[31878]: cluster 2021-03-10T20:13:55.485044+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T20:13:56.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:56 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.472669+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:56.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:56 gibba009 bash[26136]: cluster 2021-03-10T20:13:55.485044+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2021-03-10T20:13:57.487 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:57 gibba004 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.3.service: Succeeded. 2021-03-10T20:13:57.487 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:57 gibba004 systemd[1]: Stopped Ceph osd.3 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:57.487 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:57 gibba004 systemd[1]: Started Ceph osd.3 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:13:57.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[31878]: cluster 2021-03-10T20:13:56.142840+0000 mgr.gibba009.xiladd (mgr.34457) 190 : cluster [DBG] pgmap v88: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:57.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[31878]: cluster 2021-03-10T20:13:56.487452+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:13:57.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[31878]: audit 2021-03-10T20:13:57.389682+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:57.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[31878]: audit 2021-03-10T20:13:57.391747+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:57.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[31878]: audit 2021-03-10T20:13:57.395541+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[30897]: cluster 2021-03-10T20:13:56.142840+0000 mgr.gibba009.xiladd (mgr.34457) 190 : cluster [DBG] pgmap v88: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[30897]: cluster 2021-03-10T20:13:56.487452+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:13:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[30897]: audit 2021-03-10T20:13:57.389682+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[30897]: audit 2021-03-10T20:13:57.391747+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:57 gibba004 bash[30897]: audit 2021-03-10T20:13:57.395541+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:57.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:57 gibba009 bash[26136]: cluster 2021-03-10T20:13:56.142840+0000 mgr.gibba009.xiladd (mgr.34457) 190 : cluster [DBG] pgmap v88: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:13:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:57 gibba009 bash[26136]: cluster 2021-03-10T20:13:56.487452+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:13:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:57 gibba009 bash[26136]: audit 2021-03-10T20:13:57.389682+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:13:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:57 gibba009 bash[26136]: audit 2021-03-10T20:13:57.391747+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:57 gibba009 bash[26136]: audit 2021-03-10T20:13:57.395541+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:58.793 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:13:59.021 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:13:59.021 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (2m) 23s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:13:59.022 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (8m) 114s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:13:59.022 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (3m) 114s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:13:59.022 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (3m) 114s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:13:59.022 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (2m) 23s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:13:59.023 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (2m) 23s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:13:59.023 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (119s) 114s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:13:59.023 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (2m) 23s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:13:59.023 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (8m) 23s ago 8m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:13:59.024 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (8m) 114s ago 8m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:13:59.024 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (76s) 23s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:13:59.024 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (50s) 23s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:13:59.024 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (25s) 23s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:13:59.025 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 starting - - 2021-03-10T20:13:59.025 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (9m) 114s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5f2948809dc4 2021-03-10T20:13:59.025 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (9m) 114s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:13:59.025 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (8m) 114s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:13:59.025 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (8m) 114s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:13:59.026 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (7m) 114s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:13:59.026 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 23s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:59.026 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 114s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:59.061 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:13:59.062 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T20:13:59.062 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:13:59.062 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:13:59.062 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:13:59.063 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:13:59.063 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:13:58 gibba004 bash[37209]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T20:13:59.276 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:13:59.276 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:13:59.276 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:59.277 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:59.277 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:13:59.277 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:59.277 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:59.278 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:13:59.278 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T20:13:59.278 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:59.278 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:13:59.279 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:13:59.279 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:13:59.279 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T20:13:59.279 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 9 2021-03-10T20:13:59.280 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:13:59.280 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:13:59.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[30897]: cluster 2021-03-10T20:13:58.144117+0000 mgr.gibba009.xiladd (mgr.34457) 191 : cluster [DBG] pgmap v90: 129 pgs: 16 stale+active+clean, 6 active+undersized+degraded, 10 active+clean+wait, 4 active+undersized, 93 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:59.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[30897]: cluster 2021-03-10T20:13:58.487637+0000 mon.a (mon.0) 336 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:59.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[30897]: audit 2021-03-10T20:13:58.785462+0000 mgr.gibba009.xiladd (mgr.34457) 192 : audit [DBG] from='client.54190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:59.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[30897]: audit 2021-03-10T20:13:59.276664+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.2.104:0/1962028786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:59.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[31878]: cluster 2021-03-10T20:13:58.144117+0000 mgr.gibba009.xiladd (mgr.34457) 191 : cluster [DBG] pgmap v90: 129 pgs: 16 stale+active+clean, 6 active+undersized+degraded, 10 active+clean+wait, 4 active+undersized, 93 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:59.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[31878]: cluster 2021-03-10T20:13:58.487637+0000 mon.a (mon.0) 336 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:59.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[31878]: audit 2021-03-10T20:13:58.785462+0000 mgr.gibba009.xiladd (mgr.34457) 192 : audit [DBG] from='client.54190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:59.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:13:59 gibba004 bash[31878]: audit 2021-03-10T20:13:59.276664+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.2.104:0/1962028786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:59.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:59 gibba009 bash[26136]: cluster 2021-03-10T20:13:58.144117+0000 mgr.gibba009.xiladd (mgr.34457) 191 : cluster [DBG] pgmap v90: 129 pgs: 16 stale+active+clean, 6 active+undersized+degraded, 10 active+clean+wait, 4 active+undersized, 93 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:13:59.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:59 gibba009 bash[26136]: cluster 2021-03-10T20:13:58.487637+0000 mon.a (mon.0) 336 : cluster [WRN] Health check failed: Degraded data redundancy: 7/195 objects degraded (3.590%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:59.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:59 gibba009 bash[26136]: audit 2021-03-10T20:13:58.785462+0000 mgr.gibba009.xiladd (mgr.34457) 192 : audit [DBG] from='client.54190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:59.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:13:59 gibba009 bash[26136]: audit 2021-03-10T20:13:59.276664+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.2.104:0/1962028786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:00.473 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:00 gibba004 bash[37412]: debug 2021-03-10T20:14:00.255+0000 7faa44f84700 1 -- 172.21.2.104:0/1975971413 <== mon.0 v2:172.21.2.104:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5611469464e0 con 0x5611469c3400 2021-03-10T20:14:00.811 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:00 gibba004 bash[31878]: audit 2021-03-10T20:13:59.010600+0000 mgr.gibba009.xiladd (mgr.34457) 193 : audit [DBG] from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:00 gibba004 bash[30897]: audit 2021-03-10T20:13:59.010600+0000 mgr.gibba009.xiladd (mgr.34457) 193 : audit [DBG] from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:00.812 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:00 gibba004 bash[37412]: debug 2021-03-10T20:14:00.579+0000 7faa4ca19080 -1 Falling back to public interface 2021-03-10T20:14:00.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:00 gibba009 bash[26136]: audit 2021-03-10T20:13:59.010600+0000 mgr.gibba009.xiladd (mgr.34457) 193 : audit [DBG] from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: cluster 2021-03-10T20:14:00.145667+0000 mgr.gibba009.xiladd (mgr.34457) 194 : cluster [DBG] pgmap v91: 129 pgs: 9 stale+active+clean, 13 active+undersized+degraded, 15 active+undersized, 92 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T20:14:02.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:00.905572+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: cephadm 2021-03-10T20:14:00.907604+0000 mgr.gibba009.xiladd (mgr.34457) 195 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:14:02.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.122028+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.130770+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.132459+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.134261+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.135840+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[30897]: audit 2021-03-10T20:14:01.139306+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: cluster 2021-03-10T20:14:00.145667+0000 mgr.gibba009.xiladd (mgr.34457) 194 : cluster [DBG] pgmap v91: 129 pgs: 9 stale+active+clean, 13 active+undersized+degraded, 15 active+undersized, 92 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T20:14:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:00.905572+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: cephadm 2021-03-10T20:14:00.907604+0000 mgr.gibba009.xiladd (mgr.34457) 195 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:14:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.122028+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.130770+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.132459+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.134261+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.135840+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:01 gibba004 bash[31878]: audit 2021-03-10T20:14:01.139306+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: cluster 2021-03-10T20:14:00.145667+0000 mgr.gibba009.xiladd (mgr.34457) 194 : cluster [DBG] pgmap v91: 129 pgs: 9 stale+active+clean, 13 active+undersized+degraded, 15 active+undersized, 92 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 15/195 objects degraded (7.692%) 2021-03-10T20:14:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:00.905572+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: cephadm 2021-03-10T20:14:00.907604+0000 mgr.gibba009.xiladd (mgr.34457) 195 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:14:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.122028+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.130770+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.132459+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.134261+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.135840+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:01 gibba009 bash[26136]: audit 2021-03-10T20:14:01.139306+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:03.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.130864+0000 mgr.gibba009.xiladd (mgr.34457) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.133082+0000 mgr.gibba009.xiladd (mgr.34457) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.134821+0000 mgr.gibba009.xiladd (mgr.34457) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.134871+0000 mgr.gibba009.xiladd (mgr.34457) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.136487+0000 mgr.gibba009.xiladd (mgr.34457) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:03.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.136537+0000 mgr.gibba009.xiladd (mgr.34457) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:03.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.138137+0000 mgr.gibba009.xiladd (mgr.34457) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:03.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.139728+0000 mgr.gibba009.xiladd (mgr.34457) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:03.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.139779+0000 mgr.gibba009.xiladd (mgr.34457) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:03.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: audit 2021-03-10T20:14:01.140628+0000 mgr.gibba009.xiladd (mgr.34457) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:03.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[30897]: cephadm 2021-03-10T20:14:01.141937+0000 mgr.gibba009.xiladd (mgr.34457) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2021-03-10T20:14:03.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.130864+0000 mgr.gibba009.xiladd (mgr.34457) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:03.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.133082+0000 mgr.gibba009.xiladd (mgr.34457) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:03.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.134821+0000 mgr.gibba009.xiladd (mgr.34457) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:03.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.134871+0000 mgr.gibba009.xiladd (mgr.34457) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:03.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.136487+0000 mgr.gibba009.xiladd (mgr.34457) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:03.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.136537+0000 mgr.gibba009.xiladd (mgr.34457) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.138137+0000 mgr.gibba009.xiladd (mgr.34457) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.139728+0000 mgr.gibba009.xiladd (mgr.34457) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.139779+0000 mgr.gibba009.xiladd (mgr.34457) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: audit 2021-03-10T20:14:01.140628+0000 mgr.gibba009.xiladd (mgr.34457) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:03.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:02 gibba004 bash[31878]: cephadm 2021-03-10T20:14:01.141937+0000 mgr.gibba009.xiladd (mgr.34457) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2021-03-10T20:14:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.130864+0000 mgr.gibba009.xiladd (mgr.34457) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:03.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.133082+0000 mgr.gibba009.xiladd (mgr.34457) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:03.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.134821+0000 mgr.gibba009.xiladd (mgr.34457) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:03.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.134871+0000 mgr.gibba009.xiladd (mgr.34457) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:03.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.136487+0000 mgr.gibba009.xiladd (mgr.34457) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:03.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.136537+0000 mgr.gibba009.xiladd (mgr.34457) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:03.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.138137+0000 mgr.gibba009.xiladd (mgr.34457) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:03.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.139728+0000 mgr.gibba009.xiladd (mgr.34457) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:03.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.139779+0000 mgr.gibba009.xiladd (mgr.34457) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:03.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: audit 2021-03-10T20:14:01.140628+0000 mgr.gibba009.xiladd (mgr.34457) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:03.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:02 gibba009 bash[26136]: cephadm 2021-03-10T20:14:01.141937+0000 mgr.gibba009.xiladd (mgr.34457) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2021-03-10T20:14:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[30897]: cluster 2021-03-10T20:14:02.147692+0000 mgr.gibba009.xiladd (mgr.34457) 207 : cluster [DBG] pgmap v92: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[30897]: audit 2021-03-10T20:14:03.892580+0000 mon.c (mon.1) 112 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[30897]: audit 2021-03-10T20:14:03.892970+0000 mon.a (mon.0) 340 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[31878]: cluster 2021-03-10T20:14:02.147692+0000 mgr.gibba009.xiladd (mgr.34457) 207 : cluster [DBG] pgmap v92: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[31878]: audit 2021-03-10T20:14:03.892580+0000 mon.c (mon.1) 112 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[31878]: audit 2021-03-10T20:14:03.892970+0000 mon.a (mon.0) 340 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.064 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[37412]: debug 2021-03-10T20:14:03.755+0000 7faa4ca19080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:14:04.064 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[37412]: debug 2021-03-10T20:14:03.759+0000 7faa4ca19080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:14:04.064 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:03 gibba004 bash[37412]: debug 2021-03-10T20:14:03.883+0000 7faa4ca19080 -1 osd.3 81 log_to_monitors {default=true} 2021-03-10T20:14:04.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:03 gibba009 bash[26136]: cluster 2021-03-10T20:14:02.147692+0000 mgr.gibba009.xiladd (mgr.34457) 207 : cluster [DBG] pgmap v92: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:04.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:03 gibba009 bash[26136]: audit 2021-03-10T20:14:03.892580+0000 mon.c (mon.1) 112 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:03 gibba009 bash[26136]: audit 2021-03-10T20:14:03.892970+0000 mon.a (mon.0) 340 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:14:04.812 INFO:journalctl@ceph.osd.3.gibba004.stdout:Mar 10 20:14:04 gibba004 bash[37412]: debug 2021-03-10T20:14:04.483+0000 7faa3bef5700 -1 osd.3 81 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:14:05.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[30897]: cluster 2021-03-10T20:14:04.148317+0000 mgr.gibba009.xiladd (mgr.34457) 208 : cluster [DBG] pgmap v93: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[30897]: audit 2021-03-10T20:14:04.482077+0000 mon.a (mon.0) 341 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:14:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[30897]: cluster 2021-03-10T20:14:04.482129+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:14:05.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[30897]: audit 2021-03-10T20:14:04.482740+0000 mon.c (mon.1) 113 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:05.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[30897]: audit 2021-03-10T20:14:04.482986+0000 mon.a (mon.0) 343 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[31878]: cluster 2021-03-10T20:14:04.148317+0000 mgr.gibba009.xiladd (mgr.34457) 208 : cluster [DBG] pgmap v93: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[31878]: audit 2021-03-10T20:14:04.482077+0000 mon.a (mon.0) 341 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:14:05.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[31878]: cluster 2021-03-10T20:14:04.482129+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:14:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[31878]: audit 2021-03-10T20:14:04.482740+0000 mon.c (mon.1) 113 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:05.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:05 gibba004 bash[31878]: audit 2021-03-10T20:14:04.482986+0000 mon.a (mon.0) 343 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:05.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:05 gibba009 bash[26136]: cluster 2021-03-10T20:14:04.148317+0000 mgr.gibba009.xiladd (mgr.34457) 208 : cluster [DBG] pgmap v93: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:05.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:05 gibba009 bash[26136]: audit 2021-03-10T20:14:04.482077+0000 mon.a (mon.0) 341 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:14:05.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:05 gibba009 bash[26136]: cluster 2021-03-10T20:14:04.482129+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:14:05.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:05 gibba009 bash[26136]: audit 2021-03-10T20:14:04.482740+0000 mon.c (mon.1) 113 : audit [INF] from='osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:05.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:05 gibba009 bash[26136]: audit 2021-03-10T20:14:04.482986+0000 mon.a (mon.0) 343 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba004", "root=default"]}]: dispatch 2021-03-10T20:14:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[30897]: cluster 2021-03-10T20:14:05.476577+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[30897]: cluster 2021-03-10T20:14:05.486627+0000 mon.a (mon.0) 345 : cluster [INF] osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673] boot 2021-03-10T20:14:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[30897]: cluster 2021-03-10T20:14:05.486662+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T20:14:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[30897]: audit 2021-03-10T20:14:05.487425+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:14:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[30897]: cluster 2021-03-10T20:14:06.490740+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:14:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[31878]: cluster 2021-03-10T20:14:05.476577+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[31878]: cluster 2021-03-10T20:14:05.486627+0000 mon.a (mon.0) 345 : cluster [INF] osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673] boot 2021-03-10T20:14:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[31878]: cluster 2021-03-10T20:14:05.486662+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T20:14:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[31878]: audit 2021-03-10T20:14:05.487425+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:14:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:06 gibba004 bash[31878]: cluster 2021-03-10T20:14:06.490740+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:14:06.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:06 gibba009 bash[26136]: cluster 2021-03-10T20:14:05.476577+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:06.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:06 gibba009 bash[26136]: cluster 2021-03-10T20:14:05.486627+0000 mon.a (mon.0) 345 : cluster [INF] osd.3 [v2:172.21.2.104:6824/4082847673,v1:172.21.2.104:6825/4082847673] boot 2021-03-10T20:14:06.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:06 gibba009 bash[26136]: cluster 2021-03-10T20:14:05.486662+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-03-10T20:14:06.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:06 gibba009 bash[26136]: audit 2021-03-10T20:14:05.487425+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:14:06.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:06 gibba009 bash[26136]: cluster 2021-03-10T20:14:06.490740+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:14:07.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:07 gibba004 bash[30897]: cluster 2021-03-10T20:14:06.149753+0000 mgr.gibba009.xiladd (mgr.34457) 209 : cluster [DBG] pgmap v96: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:07.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:07 gibba004 bash[31878]: cluster 2021-03-10T20:14:06.149753+0000 mgr.gibba009.xiladd (mgr.34457) 209 : cluster [DBG] pgmap v96: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:07.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:07 gibba009 bash[26136]: cluster 2021-03-10T20:14:06.149753+0000 mgr.gibba009.xiladd (mgr.34457) 209 : cluster [DBG] pgmap v96: 129 pgs: 20 active+undersized+degraded, 30 active+undersized, 79 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 24/195 objects degraded (12.308%) 2021-03-10T20:14:08.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:08 gibba004 bash[30897]: cluster 2021-03-10T20:14:08.468296+0000 mon.a (mon.0) 348 : cluster [WRN] Health check update: Degraded data redundancy: 24/195 objects degraded (12.308%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:08.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:08 gibba004 bash[31878]: cluster 2021-03-10T20:14:08.468296+0000 mon.a (mon.0) 348 : cluster [WRN] Health check update: Degraded data redundancy: 24/195 objects degraded (12.308%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:08.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:08 gibba009 bash[26136]: cluster 2021-03-10T20:14:08.468296+0000 mon.a (mon.0) 348 : cluster [WRN] Health check update: Degraded data redundancy: 24/195 objects degraded (12.308%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:09.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:09 gibba004 bash[30897]: cluster 2021-03-10T20:14:08.151521+0000 mgr.gibba009.xiladd (mgr.34457) 210 : cluster [DBG] pgmap v98: 129 pgs: 17 active+undersized+degraded, 27 active+undersized, 85 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:14:09.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:09 gibba004 bash[31878]: cluster 2021-03-10T20:14:08.151521+0000 mgr.gibba009.xiladd (mgr.34457) 210 : cluster [DBG] pgmap v98: 129 pgs: 17 active+undersized+degraded, 27 active+undersized, 85 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:14:09.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:09 gibba009 bash[26136]: cluster 2021-03-10T20:14:08.151521+0000 mgr.gibba009.xiladd (mgr.34457) 210 : cluster [DBG] pgmap v98: 129 pgs: 17 active+undersized+degraded, 27 active+undersized, 85 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:14:11.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:11 gibba004 bash[30897]: cluster 2021-03-10T20:14:10.153333+0000 mgr.gibba009.xiladd (mgr.34457) 211 : cluster [DBG] pgmap v99: 129 pgs: 20 active+clean+wait, 5 active+undersized+degraded, 8 active+undersized, 96 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:14:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:11 gibba004 bash[31878]: cluster 2021-03-10T20:14:10.153333+0000 mgr.gibba009.xiladd (mgr.34457) 211 : cluster [DBG] pgmap v99: 129 pgs: 20 active+clean+wait, 5 active+undersized+degraded, 8 active+undersized, 96 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:14:11.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:11 gibba009 bash[26136]: cluster 2021-03-10T20:14:10.153333+0000 mgr.gibba009.xiladd (mgr.34457) 211 : cluster [DBG] pgmap v99: 129 pgs: 20 active+clean+wait, 5 active+undersized+degraded, 8 active+undersized, 96 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:14:12.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:12 gibba009 bash[26136]: cluster 2021-03-10T20:14:12.519938+0000 mon.a (mon.0) 349 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:14:13.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:12 gibba004 bash[31878]: cluster 2021-03-10T20:14:12.519938+0000 mon.a (mon.0) 349 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:14:13.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:12 gibba004 bash[30897]: cluster 2021-03-10T20:14:12.519938+0000 mon.a (mon.0) 349 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:14:13.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:13 gibba009 bash[26136]: cluster 2021-03-10T20:14:12.155178+0000 mgr.gibba009.xiladd (mgr.34457) 212 : cluster [DBG] pgmap v100: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:14.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:13 gibba004 bash[30897]: cluster 2021-03-10T20:14:12.155178+0000 mgr.gibba009.xiladd (mgr.34457) 212 : cluster [DBG] pgmap v100: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:14.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:13 gibba004 bash[31878]: cluster 2021-03-10T20:14:12.155178+0000 mgr.gibba009.xiladd (mgr.34457) 212 : cluster [DBG] pgmap v100: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:16.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:15 gibba004 bash[31878]: cluster 2021-03-10T20:14:14.155833+0000 mgr.gibba009.xiladd (mgr.34457) 213 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:16.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:15 gibba004 bash[31878]: audit 2021-03-10T20:14:14.609678+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:15 gibba004 bash[30897]: cluster 2021-03-10T20:14:14.155833+0000 mgr.gibba009.xiladd (mgr.34457) 213 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:15 gibba004 bash[30897]: audit 2021-03-10T20:14:14.609678+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:15 gibba009 bash[26136]: cluster 2021-03-10T20:14:14.155833+0000 mgr.gibba009.xiladd (mgr.34457) 213 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:15 gibba009 bash[26136]: audit 2021-03-10T20:14:14.609678+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:16 gibba004 bash[30897]: audit 2021-03-10T20:14:16.157406+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:17.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:16 gibba004 bash[31878]: audit 2021-03-10T20:14:16.157406+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:17.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:16 gibba009 bash[26136]: audit 2021-03-10T20:14:16.157406+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:17.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:17 gibba009 bash[26136]: cluster 2021-03-10T20:14:16.157918+0000 mgr.gibba009.xiladd (mgr.34457) 214 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:17.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:17 gibba009 bash[26136]: audit 2021-03-10T20:14:16.159425+0000 mgr.gibba009.xiladd (mgr.34457) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:17.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:17 gibba009 bash[26136]: cephadm 2021-03-10T20:14:16.164115+0000 mgr.gibba009.xiladd (mgr.34457) 216 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:14:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[30897]: cluster 2021-03-10T20:14:16.157918+0000 mgr.gibba009.xiladd (mgr.34457) 214 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[30897]: audit 2021-03-10T20:14:16.159425+0000 mgr.gibba009.xiladd (mgr.34457) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[30897]: cephadm 2021-03-10T20:14:16.164115+0000 mgr.gibba009.xiladd (mgr.34457) 216 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:14:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[31878]: cluster 2021-03-10T20:14:16.157918+0000 mgr.gibba009.xiladd (mgr.34457) 214 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[31878]: audit 2021-03-10T20:14:16.159425+0000 mgr.gibba009.xiladd (mgr.34457) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:14:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:17 gibba004 bash[31878]: cephadm 2021-03-10T20:14:16.164115+0000 mgr.gibba009.xiladd (mgr.34457) 216 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:14:18.961 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:18 gibba009 bash[26136]: cephadm 2021-03-10T20:14:17.944004+0000 mgr.gibba009.xiladd (mgr.34457) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:14:19.187 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:18 gibba009 bash[26136]: audit 2021-03-10T20:14:17.954164+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:19.188 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:18 gibba009 bash[26136]: audit 2021-03-10T20:14:17.956007+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:14:19.189 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[30897]: cephadm 2021-03-10T20:14:17.944004+0000 mgr.gibba009.xiladd (mgr.34457) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:14:19.190 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[30897]: audit 2021-03-10T20:14:17.954164+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:19.190 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[30897]: audit 2021-03-10T20:14:17.956007+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:14:19.191 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[31878]: cephadm 2021-03-10T20:14:17.944004+0000 mgr.gibba009.xiladd (mgr.34457) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:14:19.191 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[31878]: audit 2021-03-10T20:14:17.954164+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:19.191 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:18 gibba004 bash[31878]: audit 2021-03-10T20:14:17.956007+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:14:20.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:19 gibba009 bash[26136]: cephadm 2021-03-10T20:14:17.956809+0000 mgr.gibba009.xiladd (mgr.34457) 218 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:14:20.029 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:19 gibba009 bash[26136]: cluster 2021-03-10T20:14:18.159203+0000 mgr.gibba009.xiladd (mgr.34457) 219 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:20.030 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:19 gibba009 systemd[1]: Stopping Ceph osd.4 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:14:20.030 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:19 gibba009 bash[12211]: debug 2021-03-10T20:14:19.874+0000 7f18a2e38700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:14:20.030 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:19 gibba009 bash[12211]: debug 2021-03-10T20:14:19.874+0000 7f18a2e38700 -1 osd.4 86 *** Got signal Terminated *** 2021-03-10T20:14:20.031 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:19 gibba009 bash[12211]: debug 2021-03-10T20:14:19.874+0000 7f18a2e38700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:14:20.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:19 gibba004 bash[30897]: cephadm 2021-03-10T20:14:17.956809+0000 mgr.gibba009.xiladd (mgr.34457) 218 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:14:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:19 gibba004 bash[30897]: cluster 2021-03-10T20:14:18.159203+0000 mgr.gibba009.xiladd (mgr.34457) 219 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:19 gibba004 bash[31878]: cephadm 2021-03-10T20:14:17.956809+0000 mgr.gibba009.xiladd (mgr.34457) 218 : cephadm [INF] Deploying daemon osd.4 on gibba009 2021-03-10T20:14:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:19 gibba004 bash[31878]: cluster 2021-03-10T20:14:18.159203+0000 mgr.gibba009.xiladd (mgr.34457) 219 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:21.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.203957+0000 mon.a (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.204058+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:14:21.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.204541+0000 mon.a (mon.0) 354 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.204846+0000 mon.a (mon.0) 355 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.205302+0000 mon.a (mon.0) 356 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.205574+0000 mon.a (mon.0) 357 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.205995+0000 mon.a (mon.0) 358 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.206308+0000 mon.a (mon.0) 359 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.206813+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.207079+0000 mon.a (mon.0) 361 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.207616+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.207885+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.208266+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.208351+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.208541+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.601743+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.602042+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.602703+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.603157+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.603985+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.604267+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.604830+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.605078+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.605648+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.605837+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.606390+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.203957+0000 mon.a (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.204058+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:14:21.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.204541+0000 mon.a (mon.0) 354 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.204846+0000 mon.a (mon.0) 355 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.205302+0000 mon.a (mon.0) 356 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.205574+0000 mon.a (mon.0) 357 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.205995+0000 mon.a (mon.0) 358 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.206308+0000 mon.a (mon.0) 359 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.206813+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.207079+0000 mon.a (mon.0) 361 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.207616+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.207885+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.208266+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.208351+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.208541+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.601743+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.602042+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.602703+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.603157+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.603985+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.604267+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.604830+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.605078+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.605648+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.605837+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.606390+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.606578+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.606788+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.606837+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.606578+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.606788+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:20 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.606837+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.084 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:20 gibba009 docker[27608]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.4 2021-03-10T20:14:21.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.203957+0000 mon.a (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.204058+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:14:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.204541+0000 mon.a (mon.0) 354 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.204846+0000 mon.a (mon.0) 355 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.205302+0000 mon.a (mon.0) 356 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.205574+0000 mon.a (mon.0) 357 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.205995+0000 mon.a (mon.0) 358 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.206308+0000 mon.a (mon.0) 359 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.206813+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.207079+0000 mon.a (mon.0) 361 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.207616+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.207885+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.208266+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.208351+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.208541+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.601743+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.602042+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T20:14:21.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.602703+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.603157+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:14:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.603985+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.604267+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.604830+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T20:14:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.605078+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:14:21.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.605648+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.605837+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.606390+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.606578+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:14:21.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.606788+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:14:21.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:20 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.606837+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:14:21.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:21 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.160681+0000 mgr.gibba009.xiladd (mgr.34457) 220 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:21.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:21 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.639604+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:21.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:21 gibba009 bash[26136]: cluster 2021-03-10T20:14:20.654073+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T20:14:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.160681+0000 mgr.gibba009.xiladd (mgr.34457) 220 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.639604+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[31878]: cluster 2021-03-10T20:14:20.654073+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T20:14:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.160681+0000 mgr.gibba009.xiladd (mgr.34457) 220 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.639604+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:21 gibba004 bash[30897]: cluster 2021-03-10T20:14:20.654073+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2021-03-10T20:14:22.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:22 gibba009 bash[26136]: cluster 2021-03-10T20:14:21.660269+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:14:22.835 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:22 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.4.service: Succeeded. 2021-03-10T20:14:22.835 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:22 gibba009 systemd[1]: Stopped Ceph osd.4 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:14:22.836 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:22 gibba009 systemd[1]: Started Ceph osd.4 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:14:23.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:22 gibba004 bash[30897]: cluster 2021-03-10T20:14:21.660269+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:14:23.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:22 gibba004 bash[31878]: cluster 2021-03-10T20:14:21.660269+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:14:23.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[26136]: cluster 2021-03-10T20:14:22.161649+0000 mgr.gibba009.xiladd (mgr.34457) 221 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:23.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[26136]: audit 2021-03-10T20:14:22.708124+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:23.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[26136]: audit 2021-03-10T20:14:22.709614+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:23.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[26136]: audit 2021-03-10T20:14:22.711367+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:24.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[30897]: cluster 2021-03-10T20:14:22.161649+0000 mgr.gibba009.xiladd (mgr.34457) 221 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:24.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[30897]: audit 2021-03-10T20:14:22.708124+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[30897]: audit 2021-03-10T20:14:22.709614+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[30897]: audit 2021-03-10T20:14:22.711367+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:24.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[31878]: cluster 2021-03-10T20:14:22.161649+0000 mgr.gibba009.xiladd (mgr.34457) 221 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:14:24.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[31878]: audit 2021-03-10T20:14:22.708124+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[31878]: audit 2021-03-10T20:14:22.709614+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:23 gibba004 bash[31878]: audit 2021-03-10T20:14:22.711367+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:24.335 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:14:24.335 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T20:14:24.336 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:14:24.336 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:14:24.336 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:14:24.336 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:14:24.336 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:23 gibba009 bash[27788]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T20:14:25.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:24 gibba004 bash[30897]: cluster 2021-03-10T20:14:24.710872+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Degraded data redundancy: 10/195 objects degraded (5.128%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:25.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:24 gibba004 bash[31878]: cluster 2021-03-10T20:14:24.710872+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Degraded data redundancy: 10/195 objects degraded (5.128%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:25.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:24 gibba009 bash[26136]: cluster 2021-03-10T20:14:24.710872+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Degraded data redundancy: 10/195 objects degraded (5.128%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:25.769 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:25 gibba009 bash[27921]: debug 2021-03-10T20:14:25.502+0000 7fa972ed4700 1 -- 172.21.2.109:0/2643218672 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e98b0ca4e0 con 0x55e98b146c00 2021-03-10T20:14:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:25 gibba004 bash[30897]: cluster 2021-03-10T20:14:24.162230+0000 mgr.gibba009.xiladd (mgr.34457) 222 : cluster [DBG] pgmap v108: 129 pgs: 14 stale+active+clean, 8 active+undersized+degraded, 20 active+clean+wait, 10 active+undersized, 77 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:14:26.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:25 gibba004 bash[31878]: cluster 2021-03-10T20:14:24.162230+0000 mgr.gibba009.xiladd (mgr.34457) 222 : cluster [DBG] pgmap v108: 129 pgs: 14 stale+active+clean, 8 active+undersized+degraded, 20 active+clean+wait, 10 active+undersized, 77 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:14:26.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:25 gibba009 bash[26136]: cluster 2021-03-10T20:14:24.162230+0000 mgr.gibba009.xiladd (mgr.34457) 222 : cluster [DBG] pgmap v108: 129 pgs: 14 stale+active+clean, 8 active+undersized+degraded, 20 active+clean+wait, 10 active+undersized, 77 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 10/195 objects degraded (5.128%) 2021-03-10T20:14:26.584 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:26 gibba009 bash[27921]: debug 2021-03-10T20:14:26.122+0000 7fa97a969080 -1 Falling back to public interface 2021-03-10T20:14:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cluster 2021-03-10T20:14:26.162827+0000 mgr.gibba009.xiladd (mgr.34457) 223 : cluster [DBG] pgmap v109: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.501187+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.503682+0000 mgr.gibba009.xiladd (mgr.34457) 224 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:14:27.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.712176+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.715977+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:27.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.716441+0000 mgr.gibba009.xiladd (mgr.34457) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:27.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.717588+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.718464+0000 mgr.gibba009.xiladd (mgr.34457) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:27.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.718739+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.719490+0000 mgr.gibba009.xiladd (mgr.34457) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:27.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.719526+0000 mgr.gibba009.xiladd (mgr.34457) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:27.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.719917+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.720776+0000 mgr.gibba009.xiladd (mgr.34457) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:27.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.720815+0000 mgr.gibba009.xiladd (mgr.34457) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:27.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.721909+0000 mgr.gibba009.xiladd (mgr.34457) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:27.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.722880+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.723580+0000 mgr.gibba009.xiladd (mgr.34457) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:27.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.723617+0000 mgr.gibba009.xiladd (mgr.34457) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:27.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: audit 2021-03-10T20:14:26.724199+0000 mgr.gibba009.xiladd (mgr.34457) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[30897]: cephadm 2021-03-10T20:14:26.725026+0000 mgr.gibba009.xiladd (mgr.34457) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:14:27.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cluster 2021-03-10T20:14:26.162827+0000 mgr.gibba009.xiladd (mgr.34457) 223 : cluster [DBG] pgmap v109: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:27.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.501187+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.503682+0000 mgr.gibba009.xiladd (mgr.34457) 224 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:14:27.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.712176+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.715977+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:27.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.716441+0000 mgr.gibba009.xiladd (mgr.34457) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:27.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.717588+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.718464+0000 mgr.gibba009.xiladd (mgr.34457) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:27.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.718739+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.719490+0000 mgr.gibba009.xiladd (mgr.34457) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:27.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.719526+0000 mgr.gibba009.xiladd (mgr.34457) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:27.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.719917+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.720776+0000 mgr.gibba009.xiladd (mgr.34457) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:27.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.720815+0000 mgr.gibba009.xiladd (mgr.34457) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:27.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.721909+0000 mgr.gibba009.xiladd (mgr.34457) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:27.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.722880+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.723580+0000 mgr.gibba009.xiladd (mgr.34457) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:27.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.723617+0000 mgr.gibba009.xiladd (mgr.34457) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:27.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: audit 2021-03-10T20:14:26.724199+0000 mgr.gibba009.xiladd (mgr.34457) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:27 gibba004 bash[31878]: cephadm 2021-03-10T20:14:26.725026+0000 mgr.gibba009.xiladd (mgr.34457) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:14:27.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cluster 2021-03-10T20:14:26.162827+0000 mgr.gibba009.xiladd (mgr.34457) 223 : cluster [DBG] pgmap v109: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:27.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.501187+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.503682+0000 mgr.gibba009.xiladd (mgr.34457) 224 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:14:27.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.712176+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:27.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.715977+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:27.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.716441+0000 mgr.gibba009.xiladd (mgr.34457) 225 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:27.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.717588+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.718464+0000 mgr.gibba009.xiladd (mgr.34457) 226 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:27.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.718739+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.719490+0000 mgr.gibba009.xiladd (mgr.34457) 227 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.719526+0000 mgr.gibba009.xiladd (mgr.34457) 228 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.719917+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.720776+0000 mgr.gibba009.xiladd (mgr.34457) 229 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.720815+0000 mgr.gibba009.xiladd (mgr.34457) 230 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.721909+0000 mgr.gibba009.xiladd (mgr.34457) 231 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.722880+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.723580+0000 mgr.gibba009.xiladd (mgr.34457) 232 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.723617+0000 mgr.gibba009.xiladd (mgr.34457) 233 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:27.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: audit 2021-03-10T20:14:26.724199+0000 mgr.gibba009.xiladd (mgr.34457) 234 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:27.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:27 gibba009 bash[26136]: cephadm 2021-03-10T20:14:26.725026+0000 mgr.gibba009.xiladd (mgr.34457) 235 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:14:29.522 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:14:29.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[26136]: cluster 2021-03-10T20:14:28.164406+0000 mgr.gibba009.xiladd (mgr.34457) 236 : cluster [DBG] pgmap v110: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:29.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[26136]: audit 2021-03-10T20:14:29.453897+0000 mon.a (mon.0) 388 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:14:29.586 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[27921]: debug 2021-03-10T20:14:29.318+0000 7fa97a969080 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:14:29.586 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[27921]: debug 2021-03-10T20:14:29.318+0000 7fa963429700 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:14:29.586 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[27921]: debug 2021-03-10T20:14:29.446+0000 7fa97a969080 -1 osd.4 86 log_to_monitors {default=true} 2021-03-10T20:14:29.586 INFO:journalctl@ceph.osd.4.gibba009.stdout:Mar 10 20:14:29 gibba009 bash[27921]: debug 2021-03-10T20:14:29.518+0000 7fa969644700 -1 osd.4 86 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:14:29.786 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:14:29.787 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (3m) 28s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:14:29.787 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (8m) 3s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:14:29.787 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (3m) 3s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:14:29.787 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (4m) 3s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:14:29.788 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (3m) 28s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:14:29.788 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (2m) 28s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:14:29.788 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (2m) 3s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:14:29.788 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (2m) 28s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:14:29.789 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (8m) 28s ago 8m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:14:29.789 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (8m) 3s ago 8m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:14:29.789 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (106s) 28s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:14:29.789 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (81s) 28s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:14:29.789 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (56s) 28s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:14:29.790 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (30s) 28s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:14:29.790 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (5s) 3s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:14:29.790 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (10m) 3s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b9b0e6db0ba6 2021-03-10T20:14:29.791 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (9m) 3s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:14:29.791 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (9m) 3s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:14:29.791 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (8m) 3s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:14:29.791 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 28s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:29.791 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:29.811 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:29 gibba004 bash[31878]: cluster 2021-03-10T20:14:28.164406+0000 mgr.gibba009.xiladd (mgr.34457) 236 : cluster [DBG] pgmap v110: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:29.811 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:29 gibba004 bash[31878]: audit 2021-03-10T20:14:29.453897+0000 mon.a (mon.0) 388 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:14:29.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:29 gibba004 bash[30897]: cluster 2021-03-10T20:14:28.164406+0000 mgr.gibba009.xiladd (mgr.34457) 236 : cluster [DBG] pgmap v110: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:29.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:29 gibba004 bash[30897]: audit 2021-03-10T20:14:29.453897+0000 mon.a (mon.0) 388 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:14:30.038 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:14:30.039 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:14:30.039 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:30.040 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:14:30.040 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:14:30.040 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:30.040 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:14:30.041 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:14:30.041 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T20:14:30.041 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 4 2021-03-10T20:14:30.041 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:14:30.042 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:14:30.042 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:14:30.042 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T20:14:30.042 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 10 2021-03-10T20:14:30.043 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:14:30.043 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:14:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: audit 2021-03-10T20:14:29.507063+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:14:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: cluster 2021-03-10T20:14:29.507098+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:14:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: audit 2021-03-10T20:14:29.508378+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: audit 2021-03-10T20:14:29.514322+0000 mgr.gibba009.xiladd (mgr.34457) 237 : audit [DBG] from='client.54214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: audit 2021-03-10T20:14:29.746495+0000 mgr.gibba009.xiladd (mgr.34457) 238 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[30897]: audit 2021-03-10T20:14:30.039005+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.104:0/2260588014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:30.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: audit 2021-03-10T20:14:29.507063+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:14:30.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: cluster 2021-03-10T20:14:29.507098+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:14:30.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: audit 2021-03-10T20:14:29.508378+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:30.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: audit 2021-03-10T20:14:29.514322+0000 mgr.gibba009.xiladd (mgr.34457) 237 : audit [DBG] from='client.54214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: audit 2021-03-10T20:14:29.746495+0000 mgr.gibba009.xiladd (mgr.34457) 238 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:30 gibba004 bash[31878]: audit 2021-03-10T20:14:30.039005+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.104:0/2260588014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:30.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: audit 2021-03-10T20:14:29.507063+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:14:30.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: cluster 2021-03-10T20:14:29.507098+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:14:30.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: audit 2021-03-10T20:14:29.508378+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:30.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: audit 2021-03-10T20:14:29.514322+0000 mgr.gibba009.xiladd (mgr.34457) 237 : audit [DBG] from='client.54214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: audit 2021-03-10T20:14:29.746495+0000 mgr.gibba009.xiladd (mgr.34457) 238 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:30.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:30 gibba009 bash[26136]: audit 2021-03-10T20:14:30.039005+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.104:0/2260588014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[30897]: cluster 2021-03-10T20:14:30.165209+0000 mgr.gibba009.xiladd (mgr.34457) 239 : cluster [DBG] pgmap v112: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[30897]: cluster 2021-03-10T20:14:30.514646+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[30897]: cluster 2021-03-10T20:14:30.519184+0000 mon.a (mon.0) 393 : cluster [INF] osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405] boot 2021-03-10T20:14:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[30897]: cluster 2021-03-10T20:14:30.519227+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T20:14:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[30897]: audit 2021-03-10T20:14:30.520283+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:14:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[31878]: cluster 2021-03-10T20:14:30.165209+0000 mgr.gibba009.xiladd (mgr.34457) 239 : cluster [DBG] pgmap v112: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[31878]: cluster 2021-03-10T20:14:30.514646+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[31878]: cluster 2021-03-10T20:14:30.519184+0000 mon.a (mon.0) 393 : cluster [INF] osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405] boot 2021-03-10T20:14:31.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[31878]: cluster 2021-03-10T20:14:30.519227+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T20:14:31.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:31 gibba004 bash[31878]: audit 2021-03-10T20:14:30.520283+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:14:31.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:31 gibba009 bash[26136]: cluster 2021-03-10T20:14:30.165209+0000 mgr.gibba009.xiladd (mgr.34457) 239 : cluster [DBG] pgmap v112: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:31.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:31 gibba009 bash[26136]: cluster 2021-03-10T20:14:30.514646+0000 mon.a (mon.0) 392 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:31.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:31 gibba009 bash[26136]: cluster 2021-03-10T20:14:30.519184+0000 mon.a (mon.0) 393 : cluster [INF] osd.4 [v2:172.21.2.109:6800/1572891405,v1:172.21.2.109:6801/1572891405] boot 2021-03-10T20:14:31.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:31 gibba009 bash[26136]: cluster 2021-03-10T20:14:30.519227+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-03-10T20:14:31.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:31 gibba009 bash[26136]: audit 2021-03-10T20:14:30.520283+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:14:32.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:32 gibba004 bash[30897]: cluster 2021-03-10T20:14:31.528160+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:14:32.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:32 gibba004 bash[31878]: cluster 2021-03-10T20:14:31.528160+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:14:32.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:32 gibba009 bash[26136]: cluster 2021-03-10T20:14:31.528160+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:14:33.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:33 gibba004 bash[30897]: cluster 2021-03-10T20:14:32.166657+0000 mgr.gibba009.xiladd (mgr.34457) 240 : cluster [DBG] pgmap v115: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:33.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:33 gibba004 bash[30897]: cluster 2021-03-10T20:14:33.480028+0000 mon.a (mon.0) 396 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 23 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:33 gibba004 bash[31878]: cluster 2021-03-10T20:14:32.166657+0000 mgr.gibba009.xiladd (mgr.34457) 240 : cluster [DBG] pgmap v115: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:33 gibba004 bash[31878]: cluster 2021-03-10T20:14:33.480028+0000 mon.a (mon.0) 396 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 23 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:33.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:33 gibba009 bash[26136]: cluster 2021-03-10T20:14:32.166657+0000 mgr.gibba009.xiladd (mgr.34457) 240 : cluster [DBG] pgmap v115: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:14:33.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:33 gibba009 bash[26136]: cluster 2021-03-10T20:14:33.480028+0000 mon.a (mon.0) 396 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 23 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:35.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:35 gibba004 bash[30897]: cluster 2021-03-10T20:14:34.167293+0000 mgr.gibba009.xiladd (mgr.34457) 241 : cluster [DBG] pgmap v116: 129 pgs: 19 active+undersized+degraded, 23 active+undersized, 87 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 27/195 objects degraded (13.846%) 2021-03-10T20:14:35.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:35 gibba004 bash[31878]: cluster 2021-03-10T20:14:34.167293+0000 mgr.gibba009.xiladd (mgr.34457) 241 : cluster [DBG] pgmap v116: 129 pgs: 19 active+undersized+degraded, 23 active+undersized, 87 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 27/195 objects degraded (13.846%) 2021-03-10T20:14:35.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:35 gibba009 bash[26136]: cluster 2021-03-10T20:14:34.167293+0000 mgr.gibba009.xiladd (mgr.34457) 241 : cluster [DBG] pgmap v116: 129 pgs: 19 active+undersized+degraded, 23 active+undersized, 87 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 27/195 objects degraded (13.846%) 2021-03-10T20:14:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:36 gibba004 bash[30897]: cluster 2021-03-10T20:14:36.554599+0000 mon.a (mon.0) 397 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/195 objects degraded (13.846%), 19 pgs degraded) 2021-03-10T20:14:37.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:36 gibba004 bash[31878]: cluster 2021-03-10T20:14:36.554599+0000 mon.a (mon.0) 397 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/195 objects degraded (13.846%), 19 pgs degraded) 2021-03-10T20:14:37.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:36 gibba009 bash[26136]: cluster 2021-03-10T20:14:36.554599+0000 mon.a (mon.0) 397 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/195 objects degraded (13.846%), 19 pgs degraded) 2021-03-10T20:14:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:37 gibba004 bash[30897]: cluster 2021-03-10T20:14:36.169088+0000 mgr.gibba009.xiladd (mgr.34457) 242 : cluster [DBG] pgmap v117: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:37 gibba004 bash[31878]: cluster 2021-03-10T20:14:36.169088+0000 mgr.gibba009.xiladd (mgr.34457) 242 : cluster [DBG] pgmap v117: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:37 gibba009 bash[26136]: cluster 2021-03-10T20:14:36.169088+0000 mgr.gibba009.xiladd (mgr.34457) 242 : cluster [DBG] pgmap v117: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: cluster 2021-03-10T20:14:38.170215+0000 mgr.gibba009.xiladd (mgr.34457) 243 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.470341+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.471057+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.471680+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.471735+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.472407+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.473146+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.474185+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.475088+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.579304+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.579835+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.585246+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[30897]: audit 2021-03-10T20:14:39.585766+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: cluster 2021-03-10T20:14:38.170215+0000 mgr.gibba009.xiladd (mgr.34457) 243 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.470341+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.471057+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.471680+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.471735+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.472407+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.473146+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.474185+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.475088+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.579304+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.579835+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.585246+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:39 gibba004 bash[31878]: audit 2021-03-10T20:14:39.585766+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: cluster 2021-03-10T20:14:38.170215+0000 mgr.gibba009.xiladd (mgr.34457) 243 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.470341+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.471057+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.471680+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:14:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.471735+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.472407+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.473146+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.474185+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:14:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.475088+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:14:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.579304+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.579835+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.585246+0000 mon.c (mon.1) 131 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:39 gibba009 bash[26136]: audit 2021-03-10T20:14:39.585766+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:41.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:40 gibba004 bash[30897]: audit 2021-03-10T20:14:39.624702+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:41.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:40 gibba004 bash[31878]: audit 2021-03-10T20:14:39.624702+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:41.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:40 gibba009 bash[26136]: audit 2021-03-10T20:14:39.624702+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:41.936 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:41 gibba009 bash[26136]: cluster 2021-03-10T20:14:40.171983+0000 mgr.gibba009.xiladd (mgr.34457) 244 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:41 gibba004 bash[30897]: cluster 2021-03-10T20:14:40.171983+0000 mgr.gibba009.xiladd (mgr.34457) 244 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:41 gibba004 bash[31878]: cluster 2021-03-10T20:14:40.171983+0000 mgr.gibba009.xiladd (mgr.34457) 244 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:43.018 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:42 gibba009 bash[26136]: audit 2021-03-10T20:14:41.740360+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:42 gibba009 bash[26136]: audit 2021-03-10T20:14:41.742405+0000 mgr.gibba009.xiladd (mgr.34457) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.019 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:42 gibba009 bash[26136]: cephadm 2021-03-10T20:14:41.747001+0000 mgr.gibba009.xiladd (mgr.34457) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:14:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[30897]: audit 2021-03-10T20:14:41.740360+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[30897]: audit 2021-03-10T20:14:41.742405+0000 mgr.gibba009.xiladd (mgr.34457) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[30897]: cephadm 2021-03-10T20:14:41.747001+0000 mgr.gibba009.xiladd (mgr.34457) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:14:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[31878]: audit 2021-03-10T20:14:41.740360+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[31878]: audit 2021-03-10T20:14:41.742405+0000 mgr.gibba009.xiladd (mgr.34457) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:14:43.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:42 gibba004 bash[31878]: cephadm 2021-03-10T20:14:41.747001+0000 mgr.gibba009.xiladd (mgr.34457) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:14:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[30897]: cluster 2021-03-10T20:14:42.173364+0000 mgr.gibba009.xiladd (mgr.34457) 247 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[30897]: audit 2021-03-10T20:14:43.599248+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[30897]: audit 2021-03-10T20:14:43.601191+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:14:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[31878]: cluster 2021-03-10T20:14:42.173364+0000 mgr.gibba009.xiladd (mgr.34457) 247 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[31878]: audit 2021-03-10T20:14:43.599248+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:43 gibba004 bash[31878]: audit 2021-03-10T20:14:43.601191+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:14:44.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:43 gibba009 bash[26136]: cluster 2021-03-10T20:14:42.173364+0000 mgr.gibba009.xiladd (mgr.34457) 247 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:44.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:43 gibba009 bash[26136]: audit 2021-03-10T20:14:43.599248+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:44.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:43 gibba009 bash[26136]: audit 2021-03-10T20:14:43.601191+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:14:44.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:44 gibba009 bash[26136]: cephadm 2021-03-10T20:14:43.588877+0000 mgr.gibba009.xiladd (mgr.34457) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:14:44.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:44 gibba009 bash[26136]: cephadm 2021-03-10T20:14:43.602038+0000 mgr.gibba009.xiladd (mgr.34457) 249 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:14:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:44 gibba004 bash[30897]: cephadm 2021-03-10T20:14:43.588877+0000 mgr.gibba009.xiladd (mgr.34457) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:14:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:44 gibba004 bash[30897]: cephadm 2021-03-10T20:14:43.602038+0000 mgr.gibba009.xiladd (mgr.34457) 249 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:14:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:44 gibba004 bash[31878]: cephadm 2021-03-10T20:14:43.588877+0000 mgr.gibba009.xiladd (mgr.34457) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:14:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:44 gibba004 bash[31878]: cephadm 2021-03-10T20:14:43.602038+0000 mgr.gibba009.xiladd (mgr.34457) 249 : cephadm [INF] Deploying daemon osd.5 on gibba009 2021-03-10T20:14:45.676 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:45 gibba009 systemd[1]: Stopping Ceph osd.5 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:14:45.677 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:45 gibba009 bash[13705]: debug 2021-03-10T20:14:45.582+0000 7fe4fe5b7700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:14:45.677 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:45 gibba009 bash[13705]: debug 2021-03-10T20:14:45.582+0000 7fe4fe5b7700 -1 osd.5 91 *** Got signal Terminated *** 2021-03-10T20:14:45.677 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:45 gibba009 bash[13705]: debug 2021-03-10T20:14:45.582+0000 7fe4fe5b7700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:14:45.929 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:45 gibba009 bash[26136]: cluster 2021-03-10T20:14:44.174629+0000 mgr.gibba009.xiladd (mgr.34457) 250 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:45 gibba004 bash[30897]: cluster 2021-03-10T20:14:44.174629+0000 mgr.gibba009.xiladd (mgr.34457) 250 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:46.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:45 gibba004 bash[31878]: cluster 2021-03-10T20:14:44.174629+0000 mgr.gibba009.xiladd (mgr.34457) 250 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:46.698 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:46 gibba009 docker[28857]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.5 2021-03-10T20:14:46.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.929030+0000 mon.a (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.929183+0000 mon.a (mon.0) 407 : cluster [INF] osd.5 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:14:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.929979+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.930235+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:46.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.931035+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:46.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.931394+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:46.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.932038+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:46.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.932293+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:46.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.932721+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.932892+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.933402+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.933785+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.934477+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.934884+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:45.935521+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.328073+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.328957+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.329258+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:46.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.329776+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:46.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.330047+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:46.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.330626+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:46.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.330942+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:46.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.331568+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:46.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.331801+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:46.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.332201+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:46.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.332480+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:46.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.332913+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:46.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.333185+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:46.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.333762+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:46.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.501520+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:46.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.502037+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:46.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.502282+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:46.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:46 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.502386+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.929030+0000 mon.a (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.929183+0000 mon.a (mon.0) 407 : cluster [INF] osd.5 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:14:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.929979+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.930235+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.931035+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.931394+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.932038+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.932293+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.932721+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.932892+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.933402+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.933785+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.934477+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.934884+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:45.935521+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.328073+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.328957+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.329258+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.329776+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.330047+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.330626+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.330942+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.331568+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.331801+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.332201+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.332480+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.929030+0000 mon.a (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.929183+0000 mon.a (mon.0) 407 : cluster [INF] osd.5 failed (root=default,host=gibba009) (connection refused reported by osd.3) 2021-03-10T20:14:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.929979+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.930235+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.931035+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.931394+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.932038+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.932293+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.932721+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.932892+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.933402+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.933785+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.934477+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.934884+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:45.935521+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.328073+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.328957+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.329258+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.329776+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.330047+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:14:47.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.330626+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.330942+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.331568+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.331801+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:14:47.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.332201+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.332480+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.332913+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.333185+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.333762+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.501520+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.502037+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.502282+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.502386+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.332913+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:14:47.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.333185+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:47.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.333762+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.501520+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:14:47.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.502037+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:14:47.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.502282+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:14:47.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:46 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.502386+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:14:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.176543+0000 mgr.gibba009.xiladd (mgr.34457) 251 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.677281+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[30897]: cluster 2021-03-10T20:14:46.696922+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T20:14:48.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.176543+0000 mgr.gibba009.xiladd (mgr.34457) 251 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:48.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.677281+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:47 gibba004 bash[31878]: cluster 2021-03-10T20:14:46.696922+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T20:14:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:47 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.176543+0000 mgr.gibba009.xiladd (mgr.34457) 251 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:47 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.677281+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:14:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:47 gibba009 bash[26136]: cluster 2021-03-10T20:14:46.696922+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2021-03-10T20:14:48.584 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:48 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.5.service: Succeeded. 2021-03-10T20:14:48.585 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:48 gibba009 systemd[1]: Stopped Ceph osd.5 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:14:48.585 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:48 gibba009 systemd[1]: Started Ceph osd.5 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:14:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[30897]: cluster 2021-03-10T20:14:47.703311+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:14:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[30897]: audit 2021-03-10T20:14:48.427115+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[30897]: audit 2021-03-10T20:14:48.428251+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[30897]: audit 2021-03-10T20:14:48.429790+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:49.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[31878]: cluster 2021-03-10T20:14:47.703311+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:14:49.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[31878]: audit 2021-03-10T20:14:48.427115+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[31878]: audit 2021-03-10T20:14:48.428251+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:48 gibba004 bash[31878]: audit 2021-03-10T20:14:48.429790+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:49.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:48 gibba009 bash[26136]: cluster 2021-03-10T20:14:47.703311+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:14:49.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:48 gibba009 bash[26136]: audit 2021-03-10T20:14:48.427115+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:48 gibba009 bash[26136]: audit 2021-03-10T20:14:48.428251+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:48 gibba009 bash[26136]: audit 2021-03-10T20:14:48.429790+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:14:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:49 gibba004 bash[30897]: cluster 2021-03-10T20:14:48.177594+0000 mgr.gibba009.xiladd (mgr.34457) 252 : cluster [DBG] pgmap v125: 129 pgs: 16 stale+active+clean, 5 peering, 18 active+clean+wait, 90 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:50.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:49 gibba004 bash[30897]: cluster 2021-03-10T20:14:48.703219+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:14:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:49 gibba004 bash[31878]: cluster 2021-03-10T20:14:48.177594+0000 mgr.gibba009.xiladd (mgr.34457) 252 : cluster [DBG] pgmap v125: 129 pgs: 16 stale+active+clean, 5 peering, 18 active+clean+wait, 90 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:49 gibba004 bash[31878]: cluster 2021-03-10T20:14:48.703219+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:14:50.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[26136]: cluster 2021-03-10T20:14:48.177594+0000 mgr.gibba009.xiladd (mgr.34457) 252 : cluster [DBG] pgmap v125: 129 pgs: 16 stale+active+clean, 5 peering, 18 active+clean+wait, 90 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:14:50.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[26136]: cluster 2021-03-10T20:14:48.703219+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:14:50.085 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:14:50.086 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T20:14:50.086 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:14:50.086 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:14:50.086 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:14:50.087 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:14:50.087 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:49 gibba009 bash[29037]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T20:14:51.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:50 gibba004 bash[30897]: cluster 2021-03-10T20:14:50.710549+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:51.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:50 gibba004 bash[31878]: cluster 2021-03-10T20:14:50.710549+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:51.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:50 gibba009 bash[26136]: cluster 2021-03-10T20:14:50.710549+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: Degraded data redundancy: 11/195 objects degraded (5.641%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:51 gibba004 bash[30897]: cluster 2021-03-10T20:14:50.178291+0000 mgr.gibba009.xiladd (mgr.34457) 253 : cluster [DBG] pgmap v126: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 5 peering, 20 active+undersized, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T20:14:52.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:51 gibba004 bash[31878]: cluster 2021-03-10T20:14:50.178291+0000 mgr.gibba009.xiladd (mgr.34457) 253 : cluster [DBG] pgmap v126: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 5 peering, 20 active+undersized, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T20:14:52.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:51 gibba009 bash[26136]: cluster 2021-03-10T20:14:50.178291+0000 mgr.gibba009.xiladd (mgr.34457) 253 : cluster [DBG] pgmap v126: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 5 peering, 20 active+undersized, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 11/195 objects degraded (5.641%) 2021-03-10T20:14:52.085 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:51 gibba009 bash[29169]: debug 2021-03-10T20:14:51.814+0000 7f4e61dd2080 -1 Falling back to public interface 2021-03-10T20:14:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cluster 2021-03-10T20:14:52.178753+0000 mgr.gibba009.xiladd (mgr.34457) 254 : cluster [DBG] pgmap v127: 129 pgs: 12 active+undersized+degraded, 5 peering, 27 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:14:53.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.406730+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.410671+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.415589+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:53.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.416013+0000 mgr.gibba009.xiladd (mgr.34457) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:53.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.416824+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.417713+0000 mgr.gibba009.xiladd (mgr.34457) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:53.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.417985+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.418817+0000 mgr.gibba009.xiladd (mgr.34457) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:53.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.418872+0000 mgr.gibba009.xiladd (mgr.34457) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:53.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.419193+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.419980+0000 mgr.gibba009.xiladd (mgr.34457) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:53.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.420132+0000 mgr.gibba009.xiladd (mgr.34457) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:53.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.421224+0000 mgr.gibba009.xiladd (mgr.34457) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:53.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.421988+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.422609+0000 mgr.gibba009.xiladd (mgr.34457) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:53.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.422661+0000 mgr.gibba009.xiladd (mgr.34457) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:53.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: audit 2021-03-10T20:14:52.423368+0000 mgr.gibba009.xiladd (mgr.34457) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[30897]: cephadm 2021-03-10T20:14:52.424564+0000 mgr.gibba009.xiladd (mgr.34457) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:14:53.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cluster 2021-03-10T20:14:52.178753+0000 mgr.gibba009.xiladd (mgr.34457) 254 : cluster [DBG] pgmap v127: 129 pgs: 12 active+undersized+degraded, 5 peering, 27 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:14:53.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.406730+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.410671+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.415589+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:53.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.416013+0000 mgr.gibba009.xiladd (mgr.34457) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:53.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.416824+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.417713+0000 mgr.gibba009.xiladd (mgr.34457) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:53.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.417985+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.418817+0000 mgr.gibba009.xiladd (mgr.34457) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:53.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.418872+0000 mgr.gibba009.xiladd (mgr.34457) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:53.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.419193+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.419980+0000 mgr.gibba009.xiladd (mgr.34457) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:53.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.420132+0000 mgr.gibba009.xiladd (mgr.34457) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:53.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.421224+0000 mgr.gibba009.xiladd (mgr.34457) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:53.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.421988+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.422609+0000 mgr.gibba009.xiladd (mgr.34457) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:53.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.422661+0000 mgr.gibba009.xiladd (mgr.34457) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:53.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: audit 2021-03-10T20:14:52.423368+0000 mgr.gibba009.xiladd (mgr.34457) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:53 gibba004 bash[31878]: cephadm 2021-03-10T20:14:52.424564+0000 mgr.gibba009.xiladd (mgr.34457) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:14:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cluster 2021-03-10T20:14:52.178753+0000 mgr.gibba009.xiladd (mgr.34457) 254 : cluster [DBG] pgmap v127: 129 pgs: 12 active+undersized+degraded, 5 peering, 27 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:14:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.406730+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.410671+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:14:53.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.415589+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:53.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.416013+0000 mgr.gibba009.xiladd (mgr.34457) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:53.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.416824+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.417713+0000 mgr.gibba009.xiladd (mgr.34457) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.417985+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.418817+0000 mgr.gibba009.xiladd (mgr.34457) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.418872+0000 mgr.gibba009.xiladd (mgr.34457) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:53.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.419193+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.419980+0000 mgr.gibba009.xiladd (mgr.34457) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.420132+0000 mgr.gibba009.xiladd (mgr.34457) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.421224+0000 mgr.gibba009.xiladd (mgr.34457) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:53.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.421988+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.422609+0000 mgr.gibba009.xiladd (mgr.34457) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.422661+0000 mgr.gibba009.xiladd (mgr.34457) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: audit 2021-03-10T20:14:52.423368+0000 mgr.gibba009.xiladd (mgr.34457) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:14:53.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:53 gibba009 bash[26136]: cephadm 2021-03-10T20:14:52.424564+0000 mgr.gibba009.xiladd (mgr.34457) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:14:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:54 gibba004 bash[30897]: cluster 2021-03-10T20:14:54.494239+0000 mon.a (mon.0) 447 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:14:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:54 gibba004 bash[31878]: cluster 2021-03-10T20:14:54.494239+0000 mon.a (mon.0) 447 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:14:54.834 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:54 gibba009 bash[26136]: cluster 2021-03-10T20:14:54.494239+0000 mon.a (mon.0) 447 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:14:55.335 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[29169]: debug 2021-03-10T20:14:55.030+0000 7f4e61dd2080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:14:55.335 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[29169]: debug 2021-03-10T20:14:55.030+0000 7f4e4a892700 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:14:55.336 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[29169]: debug 2021-03-10T20:14:55.158+0000 7f4e61dd2080 -1 osd.5 91 log_to_monitors {default=true} 2021-03-10T20:14:55.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[30897]: cluster 2021-03-10T20:14:54.180158+0000 mgr.gibba009.xiladd (mgr.34457) 266 : cluster [DBG] pgmap v128: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[30897]: audit 2021-03-10T20:14:55.163973+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:55.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[30897]: audit 2021-03-10T20:14:55.164057+0000 mon.b (mon.2) 3 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:55.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[31878]: cluster 2021-03-10T20:14:54.180158+0000 mgr.gibba009.xiladd (mgr.34457) 266 : cluster [DBG] pgmap v128: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:55.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[31878]: audit 2021-03-10T20:14:55.163973+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:55.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:55 gibba004 bash[31878]: audit 2021-03-10T20:14:55.164057+0000 mon.b (mon.2) 3 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:55.836 INFO:journalctl@ceph.osd.5.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[29169]: debug 2021-03-10T20:14:55.562+0000 7f4e50aad700 -1 osd.5 91 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:14:55.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[26136]: cluster 2021-03-10T20:14:54.180158+0000 mgr.gibba009.xiladd (mgr.34457) 266 : cluster [DBG] pgmap v128: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[26136]: audit 2021-03-10T20:14:55.163973+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:55.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:55 gibba009 bash[26136]: audit 2021-03-10T20:14:55.164057+0000 mon.b (mon.2) 3 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:14:56.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:56 gibba009 bash[26136]: audit 2021-03-10T20:14:55.551674+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:14:56.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:56 gibba009 bash[26136]: cluster 2021-03-10T20:14:55.551738+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:14:56.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:56 gibba009 bash[26136]: audit 2021-03-10T20:14:55.554730+0000 mon.b (mon.2) 4 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:56.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:56 gibba009 bash[26136]: audit 2021-03-10T20:14:55.555563+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[30897]: audit 2021-03-10T20:14:55.551674+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:14:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[30897]: cluster 2021-03-10T20:14:55.551738+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:14:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[30897]: audit 2021-03-10T20:14:55.554730+0000 mon.b (mon.2) 4 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:57.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[30897]: audit 2021-03-10T20:14:55.555563+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[31878]: audit 2021-03-10T20:14:55.551674+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:14:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[31878]: cluster 2021-03-10T20:14:55.551738+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:14:57.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[31878]: audit 2021-03-10T20:14:55.554730+0000 mon.b (mon.2) 4 : audit [INF] from='osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:57.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:56 gibba004 bash[31878]: audit 2021-03-10T20:14:55.555563+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:14:57.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:57 gibba009 bash[26136]: cluster 2021-03-10T20:14:56.181358+0000 mgr.gibba009.xiladd (mgr.34457) 267 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:57.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:57 gibba009 bash[26136]: cluster 2021-03-10T20:14:56.555140+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:57 gibba009 bash[26136]: cluster 2021-03-10T20:14:56.565464+0000 mon.a (mon.0) 453 : cluster [INF] osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548] boot 2021-03-10T20:14:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:57 gibba009 bash[26136]: cluster 2021-03-10T20:14:56.565509+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T20:14:57.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:57 gibba009 bash[26136]: audit 2021-03-10T20:14:56.566734+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:14:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[30897]: cluster 2021-03-10T20:14:56.181358+0000 mgr.gibba009.xiladd (mgr.34457) 267 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:58.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[30897]: cluster 2021-03-10T20:14:56.555140+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:58.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[30897]: cluster 2021-03-10T20:14:56.565464+0000 mon.a (mon.0) 453 : cluster [INF] osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548] boot 2021-03-10T20:14:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[30897]: cluster 2021-03-10T20:14:56.565509+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T20:14:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[30897]: audit 2021-03-10T20:14:56.566734+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:14:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[31878]: cluster 2021-03-10T20:14:56.181358+0000 mgr.gibba009.xiladd (mgr.34457) 267 : cluster [DBG] pgmap v130: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:14:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[31878]: cluster 2021-03-10T20:14:56.555140+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:14:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[31878]: cluster 2021-03-10T20:14:56.565464+0000 mon.a (mon.0) 453 : cluster [INF] osd.5 [v2:172.21.2.109:6808/767541548,v1:172.21.2.109:6809/767541548] boot 2021-03-10T20:14:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[31878]: cluster 2021-03-10T20:14:56.565509+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-03-10T20:14:58.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:57 gibba004 bash[31878]: audit 2021-03-10T20:14:56.566734+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:14:58.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:58 gibba009 bash[26136]: cluster 2021-03-10T20:14:57.570277+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:14:58.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:58 gibba009 bash[26136]: cluster 2021-03-10T20:14:58.491450+0000 mon.a (mon.0) 456 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:58 gibba004 bash[30897]: cluster 2021-03-10T20:14:57.570277+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:14:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:58 gibba004 bash[30897]: cluster 2021-03-10T20:14:58.491450+0000 mon.a (mon.0) 456 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:14:59.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:58 gibba004 bash[31878]: cluster 2021-03-10T20:14:57.570277+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:14:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:58 gibba004 bash[31878]: cluster 2021-03-10T20:14:58.491450+0000 mon.a (mon.0) 456 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:00.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:14:59 gibba004 bash[30897]: cluster 2021-03-10T20:14:58.182745+0000 mgr.gibba009.xiladd (mgr.34457) 268 : cluster [DBG] pgmap v133: 129 pgs: 4 peering, 12 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:00.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:14:59 gibba004 bash[31878]: cluster 2021-03-10T20:14:58.182745+0000 mgr.gibba009.xiladd (mgr.34457) 268 : cluster [DBG] pgmap v133: 129 pgs: 4 peering, 12 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:14:59 gibba009 bash[26136]: cluster 2021-03-10T20:14:58.182745+0000 mgr.gibba009.xiladd (mgr.34457) 268 : cluster [DBG] pgmap v133: 129 pgs: 4 peering, 12 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:00.281 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:15:00.507 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:15:00.507 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (3m) 59s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:15:00.507 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (9m) 8s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:15:00.508 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (4m) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:15:00.508 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (4m) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:15:00.508 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (3m) 59s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:15:00.508 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (3m) 59s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:15:00.508 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (3m) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:15:00.509 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (3m) 59s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:15:00.509 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (9m) 59s ago 9m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:15:00.509 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (9m) 8s ago 9m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:15:00.509 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (2m) 59s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:15:00.510 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (112s) 59s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:15:00.510 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (86s) 59s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:15:00.510 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (61s) 59s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:15:00.510 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (35s) 8s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:15:00.510 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (10s) 8s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:15:00.511 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (9m) 8s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 288548dd424e 2021-03-10T20:15:00.511 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (9m) 8s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:15:00.511 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (8m) 8s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:15:00.511 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 59s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:00.512 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:00.758 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:15:00.758 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:15:00.758 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:00.758 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:00.759 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:15:00.759 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:00.759 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:00.759 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:15:00.759 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T20:15:00.760 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T20:15:00.760 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:00.760 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:15:00.760 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:15:00.761 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T20:15:00.761 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 12 2021-03-10T20:15:00.761 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:15:00.761 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:15:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[30897]: cluster 2021-03-10T20:15:00.184479+0000 mgr.gibba009.xiladd (mgr.34457) 269 : cluster [DBG] pgmap v134: 129 pgs: 4 peering, 10 active+undersized+degraded, 16 active+undersized, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:15:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[30897]: audit 2021-03-10T20:15:00.274639+0000 mgr.gibba009.xiladd (mgr.34457) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[30897]: audit 2021-03-10T20:15:00.496318+0000 mgr.gibba009.xiladd (mgr.34457) 271 : audit [DBG] from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[30897]: audit 2021-03-10T20:15:00.758307+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.104:0/2244032284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[31878]: cluster 2021-03-10T20:15:00.184479+0000 mgr.gibba009.xiladd (mgr.34457) 269 : cluster [DBG] pgmap v134: 129 pgs: 4 peering, 10 active+undersized+degraded, 16 active+undersized, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:15:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[31878]: audit 2021-03-10T20:15:00.274639+0000 mgr.gibba009.xiladd (mgr.34457) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[31878]: audit 2021-03-10T20:15:00.496318+0000 mgr.gibba009.xiladd (mgr.34457) 271 : audit [DBG] from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:01 gibba004 bash[31878]: audit 2021-03-10T20:15:00.758307+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.104:0/2244032284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:01 gibba009 bash[26136]: cluster 2021-03-10T20:15:00.184479+0000 mgr.gibba009.xiladd (mgr.34457) 269 : cluster [DBG] pgmap v134: 129 pgs: 4 peering, 10 active+undersized+degraded, 16 active+undersized, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:15:02.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:01 gibba009 bash[26136]: audit 2021-03-10T20:15:00.274639+0000 mgr.gibba009.xiladd (mgr.34457) 270 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:01 gibba009 bash[26136]: audit 2021-03-10T20:15:00.496318+0000 mgr.gibba009.xiladd (mgr.34457) 271 : audit [DBG] from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:02.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:01 gibba009 bash[26136]: audit 2021-03-10T20:15:00.758307+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.104:0/2244032284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:03.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:02 gibba004 bash[30897]: cluster 2021-03-10T20:15:02.594417+0000 mon.a (mon.0) 457 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 10 pgs degraded) 2021-03-10T20:15:03.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:02 gibba004 bash[31878]: cluster 2021-03-10T20:15:02.594417+0000 mon.a (mon.0) 457 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 10 pgs degraded) 2021-03-10T20:15:03.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:02 gibba009 bash[26136]: cluster 2021-03-10T20:15:02.594417+0000 mon.a (mon.0) 457 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 10 pgs degraded) 2021-03-10T20:15:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:03 gibba004 bash[30897]: cluster 2021-03-10T20:15:02.185900+0000 mgr.gibba009.xiladd (mgr.34457) 272 : cluster [DBG] pgmap v135: 129 pgs: 17 active+clean+wait, 4 peering, 108 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:04.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:03 gibba004 bash[31878]: cluster 2021-03-10T20:15:02.185900+0000 mgr.gibba009.xiladd (mgr.34457) 272 : cluster [DBG] pgmap v135: 129 pgs: 17 active+clean+wait, 4 peering, 108 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:03 gibba009 bash[26136]: cluster 2021-03-10T20:15:02.185900+0000 mgr.gibba009.xiladd (mgr.34457) 272 : cluster [DBG] pgmap v135: 129 pgs: 17 active+clean+wait, 4 peering, 108 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:06.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:05 gibba004 bash[30897]: cluster 2021-03-10T20:15:04.187172+0000 mgr.gibba009.xiladd (mgr.34457) 273 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:06.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:05 gibba004 bash[31878]: cluster 2021-03-10T20:15:04.187172+0000 mgr.gibba009.xiladd (mgr.34457) 273 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:05 gibba009 bash[26136]: cluster 2021-03-10T20:15:04.187172+0000 mgr.gibba009.xiladd (mgr.34457) 273 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:08.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:07 gibba004 bash[31878]: cluster 2021-03-10T20:15:06.189002+0000 mgr.gibba009.xiladd (mgr.34457) 274 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:08.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:07 gibba004 bash[31878]: audit 2021-03-10T20:15:07.440158+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:07 gibba004 bash[30897]: cluster 2021-03-10T20:15:06.189002+0000 mgr.gibba009.xiladd (mgr.34457) 274 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:07 gibba004 bash[30897]: audit 2021-03-10T20:15:07.440158+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:07 gibba009 bash[26136]: cluster 2021-03-10T20:15:06.189002+0000 mgr.gibba009.xiladd (mgr.34457) 274 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:07 gibba009 bash[26136]: audit 2021-03-10T20:15:07.440158+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:08.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:08 gibba009 bash[26136]: audit 2021-03-10T20:15:07.442258+0000 mgr.gibba009.xiladd (mgr.34457) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:08.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:08 gibba009 bash[26136]: cephadm 2021-03-10T20:15:07.447090+0000 mgr.gibba009.xiladd (mgr.34457) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:15:09.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:08 gibba004 bash[30897]: audit 2021-03-10T20:15:07.442258+0000 mgr.gibba009.xiladd (mgr.34457) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:09.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:08 gibba004 bash[30897]: cephadm 2021-03-10T20:15:07.447090+0000 mgr.gibba009.xiladd (mgr.34457) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:15:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:08 gibba004 bash[31878]: audit 2021-03-10T20:15:07.442258+0000 mgr.gibba009.xiladd (mgr.34457) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:15:09.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:08 gibba004 bash[31878]: cephadm 2021-03-10T20:15:07.447090+0000 mgr.gibba009.xiladd (mgr.34457) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:15:09.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:09 gibba009 bash[26136]: cluster 2021-03-10T20:15:08.190246+0000 mgr.gibba009.xiladd (mgr.34457) 277 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:09.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:09 gibba009 bash[26136]: audit 2021-03-10T20:15:09.283676+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:09.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:09 gibba009 bash[26136]: audit 2021-03-10T20:15:09.285520+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:15:09.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:09 gibba009 bash[26136]: audit 2021-03-10T20:15:09.640350+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:10.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[30897]: cluster 2021-03-10T20:15:08.190246+0000 mgr.gibba009.xiladd (mgr.34457) 277 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[30897]: audit 2021-03-10T20:15:09.283676+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[30897]: audit 2021-03-10T20:15:09.285520+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:15:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[30897]: audit 2021-03-10T20:15:09.640350+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:10.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[31878]: cluster 2021-03-10T20:15:08.190246+0000 mgr.gibba009.xiladd (mgr.34457) 277 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:10.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[31878]: audit 2021-03-10T20:15:09.283676+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:10.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[31878]: audit 2021-03-10T20:15:09.285520+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:15:10.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:09 gibba004 bash[31878]: audit 2021-03-10T20:15:09.640350+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:10.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:10 gibba009 bash[26136]: cephadm 2021-03-10T20:15:09.273589+0000 mgr.gibba009.xiladd (mgr.34457) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:15:10.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:10 gibba009 bash[26136]: cephadm 2021-03-10T20:15:09.286387+0000 mgr.gibba009.xiladd (mgr.34457) 279 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:15:11.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:10 gibba004 bash[30897]: cephadm 2021-03-10T20:15:09.273589+0000 mgr.gibba009.xiladd (mgr.34457) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:15:11.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:10 gibba004 bash[30897]: cephadm 2021-03-10T20:15:09.286387+0000 mgr.gibba009.xiladd (mgr.34457) 279 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:15:11.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:10 gibba004 bash[31878]: cephadm 2021-03-10T20:15:09.273589+0000 mgr.gibba009.xiladd (mgr.34457) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:15:11.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:10 gibba004 bash[31878]: cephadm 2021-03-10T20:15:09.286387+0000 mgr.gibba009.xiladd (mgr.34457) 279 : cephadm [INF] Deploying daemon osd.6 on gibba009 2021-03-10T20:15:11.335 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:11 gibba009 systemd[1]: Stopping Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:15:11.335 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[16707]: debug 2021-03-10T20:15:11.218+0000 7faa98a80700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:15:11.336 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[16707]: debug 2021-03-10T20:15:11.218+0000 7faa98a80700 -1 osd.6 96 *** Got signal Terminated *** 2021-03-10T20:15:11.336 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[16707]: debug 2021-03-10T20:15:11.218+0000 7faa98a80700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:15:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:10.191775+0000 mgr.gibba009.xiladd (mgr.34457) 280 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.537020+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:11.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.537142+0000 mon.a (mon.0) 461 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.7) 2021-03-10T20:15:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.539172+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.539866+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.553019+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.553090+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.554171+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.554282+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.555878+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556010+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556073+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556280+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556389+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556575+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556826+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.556894+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:11.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.557016+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:11.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:11 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.557082+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:12.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:10.191775+0000 mgr.gibba009.xiladd (mgr.34457) 280 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:12.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.537020+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.537142+0000 mon.a (mon.0) 461 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.7) 2021-03-10T20:15:12.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.539172+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.539866+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.553019+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.553090+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.554171+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.554282+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.555878+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:12.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556010+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556073+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:12.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556280+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:12.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556389+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:12.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556575+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556826+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:12.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.556894+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:12.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.557016+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:12.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.557082+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:12.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:10.191775+0000 mgr.gibba009.xiladd (mgr.34457) 280 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:12.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.537020+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.537142+0000 mon.a (mon.0) 461 : cluster [INF] osd.6 failed (root=default,host=gibba009) (connection refused reported by osd.7) 2021-03-10T20:15:12.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.539172+0000 mon.a (mon.0) 462 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.539866+0000 mon.a (mon.0) 463 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.553019+0000 mon.a (mon.0) 464 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.553090+0000 mon.a (mon.0) 465 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T20:15:12.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.554171+0000 mon.a (mon.0) 466 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.554282+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:15:12.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.555878+0000 mon.a (mon.0) 468 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:12.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556010+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556073+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T20:15:12.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556280+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:12.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556389+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T20:15:12.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556575+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T20:15:12.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556826+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:12.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.556894+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T20:15:12.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.557016+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:12.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:11 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.557082+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T20:15:12.335 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:12 gibba009 docker[30096]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.6 2021-03-10T20:15:12.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:12 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.700899+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:12.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:12 gibba009 bash[26136]: cluster 2021-03-10T20:15:11.715837+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T20:15:13.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:12 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.700899+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:13.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:12 gibba004 bash[30897]: cluster 2021-03-10T20:15:11.715837+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T20:15:13.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:12 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.700899+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:13.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:12 gibba004 bash[31878]: cluster 2021-03-10T20:15:11.715837+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2021-03-10T20:15:14.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:13 gibba009 bash[26136]: cluster 2021-03-10T20:15:12.192897+0000 mgr.gibba009.xiladd (mgr.34457) 281 : cluster [DBG] pgmap v141: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:14.016 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:13 gibba009 bash[26136]: cluster 2021-03-10T20:15:12.718108+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:15:14.017 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:13 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T20:15:14.017 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:13 gibba009 systemd[1]: Stopped Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:15:14.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:13 gibba004 bash[30897]: cluster 2021-03-10T20:15:12.192897+0000 mgr.gibba009.xiladd (mgr.34457) 281 : cluster [DBG] pgmap v141: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:14.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:13 gibba004 bash[30897]: cluster 2021-03-10T20:15:12.718108+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:15:14.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:13 gibba004 bash[31878]: cluster 2021-03-10T20:15:12.192897+0000 mgr.gibba009.xiladd (mgr.34457) 281 : cluster [DBG] pgmap v141: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:15:14.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:13 gibba004 bash[31878]: cluster 2021-03-10T20:15:12.718108+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:15:14.335 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:14 gibba009 systemd[1]: Started Ceph osd.6 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:15:15.227 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[26136]: audit 2021-03-10T20:15:14.045963+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:15.228 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[26136]: audit 2021-03-10T20:15:14.047315+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:15.228 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[26136]: audit 2021-03-10T20:15:14.049311+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:15.228 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[26136]: cephadm 2021-03-10T20:15:14.049679+0000 mgr.gibba009.xiladd (mgr.34457) 282 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:15:15.228 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[26136]: cluster 2021-03-10T20:15:14.193655+0000 mgr.gibba009.xiladd (mgr.34457) 283 : cluster [DBG] pgmap v143: 129 pgs: 10 stale+active+clean, 1 active+undersized+degraded, 3 peering, 17 active+clean+wait, 3 active+undersized, 95 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:15.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[30897]: audit 2021-03-10T20:15:14.045963+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:15.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[30897]: audit 2021-03-10T20:15:14.047315+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[30897]: audit 2021-03-10T20:15:14.049311+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[30897]: cephadm 2021-03-10T20:15:14.049679+0000 mgr.gibba009.xiladd (mgr.34457) 282 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:15:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[30897]: cluster 2021-03-10T20:15:14.193655+0000 mgr.gibba009.xiladd (mgr.34457) 283 : cluster [DBG] pgmap v143: 129 pgs: 10 stale+active+clean, 1 active+undersized+degraded, 3 peering, 17 active+clean+wait, 3 active+undersized, 95 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:15.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[31878]: audit 2021-03-10T20:15:14.045963+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[31878]: audit 2021-03-10T20:15:14.047315+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[31878]: audit 2021-03-10T20:15:14.049311+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[31878]: cephadm 2021-03-10T20:15:14.049679+0000 mgr.gibba009.xiladd (mgr.34457) 282 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:15:15.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:15 gibba004 bash[31878]: cluster 2021-03-10T20:15:14.193655+0000 mgr.gibba009.xiladd (mgr.34457) 283 : cluster [DBG] pgmap v143: 129 pgs: 10 stale+active+clean, 1 active+undersized+degraded, 3 peering, 17 active+clean+wait, 3 active+undersized, 95 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:15.585 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:15:15.585 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T20:15:15.586 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:15:15.586 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:15:15.586 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:15:15.587 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:15:15.587 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:15 gibba009 bash[30282]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T20:15:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:16 gibba004 bash[30897]: cluster 2021-03-10T20:15:15.040960+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:15:16.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:16 gibba004 bash[31878]: cluster 2021-03-10T20:15:15.040960+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:15:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:16 gibba009 bash[26136]: cluster 2021-03-10T20:15:15.040960+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: Degraded data redundancy: 3/195 objects degraded (1.538%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:15:17.066 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:16 gibba009 bash[30418]: debug 2021-03-10T20:15:16.758+0000 7f8269b67700 1 -- 172.21.2.109:0/2724116026 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617313144e0 con 0x561731390c00 2021-03-10T20:15:17.334 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:17 gibba009 bash[30418]: debug 2021-03-10T20:15:17.078+0000 7f82715fc080 -1 Falling back to public interface 2021-03-10T20:15:17.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:17 gibba009 bash[26136]: cluster 2021-03-10T20:15:16.195733+0000 mgr.gibba009.xiladd (mgr.34457) 284 : cluster [DBG] pgmap v144: 129 pgs: 13 active+undersized+degraded, 3 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:17.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:17 gibba004 bash[30897]: cluster 2021-03-10T20:15:16.195733+0000 mgr.gibba009.xiladd (mgr.34457) 284 : cluster [DBG] pgmap v144: 129 pgs: 13 active+undersized+degraded, 3 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:17.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:17 gibba004 bash[31878]: cluster 2021-03-10T20:15:16.195733+0000 mgr.gibba009.xiladd (mgr.34457) 284 : cluster [DBG] pgmap v144: 129 pgs: 13 active+undersized+degraded, 3 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:19.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.835662+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.840400+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.846352+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:19.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.846370+0000 mgr.gibba009.xiladd (mgr.34457) 285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:19.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.848198+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.848850+0000 mgr.gibba009.xiladd (mgr.34457) 286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:19.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.850002+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.850604+0000 mgr.gibba009.xiladd (mgr.34457) 287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:19.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.850677+0000 mgr.gibba009.xiladd (mgr.34457) 288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:19.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.851621+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.852241+0000 mgr.gibba009.xiladd (mgr.34457) 289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:19.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.852310+0000 mgr.gibba009.xiladd (mgr.34457) 290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:19.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.853969+0000 mgr.gibba009.xiladd (mgr.34457) 291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:19.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.856061+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.856178+0000 mgr.gibba009.xiladd (mgr.34457) 292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:19.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.856262+0000 mgr.gibba009.xiladd (mgr.34457) 293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:19.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: audit 2021-03-10T20:15:17.857547+0000 mgr.gibba009.xiladd (mgr.34457) 294 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[30897]: cephadm 2021-03-10T20:15:17.859306+0000 mgr.gibba009.xiladd (mgr.34457) 295 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:15:19.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.835662+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.840400+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.846352+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:19.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.846370+0000 mgr.gibba009.xiladd (mgr.34457) 285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:19.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.848198+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.848850+0000 mgr.gibba009.xiladd (mgr.34457) 286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:19.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.850002+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.850604+0000 mgr.gibba009.xiladd (mgr.34457) 287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:19.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.850677+0000 mgr.gibba009.xiladd (mgr.34457) 288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:19.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.851621+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.852241+0000 mgr.gibba009.xiladd (mgr.34457) 289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:19.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.852310+0000 mgr.gibba009.xiladd (mgr.34457) 290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:19.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.853969+0000 mgr.gibba009.xiladd (mgr.34457) 291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:19.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.856061+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.856178+0000 mgr.gibba009.xiladd (mgr.34457) 292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:19.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.856262+0000 mgr.gibba009.xiladd (mgr.34457) 293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:19.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: audit 2021-03-10T20:15:17.857547+0000 mgr.gibba009.xiladd (mgr.34457) 294 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:18 gibba004 bash[31878]: cephadm 2021-03-10T20:15:17.859306+0000 mgr.gibba009.xiladd (mgr.34457) 295 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:15:19.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.835662+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.840400+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:19.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.846352+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:19.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.846370+0000 mgr.gibba009.xiladd (mgr.34457) 285 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:19.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.848198+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.848850+0000 mgr.gibba009.xiladd (mgr.34457) 286 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.850002+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.850604+0000 mgr.gibba009.xiladd (mgr.34457) 287 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.850677+0000 mgr.gibba009.xiladd (mgr.34457) 288 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.851621+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.852241+0000 mgr.gibba009.xiladd (mgr.34457) 289 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.852310+0000 mgr.gibba009.xiladd (mgr.34457) 290 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:19.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.853969+0000 mgr.gibba009.xiladd (mgr.34457) 291 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:19.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.856061+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.856178+0000 mgr.gibba009.xiladd (mgr.34457) 292 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:19.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.856262+0000 mgr.gibba009.xiladd (mgr.34457) 293 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:19.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: audit 2021-03-10T20:15:17.857547+0000 mgr.gibba009.xiladd (mgr.34457) 294 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:19.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:18 gibba009 bash[26136]: cephadm 2021-03-10T20:15:17.859306+0000 mgr.gibba009.xiladd (mgr.34457) 295 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:15:20.165 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:19 gibba009 bash[26136]: cluster 2021-03-10T20:15:18.197292+0000 mgr.gibba009.xiladd (mgr.34457) 296 : cluster [DBG] pgmap v145: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:20.165 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[30418]: debug 2021-03-10T20:15:20.038+0000 7f82715fc080 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:15:20.166 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[30418]: debug 2021-03-10T20:15:20.038+0000 7f825c8c1700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:15:20.166 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[30418]: debug 2021-03-10T20:15:20.042+0000 7f825c8c1700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #1:96c0328a:::INTEL_SSDPEL1K375GA_PHKM913400JX375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:15:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:19 gibba004 bash[30897]: cluster 2021-03-10T20:15:18.197292+0000 mgr.gibba009.xiladd (mgr.34457) 296 : cluster [DBG] pgmap v145: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:20.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:19 gibba004 bash[31878]: cluster 2021-03-10T20:15:18.197292+0000 mgr.gibba009.xiladd (mgr.34457) 296 : cluster [DBG] pgmap v145: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:20.585 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[30418]: debug 2021-03-10T20:15:20.162+0000 7f82715fc080 -1 osd.6 96 log_to_monitors {default=true} 2021-03-10T20:15:21.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:20 gibba004 bash[30897]: audit 2021-03-10T20:15:20.169343+0000 mon.a (mon.0) 485 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:20 gibba004 bash[30897]: audit 2021-03-10T20:15:20.169422+0000 mon.b (mon.2) 5 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:20 gibba004 bash[31878]: audit 2021-03-10T20:15:20.169343+0000 mon.a (mon.0) 485 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:20 gibba004 bash[31878]: audit 2021-03-10T20:15:20.169422+0000 mon.b (mon.2) 5 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[26136]: audit 2021-03-10T20:15:20.169343+0000 mon.a (mon.0) 485 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[26136]: audit 2021-03-10T20:15:20.169422+0000 mon.b (mon.2) 5 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:15:21.335 INFO:journalctl@ceph.osd.6.gibba009.stdout:Mar 10 20:15:20 gibba009 bash[30418]: debug 2021-03-10T20:15:20.870+0000 7f82622db700 -1 osd.6 96 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:15:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[31878]: cluster 2021-03-10T20:15:20.199047+0000 mgr.gibba009.xiladd (mgr.34457) 297 : cluster [DBG] pgmap v146: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[31878]: audit 2021-03-10T20:15:20.867498+0000 mon.a (mon.0) 486 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:15:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[31878]: cluster 2021-03-10T20:15:20.867581+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:15:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[31878]: audit 2021-03-10T20:15:20.869421+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[31878]: audit 2021-03-10T20:15:20.870405+0000 mon.b (mon.2) 6 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[30897]: cluster 2021-03-10T20:15:20.199047+0000 mgr.gibba009.xiladd (mgr.34457) 297 : cluster [DBG] pgmap v146: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[30897]: audit 2021-03-10T20:15:20.867498+0000 mon.a (mon.0) 486 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:15:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[30897]: cluster 2021-03-10T20:15:20.867581+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:15:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[30897]: audit 2021-03-10T20:15:20.869421+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:21 gibba004 bash[30897]: audit 2021-03-10T20:15:20.870405+0000 mon.b (mon.2) 6 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:22.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:21 gibba009 bash[26136]: cluster 2021-03-10T20:15:20.199047+0000 mgr.gibba009.xiladd (mgr.34457) 297 : cluster [DBG] pgmap v146: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 42 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:22.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:21 gibba009 bash[26136]: audit 2021-03-10T20:15:20.867498+0000 mon.a (mon.0) 486 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:15:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:21 gibba009 bash[26136]: cluster 2021-03-10T20:15:20.867581+0000 mon.a (mon.0) 487 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:15:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:21 gibba009 bash[26136]: audit 2021-03-10T20:15:20.869421+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:21 gibba009 bash[26136]: audit 2021-03-10T20:15:20.870405+0000 mon.b (mon.2) 6 : audit [INF] from='osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:23.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[30897]: cluster 2021-03-10T20:15:21.867204+0000 mon.a (mon.0) 489 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:23.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[30897]: cluster 2021-03-10T20:15:21.877265+0000 mon.a (mon.0) 490 : cluster [INF] osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212] boot 2021-03-10T20:15:23.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[30897]: cluster 2021-03-10T20:15:21.877303+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T20:15:23.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[30897]: audit 2021-03-10T20:15:21.878248+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:15:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[31878]: cluster 2021-03-10T20:15:21.867204+0000 mon.a (mon.0) 489 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:23.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[31878]: cluster 2021-03-10T20:15:21.877265+0000 mon.a (mon.0) 490 : cluster [INF] osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212] boot 2021-03-10T20:15:23.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[31878]: cluster 2021-03-10T20:15:21.877303+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T20:15:23.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:22 gibba004 bash[31878]: audit 2021-03-10T20:15:21.878248+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:15:23.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:22 gibba009 bash[26136]: cluster 2021-03-10T20:15:21.867204+0000 mon.a (mon.0) 489 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:23.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:22 gibba009 bash[26136]: cluster 2021-03-10T20:15:21.877265+0000 mon.a (mon.0) 490 : cluster [INF] osd.6 [v2:172.21.2.109:6816/2171477212,v1:172.21.2.109:6817/2171477212] boot 2021-03-10T20:15:23.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:22 gibba009 bash[26136]: cluster 2021-03-10T20:15:21.877303+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-03-10T20:15:23.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:22 gibba009 bash[26136]: audit 2021-03-10T20:15:21.878248+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:15:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[30897]: cluster 2021-03-10T20:15:22.200328+0000 mgr.gibba009.xiladd (mgr.34457) 298 : cluster [DBG] pgmap v149: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[30897]: cluster 2021-03-10T20:15:22.881761+0000 mon.a (mon.0) 492 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-03-10T20:15:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[30897]: cluster 2021-03-10T20:15:23.504402+0000 mon.a (mon.0) 493 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[31878]: cluster 2021-03-10T20:15:22.200328+0000 mgr.gibba009.xiladd (mgr.34457) 298 : cluster [DBG] pgmap v149: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:24.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[31878]: cluster 2021-03-10T20:15:22.881761+0000 mon.a (mon.0) 492 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-03-10T20:15:24.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:23 gibba004 bash[31878]: cluster 2021-03-10T20:15:23.504402+0000 mon.a (mon.0) 493 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:24.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:23 gibba009 bash[26136]: cluster 2021-03-10T20:15:22.200328+0000 mgr.gibba009.xiladd (mgr.34457) 298 : cluster [DBG] pgmap v149: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:15:24.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:23 gibba009 bash[26136]: cluster 2021-03-10T20:15:22.881761+0000 mon.a (mon.0) 492 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-03-10T20:15:24.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:23 gibba009 bash[26136]: cluster 2021-03-10T20:15:23.504402+0000 mon.a (mon.0) 493 : cluster [WRN] Health check update: Degraded data redundancy: 20/195 objects degraded (10.256%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:25 gibba004 bash[30897]: cluster 2021-03-10T20:15:24.201707+0000 mgr.gibba009.xiladd (mgr.34457) 299 : cluster [DBG] pgmap v151: 129 pgs: 1 peering, 12 active+undersized+degraded, 27 active+undersized, 89 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:25 gibba004 bash[31878]: cluster 2021-03-10T20:15:24.201707+0000 mgr.gibba009.xiladd (mgr.34457) 299 : cluster [DBG] pgmap v151: 129 pgs: 1 peering, 12 active+undersized+degraded, 27 active+undersized, 89 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:26.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:25 gibba009 bash[26136]: cluster 2021-03-10T20:15:24.201707+0000 mgr.gibba009.xiladd (mgr.34457) 299 : cluster [DBG] pgmap v151: 129 pgs: 1 peering, 12 active+undersized+degraded, 27 active+undersized, 89 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:15:27.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:26 gibba004 bash[30897]: cluster 2021-03-10T20:15:26.898239+0000 mon.a (mon.0) 494 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded) 2021-03-10T20:15:27.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:26 gibba004 bash[31878]: cluster 2021-03-10T20:15:26.898239+0000 mon.a (mon.0) 494 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded) 2021-03-10T20:15:27.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:26 gibba009 bash[26136]: cluster 2021-03-10T20:15:26.898239+0000 mon.a (mon.0) 494 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded) 2021-03-10T20:15:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:27 gibba004 bash[30897]: cluster 2021-03-10T20:15:26.203596+0000 mgr.gibba009.xiladd (mgr.34457) 300 : cluster [DBG] pgmap v152: 129 pgs: 13 active+clean+wait, 1 peering, 115 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:27 gibba004 bash[31878]: cluster 2021-03-10T20:15:26.203596+0000 mgr.gibba009.xiladd (mgr.34457) 300 : cluster [DBG] pgmap v152: 129 pgs: 13 active+clean+wait, 1 peering, 115 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:28.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:27 gibba009 bash[26136]: cluster 2021-03-10T20:15:26.203596+0000 mgr.gibba009.xiladd (mgr.34457) 300 : cluster [DBG] pgmap v152: 129 pgs: 13 active+clean+wait, 1 peering, 115 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:29 gibba004 bash[30897]: cluster 2021-03-10T20:15:28.205044+0000 mgr.gibba009.xiladd (mgr.34457) 301 : cluster [DBG] pgmap v153: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:30.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:29 gibba004 bash[31878]: cluster 2021-03-10T20:15:28.205044+0000 mgr.gibba009.xiladd (mgr.34457) 301 : cluster [DBG] pgmap v153: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:30.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:29 gibba009 bash[26136]: cluster 2021-03-10T20:15:28.205044+0000 mgr.gibba009.xiladd (mgr.34457) 301 : cluster [DBG] pgmap v153: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:31.007 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:15:31.234 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:15:31.234 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (4m) 90s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:15:31.235 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (9m) 13s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:15:31.235 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (4m) 13s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:15:31.235 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (5m) 13s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:15:31.235 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (4m) 90s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:15:31.235 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (3m) 90s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:15:31.236 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (3m) 13s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:15:31.236 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (3m) 90s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:15:31.236 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (9m) 90s ago 9m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:15:31.236 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (9m) 13s ago 9m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:15:31.237 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (2m) 90s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:15:31.237 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (2m) 90s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:15:31.237 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (117s) 90s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:15:31.237 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (91s) 90s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:15:31.237 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (66s) 13s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:15:31.238 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (40s) 13s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:15:31.238 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (15s) 13s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:15:31.238 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (10m) 13s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d72510e8ffd 2021-03-10T20:15:31.238 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (9m) 13s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:15:31.239 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 90s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:31.239 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 13s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:31.484 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:15:31.485 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:15:31.485 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:31.485 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:31.486 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:15:31.486 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:31.486 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:31.486 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:15:31.486 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:15:31.487 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T20:15:31.487 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:15:31.487 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:15:31.487 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:15:31.488 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:15:31.488 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 13 2021-03-10T20:15:31.488 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:15:31.488 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:15:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:31 gibba004 bash[30897]: cluster 2021-03-10T20:15:30.206713+0000 mgr.gibba009.xiladd (mgr.34457) 302 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:32.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:31 gibba004 bash[30897]: audit 2021-03-10T20:15:31.484717+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.104:0/2361207961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:32.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:31 gibba004 bash[31878]: cluster 2021-03-10T20:15:30.206713+0000 mgr.gibba009.xiladd (mgr.34457) 302 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:32.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:31 gibba004 bash[31878]: audit 2021-03-10T20:15:31.484717+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.104:0/2361207961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:31 gibba009 bash[26136]: cluster 2021-03-10T20:15:30.206713+0000 mgr.gibba009.xiladd (mgr.34457) 302 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:31 gibba009 bash[26136]: audit 2021-03-10T20:15:31.484717+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.104:0/2361207961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:33.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: audit 2021-03-10T20:15:30.998406+0000 mgr.gibba009.xiladd (mgr.34457) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: audit 2021-03-10T20:15:31.225255+0000 mgr.gibba009.xiladd (mgr.34457) 304 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: cluster 2021-03-10T20:15:32.208230+0000 mgr.gibba009.xiladd (mgr.34457) 305 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:33.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: audit 2021-03-10T20:15:32.874894+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: audit 2021-03-10T20:15:32.877085+0000 mgr.gibba009.xiladd (mgr.34457) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[30897]: cephadm 2021-03-10T20:15:32.881420+0000 mgr.gibba009.xiladd (mgr.34457) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:15:33.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: audit 2021-03-10T20:15:30.998406+0000 mgr.gibba009.xiladd (mgr.34457) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: audit 2021-03-10T20:15:31.225255+0000 mgr.gibba009.xiladd (mgr.34457) 304 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: cluster 2021-03-10T20:15:32.208230+0000 mgr.gibba009.xiladd (mgr.34457) 305 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: audit 2021-03-10T20:15:32.874894+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: audit 2021-03-10T20:15:32.877085+0000 mgr.gibba009.xiladd (mgr.34457) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:32 gibba004 bash[31878]: cephadm 2021-03-10T20:15:32.881420+0000 mgr.gibba009.xiladd (mgr.34457) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:15:33.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: audit 2021-03-10T20:15:30.998406+0000 mgr.gibba009.xiladd (mgr.34457) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: audit 2021-03-10T20:15:31.225255+0000 mgr.gibba009.xiladd (mgr.34457) 304 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: cluster 2021-03-10T20:15:32.208230+0000 mgr.gibba009.xiladd (mgr.34457) 305 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: audit 2021-03-10T20:15:32.874894+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: audit 2021-03-10T20:15:32.877085+0000 mgr.gibba009.xiladd (mgr.34457) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:15:33.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:32 gibba009 bash[26136]: cephadm 2021-03-10T20:15:32.881420+0000 mgr.gibba009.xiladd (mgr.34457) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:15:35.907 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: cluster 2021-03-10T20:15:34.209702+0000 mgr.gibba009.xiladd (mgr.34457) 308 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:35.907 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: audit 2021-03-10T20:15:34.655918+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:35.908 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: cephadm 2021-03-10T20:15:34.767065+0000 mgr.gibba009.xiladd (mgr.34457) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:15:35.908 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: audit 2021-03-10T20:15:34.777012+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:35.908 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: audit 2021-03-10T20:15:34.779529+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:15:35.908 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:35 gibba009 bash[26136]: cephadm 2021-03-10T20:15:34.780160+0000 mgr.gibba009.xiladd (mgr.34457) 310 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:15:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: cluster 2021-03-10T20:15:34.209702+0000 mgr.gibba009.xiladd (mgr.34457) 308 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: audit 2021-03-10T20:15:34.655918+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: cephadm 2021-03-10T20:15:34.767065+0000 mgr.gibba009.xiladd (mgr.34457) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:15:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: audit 2021-03-10T20:15:34.777012+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: audit 2021-03-10T20:15:34.779529+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:15:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[30897]: cephadm 2021-03-10T20:15:34.780160+0000 mgr.gibba009.xiladd (mgr.34457) 310 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:15:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: cluster 2021-03-10T20:15:34.209702+0000 mgr.gibba009.xiladd (mgr.34457) 308 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: audit 2021-03-10T20:15:34.655918+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: cephadm 2021-03-10T20:15:34.767065+0000 mgr.gibba009.xiladd (mgr.34457) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:15:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: audit 2021-03-10T20:15:34.777012+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: audit 2021-03-10T20:15:34.779529+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:15:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:35 gibba004 bash[31878]: cephadm 2021-03-10T20:15:34.780160+0000 mgr.gibba009.xiladd (mgr.34457) 310 : cephadm [INF] Deploying daemon osd.7 on gibba009 2021-03-10T20:15:36.835 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:36 gibba009 systemd[1]: Stopping Ceph osd.7 for 37a23cfe-81db-11eb-9080-001a4aab830c... 2021-03-10T20:15:36.835 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:36 gibba009 bash[17309]: debug 2021-03-10T20:15:36.795+0000 7fe6ab2fb700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:15:36.836 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:36 gibba009 bash[17309]: debug 2021-03-10T20:15:36.795+0000 7fe6ab2fb700 -1 osd.7 101 *** Got signal Terminated *** 2021-03-10T20:15:36.836 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:36 gibba009 bash[17309]: debug 2021-03-10T20:15:36.795+0000 7fe6ab2fb700 -1 osd.7 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:15:37.835 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:37 gibba009 docker[31342]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c-osd.7 2021-03-10T20:15:37.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.211597+0000 mgr.gibba009.xiladd (mgr.34457) 311 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:37.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.925759+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.925910+0000 mon.a (mon.0) 498 : cluster [INF] osd.7 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:15:37.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.926620+0000 mon.a (mon.0) 499 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.926927+0000 mon.a (mon.0) 500 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.927354+0000 mon.a (mon.0) 501 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.927545+0000 mon.a (mon.0) 502 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.928163+0000 mon.a (mon.0) 503 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.928624+0000 mon.a (mon.0) 504 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:36.928775+0000 mon.a (mon.0) 505 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.124776+0000 mon.a (mon.0) 506 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.124974+0000 mon.a (mon.0) 507 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.125604+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.126109+0000 mon.a (mon.0) 509 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.126446+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.126956+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.127492+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.127804+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.127978+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.128474+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.128997+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:37.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.129449+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.129741+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:37.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.129845+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.525689+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:37.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.526253+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.526774+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:37.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.527354+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.527531+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:37.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.527928+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:37.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.528208+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.528835+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:37.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.529028+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.529569+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.529852+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:37.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.530290+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.530356+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:37.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.530531+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:37.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.576496+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:37.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.577809+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:37.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.579932+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:37.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:37 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.580436+0000 mon.a (mon.0) 537 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.211597+0000 mgr.gibba009.xiladd (mgr.34457) 311 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.925759+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.925910+0000 mon.a (mon.0) 498 : cluster [INF] osd.7 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:15:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.926620+0000 mon.a (mon.0) 499 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.926927+0000 mon.a (mon.0) 500 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.927354+0000 mon.a (mon.0) 501 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.927545+0000 mon.a (mon.0) 502 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.928163+0000 mon.a (mon.0) 503 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.928624+0000 mon.a (mon.0) 504 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:36.928775+0000 mon.a (mon.0) 505 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.124776+0000 mon.a (mon.0) 506 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.124974+0000 mon.a (mon.0) 507 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.125604+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.126109+0000 mon.a (mon.0) 509 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.126446+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.126956+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.127492+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.127804+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.127978+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.128474+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.128997+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.129449+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.129741+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.129845+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.525689+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.211597+0000 mgr.gibba009.xiladd (mgr.34457) 311 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:38.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.925759+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.925910+0000 mon.a (mon.0) 498 : cluster [INF] osd.7 failed (root=default,host=gibba009) (connection refused reported by osd.2) 2021-03-10T20:15:38.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.926620+0000 mon.a (mon.0) 499 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.926927+0000 mon.a (mon.0) 500 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.927354+0000 mon.a (mon.0) 501 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.927545+0000 mon.a (mon.0) 502 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.928163+0000 mon.a (mon.0) 503 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.928624+0000 mon.a (mon.0) 504 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:36.928775+0000 mon.a (mon.0) 505 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.124776+0000 mon.a (mon.0) 506 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.124974+0000 mon.a (mon.0) 507 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.125604+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.126109+0000 mon.a (mon.0) 509 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.126446+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.126956+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.127492+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.127804+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.127978+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.128474+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.128997+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.129449+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.129741+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.129845+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.525689+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.526253+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.526774+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.527354+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.527531+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.527928+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.528208+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.528835+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.529028+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.529569+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.529852+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.530290+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.530356+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.530531+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.576496+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.577809+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.579932+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.100 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.580436+0000 mon.a (mon.0) 537 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.101 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.526253+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.101 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.526774+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.101 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.527354+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.102 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.527531+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.102 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.527928+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T20:15:38.102 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.528208+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.103 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.528835+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.103 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.529028+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.103 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.529569+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.103 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.529852+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.104 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.530290+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.104 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.530356+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T20:15:38.104 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.530531+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:15:38.104 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.576496+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:15:38.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.577809+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T20:15:38.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.579932+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:15:38.105 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:37 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.580436+0000 mon.a (mon.0) 537 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:15:38.827 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:38 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.661151+0000 mon.a (mon.0) 538 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:38.828 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:38 gibba009 bash[26136]: cluster 2021-03-10T20:15:37.673674+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T20:15:39.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:38 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.661151+0000 mon.a (mon.0) 538 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:39.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:38 gibba004 bash[30897]: cluster 2021-03-10T20:15:37.673674+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T20:15:39.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:38 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.661151+0000 mon.a (mon.0) 538 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:15:39.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:38 gibba004 bash[31878]: cluster 2021-03-10T20:15:37.673674+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2021-03-10T20:15:39.682 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:39 gibba009 systemd[1]: ceph-37a23cfe-81db-11eb-9080-001a4aab830c@osd.7.service: Succeeded. 2021-03-10T20:15:39.683 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:39 gibba009 systemd[1]: Stopped Ceph osd.7 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:15:39.683 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:39 gibba009 systemd[1]: Started Ceph osd.7 for 37a23cfe-81db-11eb-9080-001a4aab830c. 2021-03-10T20:15:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: cluster 2021-03-10T20:15:38.212539+0000 mgr.gibba009.xiladd (mgr.34457) 312 : cluster [DBG] pgmap v159: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: cluster 2021-03-10T20:15:38.679057+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T20:15:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.582405+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.583539+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.588951+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.590822+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.598299+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.599676+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[30897]: audit 2021-03-10T20:15:39.601180+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: cluster 2021-03-10T20:15:38.212539+0000 mgr.gibba009.xiladd (mgr.34457) 312 : cluster [DBG] pgmap v159: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: cluster 2021-03-10T20:15:38.679057+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T20:15:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.582405+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.583539+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.588951+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.590822+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.598299+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.599676+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:39 gibba004 bash[31878]: audit 2021-03-10T20:15:39.601180+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: cluster 2021-03-10T20:15:38.212539+0000 mgr.gibba009.xiladd (mgr.34457) 312 : cluster [DBG] pgmap v159: 129 pgs: 17 stale+active+clean, 13 active+clean+wait, 99 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:15:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: cluster 2021-03-10T20:15:38.679057+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2021-03-10T20:15:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.582405+0000 mon.c (mon.1) 156 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.583539+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.588951+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.590822+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.598299+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.599676+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:39 gibba009 bash[26136]: audit 2021-03-10T20:15:39.601180+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:15:41.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:40 gibba004 bash[30897]: cluster 2021-03-10T20:15:40.682058+0000 mon.a (mon.0) 544 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:15:41.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:40 gibba004 bash[30897]: cluster 2021-03-10T20:15:40.682156+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: Degraded data redundancy: 19/195 objects degraded (9.744%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:41.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:40 gibba004 bash[31878]: cluster 2021-03-10T20:15:40.682058+0000 mon.a (mon.0) 544 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:15:41.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:40 gibba004 bash[31878]: cluster 2021-03-10T20:15:40.682156+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: Degraded data redundancy: 19/195 objects degraded (9.744%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:41.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[26136]: cluster 2021-03-10T20:15:40.682058+0000 mon.a (mon.0) 544 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:15:41.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[26136]: cluster 2021-03-10T20:15:40.682156+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: Degraded data redundancy: 19/195 objects degraded (9.744%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:41.086 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:15:41.086 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T20:15:41.086 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:15:41.087 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:15:41.087 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:15:41.087 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:15:41.087 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:40 gibba009 bash[31530]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T20:15:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:41 gibba004 bash[30897]: cluster 2021-03-10T20:15:40.214393+0000 mgr.gibba009.xiladd (mgr.34457) 313 : cluster [DBG] pgmap v161: 129 pgs: 7 stale+active+clean, 13 active+undersized+degraded, 5 peering, 13 active+clean+wait, 12 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T20:15:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:41 gibba004 bash[31878]: cluster 2021-03-10T20:15:40.214393+0000 mgr.gibba009.xiladd (mgr.34457) 313 : cluster [DBG] pgmap v161: 129 pgs: 7 stale+active+clean, 13 active+undersized+degraded, 5 peering, 13 active+clean+wait, 12 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T20:15:42.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:41 gibba009 bash[26136]: cluster 2021-03-10T20:15:40.214393+0000 mgr.gibba009.xiladd (mgr.34457) 313 : cluster [DBG] pgmap v161: 129 pgs: 7 stale+active+clean, 13 active+undersized+degraded, 5 peering, 13 active+clean+wait, 12 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 19/195 objects degraded (9.744%) 2021-03-10T20:15:42.584 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:42 gibba009 bash[31660]: debug 2021-03-10T20:15:42.235+0000 7fe6846e7700 1 -- 172.21.2.109:0/1807778274 <== mon.2 v2:172.21.2.109:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5634651084e0 con 0x563465185000 2021-03-10T20:15:43.084 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:42 gibba009 bash[31660]: debug 2021-03-10T20:15:42.803+0000 7fe68c17c080 -1 Falling back to public interface 2021-03-10T20:15:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: cluster 2021-03-10T20:15:42.215246+0000 mgr.gibba009.xiladd (mgr.34457) 314 : cluster [DBG] pgmap v162: 129 pgs: 3 stale+active+clean, 17 active+undersized+degraded, 5 peering, 25 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:15:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.357735+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.555844+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.559381+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.560892+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.562221+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.563532+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.566958+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.573201+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.574822+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.575237+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.580073+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:15:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.581931+0000 mon.c (mon.1) 166 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.582479+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.589009+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:15:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.591643+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.592441+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: cluster 2021-03-10T20:15:42.215246+0000 mgr.gibba009.xiladd (mgr.34457) 314 : cluster [DBG] pgmap v162: 129 pgs: 3 stale+active+clean, 17 active+undersized+degraded, 5 peering, 25 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:15:44.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.357735+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.555844+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.559381+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.560892+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.562221+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.563532+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.566958+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.573201+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.574822+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.575237+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.580073+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:15:44.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.581931+0000 mon.c (mon.1) 166 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.582479+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.589009+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:15:44.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.591643+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.592441+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.602031+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:15:44.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.604710+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.604983+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.608359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:15:44.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.610884+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.611202+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.616434+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:15:44.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.617953+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.618229+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.621190+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:15:44.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.622730+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.623025+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.626245+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:15:44.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.627416+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.627704+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.630773+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:15:44.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.632373+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:44.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[31878]: audit 2021-03-10T20:15:43.632637+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:44.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.602031+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:15:44.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.604710+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.604983+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.608359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:15:44.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.610884+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.611202+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.616434+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:15:44.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.617953+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.618229+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.621190+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:15:44.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.622730+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.623025+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.626245+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:15:44.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.627416+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.627704+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.630773+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:15:44.083 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.632373+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:44.083 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:43 gibba004 bash[30897]: audit 2021-03-10T20:15:43.632637+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:44.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: cluster 2021-03-10T20:15:42.215246+0000 mgr.gibba009.xiladd (mgr.34457) 314 : cluster [DBG] pgmap v162: 129 pgs: 3 stale+active+clean, 17 active+undersized+degraded, 5 peering, 25 active+undersized, 79 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:15:44.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.357735+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.555844+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.559381+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.560892+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.562221+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.563532+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.566958+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.573201+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.574822+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.575237+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:15:44.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.580073+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:15:44.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.581931+0000 mon.c (mon.1) 166 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.582479+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:15:44.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.589009+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:15:44.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.591643+0000 mon.c (mon.1) 167 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.592441+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:15:44.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.602031+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:15:44.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.604710+0000 mon.c (mon.1) 168 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.604983+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:15:44.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.608359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:15:44.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.610884+0000 mon.c (mon.1) 169 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.611202+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:15:44.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.616434+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:15:44.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.617953+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.618229+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:15:44.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.621190+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:15:44.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.622730+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.623025+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:15:44.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.626245+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:15:44.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.627416+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.627704+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:15:44.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.630773+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:15:44.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.632373+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:44.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:43 gibba009 bash[26136]: audit 2021-03-10T20:15:43.632637+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:15:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.360279+0000 mgr.gibba009.xiladd (mgr.34457) 315 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:15:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.559936+0000 mgr.gibba009.xiladd (mgr.34457) 316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.561698+0000 mgr.gibba009.xiladd (mgr.34457) 317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.563068+0000 mgr.gibba009.xiladd (mgr.34457) 318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:45.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.563107+0000 mgr.gibba009.xiladd (mgr.34457) 319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:45.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.564347+0000 mgr.gibba009.xiladd (mgr.34457) 320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:45.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.564466+0000 mgr.gibba009.xiladd (mgr.34457) 321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:45.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.565800+0000 mgr.gibba009.xiladd (mgr.34457) 322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:45.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.567648+0000 mgr.gibba009.xiladd (mgr.34457) 323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:45.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.567687+0000 mgr.gibba009.xiladd (mgr.34457) 324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:45.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.569359+0000 mgr.gibba009.xiladd (mgr.34457) 325 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:15:45.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.632966+0000 mgr.gibba009.xiladd (mgr.34457) 326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:45.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cephadm 2021-03-10T20:15:43.633389+0000 mgr.gibba009.xiladd (mgr.34457) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:15:45.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: audit 2021-03-10T20:15:44.640232+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:15:45.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: cluster 2021-03-10T20:15:44.640284+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T20:15:45.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: audit 2021-03-10T20:15:44.641895+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:45.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[30897]: audit 2021-03-10T20:15:44.645919+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:45.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.360279+0000 mgr.gibba009.xiladd (mgr.34457) 315 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:15:45.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.559936+0000 mgr.gibba009.xiladd (mgr.34457) 316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:45.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.561698+0000 mgr.gibba009.xiladd (mgr.34457) 317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:45.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.563068+0000 mgr.gibba009.xiladd (mgr.34457) 318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:45.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.563107+0000 mgr.gibba009.xiladd (mgr.34457) 319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:45.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.564347+0000 mgr.gibba009.xiladd (mgr.34457) 320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:45.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.564466+0000 mgr.gibba009.xiladd (mgr.34457) 321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:45.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.565800+0000 mgr.gibba009.xiladd (mgr.34457) 322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:45.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.567648+0000 mgr.gibba009.xiladd (mgr.34457) 323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:45.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.567687+0000 mgr.gibba009.xiladd (mgr.34457) 324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:45.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.569359+0000 mgr.gibba009.xiladd (mgr.34457) 325 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:15:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.632966+0000 mgr.gibba009.xiladd (mgr.34457) 326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cephadm 2021-03-10T20:15:43.633389+0000 mgr.gibba009.xiladd (mgr.34457) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:15:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: audit 2021-03-10T20:15:44.640232+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:15:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: cluster 2021-03-10T20:15:44.640284+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T20:15:45.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: audit 2021-03-10T20:15:44.641895+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:45.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:44 gibba004 bash[31878]: audit 2021-03-10T20:15:44.645919+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:45.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.360279+0000 mgr.gibba009.xiladd (mgr.34457) 315 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:15:45.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.559936+0000 mgr.gibba009.xiladd (mgr.34457) 316 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:45.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.561698+0000 mgr.gibba009.xiladd (mgr.34457) 317 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:45.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.563068+0000 mgr.gibba009.xiladd (mgr.34457) 318 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:45.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.563107+0000 mgr.gibba009.xiladd (mgr.34457) 319 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.564347+0000 mgr.gibba009.xiladd (mgr.34457) 320 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.564466+0000 mgr.gibba009.xiladd (mgr.34457) 321 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.565800+0000 mgr.gibba009.xiladd (mgr.34457) 322 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.567648+0000 mgr.gibba009.xiladd (mgr.34457) 323 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.567687+0000 mgr.gibba009.xiladd (mgr.34457) 324 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.569359+0000 mgr.gibba009.xiladd (mgr.34457) 325 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:15:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.632966+0000 mgr.gibba009.xiladd (mgr.34457) 326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cephadm 2021-03-10T20:15:43.633389+0000 mgr.gibba009.xiladd (mgr.34457) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:15:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: audit 2021-03-10T20:15:44.640232+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:15:45.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: cluster 2021-03-10T20:15:44.640284+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2021-03-10T20:15:45.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: audit 2021-03-10T20:15:44.641895+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:45.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:44 gibba009 bash[26136]: audit 2021-03-10T20:15:44.645919+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:15:46.033 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cluster 2021-03-10T20:15:44.216806+0000 mgr.gibba009.xiladd (mgr.34457) 328 : cluster [DBG] pgmap v163: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:46.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cephadm 2021-03-10T20:15:44.642917+0000 mgr.gibba009.xiladd (mgr.34457) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:46.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cephadm 2021-03-10T20:15:44.643663+0000 mgr.gibba009.xiladd (mgr.34457) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:15:46.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cephadm 2021-03-10T20:15:44.648044+0000 mgr.gibba009.xiladd (mgr.34457) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:46.034 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cephadm 2021-03-10T20:15:44.648126+0000 mgr.gibba009.xiladd (mgr.34457) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:46.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cephadm 2021-03-10T20:15:44.648286+0000 mgr.gibba009.xiladd (mgr.34457) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:15:46.035 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:45 gibba009 bash[26136]: cluster 2021-03-10T20:15:44.746257+0000 mon.a (mon.0) 569 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:15:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cluster 2021-03-10T20:15:44.216806+0000 mgr.gibba009.xiladd (mgr.34457) 328 : cluster [DBG] pgmap v163: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cephadm 2021-03-10T20:15:44.642917+0000 mgr.gibba009.xiladd (mgr.34457) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cephadm 2021-03-10T20:15:44.643663+0000 mgr.gibba009.xiladd (mgr.34457) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:15:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cephadm 2021-03-10T20:15:44.648044+0000 mgr.gibba009.xiladd (mgr.34457) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cephadm 2021-03-10T20:15:44.648126+0000 mgr.gibba009.xiladd (mgr.34457) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cephadm 2021-03-10T20:15:44.648286+0000 mgr.gibba009.xiladd (mgr.34457) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:15:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[30897]: cluster 2021-03-10T20:15:44.746257+0000 mon.a (mon.0) 569 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:15:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cluster 2021-03-10T20:15:44.216806+0000 mgr.gibba009.xiladd (mgr.34457) 328 : cluster [DBG] pgmap v163: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cephadm 2021-03-10T20:15:44.642917+0000 mgr.gibba009.xiladd (mgr.34457) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cephadm 2021-03-10T20:15:44.643663+0000 mgr.gibba009.xiladd (mgr.34457) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:15:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cephadm 2021-03-10T20:15:44.648044+0000 mgr.gibba009.xiladd (mgr.34457) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cephadm 2021-03-10T20:15:44.648126+0000 mgr.gibba009.xiladd (mgr.34457) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cephadm 2021-03-10T20:15:44.648286+0000 mgr.gibba009.xiladd (mgr.34457) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:15:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:45 gibba004 bash[31878]: cluster 2021-03-10T20:15:44.746257+0000 mon.a (mon.0) 569 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:15:46.335 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[31660]: debug 2021-03-10T20:15:46.031+0000 7fe68c17c080 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:15:46.335 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[31660]: debug 2021-03-10T20:15:46.035+0000 7fe677c42700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:15:46.336 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[31660]: debug 2021-03-10T20:15:46.035+0000 7fe677c42700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #1:96c0328a:::INTEL_SSDPEL1K375GA_PHKM913400JX375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:15:46.336 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[31660]: debug 2021-03-10T20:15:46.159+0000 7fe68c17c080 -1 osd.7 101 log_to_monitors {default=true} 2021-03-10T20:15:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:46 gibba004 bash[30897]: audit 2021-03-10T20:15:46.166376+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:46 gibba004 bash[30897]: audit 2021-03-10T20:15:46.166388+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:46 gibba004 bash[31878]: audit 2021-03-10T20:15:46.166376+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:46 gibba004 bash[31878]: audit 2021-03-10T20:15:46.166388+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[26136]: audit 2021-03-10T20:15:46.166376+0000 mon.b (mon.2) 7 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[26136]: audit 2021-03-10T20:15:46.166388+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:15:47.086 INFO:journalctl@ceph.osd.7.gibba009.stdout:Mar 10 20:15:46 gibba009 bash[31660]: debug 2021-03-10T20:15:46.771+0000 7fe67de5d700 -1 osd.7 101 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:15:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[30897]: cluster 2021-03-10T20:15:46.217496+0000 mgr.gibba009.xiladd (mgr.34457) 334 : cluster [DBG] pgmap v165: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[30897]: audit 2021-03-10T20:15:46.766185+0000 mon.a (mon.0) 571 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:15:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[30897]: cluster 2021-03-10T20:15:46.766362+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2021-03-10T20:15:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[30897]: audit 2021-03-10T20:15:46.767696+0000 mon.a (mon.0) 573 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[30897]: audit 2021-03-10T20:15:46.768302+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[31878]: cluster 2021-03-10T20:15:46.217496+0000 mgr.gibba009.xiladd (mgr.34457) 334 : cluster [DBG] pgmap v165: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[31878]: audit 2021-03-10T20:15:46.766185+0000 mon.a (mon.0) 571 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:15:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[31878]: cluster 2021-03-10T20:15:46.766362+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2021-03-10T20:15:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[31878]: audit 2021-03-10T20:15:46.767696+0000 mon.a (mon.0) 573 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:47 gibba004 bash[31878]: audit 2021-03-10T20:15:46.768302+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:47 gibba009 bash[26136]: cluster 2021-03-10T20:15:46.217496+0000 mgr.gibba009.xiladd (mgr.34457) 334 : cluster [DBG] pgmap v165: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:47 gibba009 bash[26136]: audit 2021-03-10T20:15:46.766185+0000 mon.a (mon.0) 571 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:15:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:47 gibba009 bash[26136]: cluster 2021-03-10T20:15:46.766362+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e105: 8 total, 7 up, 8 in 2021-03-10T20:15:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:47 gibba009 bash[26136]: audit 2021-03-10T20:15:46.767696+0000 mon.a (mon.0) 573 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:47 gibba009 bash[26136]: audit 2021-03-10T20:15:46.768302+0000 mon.b (mon.2) 8 : audit [INF] from='osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba009", "root=default"]}]: dispatch 2021-03-10T20:15:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[30897]: cluster 2021-03-10T20:15:47.763105+0000 mon.a (mon.0) 574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[30897]: cluster 2021-03-10T20:15:47.773495+0000 mon.a (mon.0) 575 : cluster [INF] osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218] boot 2021-03-10T20:15:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[30897]: cluster 2021-03-10T20:15:47.773546+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T20:15:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[30897]: audit 2021-03-10T20:15:47.774205+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:15:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[30897]: cluster 2021-03-10T20:15:48.516958+0000 mon.a (mon.0) 577 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[31878]: cluster 2021-03-10T20:15:47.763105+0000 mon.a (mon.0) 574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[31878]: cluster 2021-03-10T20:15:47.773495+0000 mon.a (mon.0) 575 : cluster [INF] osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218] boot 2021-03-10T20:15:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[31878]: cluster 2021-03-10T20:15:47.773546+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T20:15:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[31878]: audit 2021-03-10T20:15:47.774205+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:15:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:48 gibba004 bash[31878]: cluster 2021-03-10T20:15:48.516958+0000 mon.a (mon.0) 577 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:49.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:48 gibba009 bash[26136]: cluster 2021-03-10T20:15:47.763105+0000 mon.a (mon.0) 574 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:15:49.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:48 gibba009 bash[26136]: cluster 2021-03-10T20:15:47.773495+0000 mon.a (mon.0) 575 : cluster [INF] osd.7 [v2:172.21.2.109:6824/3590035218,v1:172.21.2.109:6825/3590035218] boot 2021-03-10T20:15:49.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:48 gibba009 bash[26136]: cluster 2021-03-10T20:15:47.773546+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-03-10T20:15:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:48 gibba009 bash[26136]: audit 2021-03-10T20:15:47.774205+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:15:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:48 gibba009 bash[26136]: cluster 2021-03-10T20:15:48.516958+0000 mon.a (mon.0) 577 : cluster [WRN] Health check update: Degraded data redundancy: 31/195 objects degraded (15.897%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:49 gibba004 bash[30897]: cluster 2021-03-10T20:15:48.218760+0000 mgr.gibba009.xiladd (mgr.34457) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:50.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:49 gibba004 bash[30897]: cluster 2021-03-10T20:15:48.777917+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-03-10T20:15:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:49 gibba004 bash[31878]: cluster 2021-03-10T20:15:48.218760+0000 mgr.gibba009.xiladd (mgr.34457) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:49 gibba004 bash[31878]: cluster 2021-03-10T20:15:48.777917+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-03-10T20:15:50.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:49 gibba009 bash[26136]: cluster 2021-03-10T20:15:48.218760+0000 mgr.gibba009.xiladd (mgr.34457) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:15:50.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:49 gibba009 bash[26136]: cluster 2021-03-10T20:15:48.777917+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-03-10T20:15:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:51 gibba004 bash[30897]: cluster 2021-03-10T20:15:50.220568+0000 mgr.gibba009.xiladd (mgr.34457) 336 : cluster [DBG] pgmap v170: 129 pgs: 4 peering, 15 active+undersized+degraded, 22 active+undersized, 88 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:15:52.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:51 gibba004 bash[31878]: cluster 2021-03-10T20:15:50.220568+0000 mgr.gibba009.xiladd (mgr.34457) 336 : cluster [DBG] pgmap v170: 129 pgs: 4 peering, 15 active+undersized+degraded, 22 active+undersized, 88 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:15:52.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:51 gibba009 bash[26136]: cluster 2021-03-10T20:15:50.220568+0000 mgr.gibba009.xiladd (mgr.34457) 336 : cluster [DBG] pgmap v170: 129 pgs: 4 peering, 15 active+undersized+degraded, 22 active+undersized, 88 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:15:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:53 gibba004 bash[30897]: cluster 2021-03-10T20:15:52.222403+0000 mgr.gibba009.xiladd (mgr.34457) 337 : cluster [DBG] pgmap v171: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 4 active+undersized, 101 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:54.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:53 gibba004 bash[30897]: cluster 2021-03-10T20:15:53.519791+0000 mon.a (mon.0) 579 : cluster [WRN] Health check update: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:53 gibba004 bash[31878]: cluster 2021-03-10T20:15:52.222403+0000 mgr.gibba009.xiladd (mgr.34457) 337 : cluster [DBG] pgmap v171: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 4 active+undersized, 101 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:53 gibba004 bash[31878]: cluster 2021-03-10T20:15:53.519791+0000 mon.a (mon.0) 579 : cluster [WRN] Health check update: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:53 gibba009 bash[26136]: cluster 2021-03-10T20:15:52.222403+0000 mgr.gibba009.xiladd (mgr.34457) 337 : cluster [DBG] pgmap v171: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 4 active+undersized, 101 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:15:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:53 gibba009 bash[26136]: cluster 2021-03-10T20:15:53.519791+0000 mon.a (mon.0) 579 : cluster [WRN] Health check update: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:15:55.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:54 gibba004 bash[30897]: cluster 2021-03-10T20:15:54.802475+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:15:55.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:54 gibba004 bash[31878]: cluster 2021-03-10T20:15:54.802475+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:15:55.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:54 gibba009 bash[26136]: cluster 2021-03-10T20:15:54.802475+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:15:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:55 gibba004 bash[30897]: cluster 2021-03-10T20:15:54.223689+0000 mgr.gibba009.xiladd (mgr.34457) 338 : cluster [DBG] pgmap v172: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:56.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:55 gibba004 bash[31878]: cluster 2021-03-10T20:15:54.223689+0000 mgr.gibba009.xiladd (mgr.34457) 338 : cluster [DBG] pgmap v172: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:56.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:55 gibba009 bash[26136]: cluster 2021-03-10T20:15:54.223689+0000 mgr.gibba009.xiladd (mgr.34457) 338 : cluster [DBG] pgmap v172: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:57 gibba004 bash[30897]: cluster 2021-03-10T20:15:56.225496+0000 mgr.gibba009.xiladd (mgr.34457) 339 : cluster [DBG] pgmap v173: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:58.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:57 gibba004 bash[31878]: cluster 2021-03-10T20:15:56.225496+0000 mgr.gibba009.xiladd (mgr.34457) 339 : cluster [DBG] pgmap v173: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:58.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:57 gibba009 bash[26136]: cluster 2021-03-10T20:15:56.225496+0000 mgr.gibba009.xiladd (mgr.34457) 339 : cluster [DBG] pgmap v173: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:59 gibba009 bash[26136]: cluster 2021-03-10T20:15:58.227023+0000 mgr.gibba009.xiladd (mgr.34457) 340 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:15:59 gibba009 bash[26136]: audit 2021-03-10T20:15:59.670942+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:59 gibba004 bash[30897]: cluster 2021-03-10T20:15:58.227023+0000 mgr.gibba009.xiladd (mgr.34457) 340 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:15:59 gibba004 bash[30897]: audit 2021-03-10T20:15:59.670942+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:59 gibba004 bash[31878]: cluster 2021-03-10T20:15:58.227023+0000 mgr.gibba009.xiladd (mgr.34457) 340 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:15:59 gibba004 bash[31878]: audit 2021-03-10T20:15:59.670942+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:01.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:00 gibba004 bash[30897]: cephadm 2021-03-10T20:15:59.661370+0000 mgr.gibba009.xiladd (mgr.34457) 341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:01.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:00 gibba004 bash[31878]: cephadm 2021-03-10T20:15:59.661370+0000 mgr.gibba009.xiladd (mgr.34457) 341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:01.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:00 gibba009 bash[26136]: cephadm 2021-03-10T20:15:59.661370+0000 mgr.gibba009.xiladd (mgr.34457) 341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:01.736 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:16:01.969 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:16:01.969 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (4m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:16:01.969 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (10m) 18s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:16:01.970 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (5m) 18s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:16:01.970 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (5m) 18s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:16:01.970 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (4m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:16:01.970 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (4m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:16:01.971 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (4m) 18s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:16:01.971 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:16:01.971 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (10m) 2m ago 10m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:16:01.971 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (10m) 18s ago 10m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:16:01.972 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:16:01.972 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:16:01.972 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:16:01.972 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:16:01.972 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (97s) 18s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:16:01.973 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (71s) 18s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:16:01.973 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (46s) 18s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:16:01.973 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (20s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:16:01.973 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (9m) 18s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:16:01.973 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:01.974 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 18s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:02.222 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:16:02.222 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:16:02.222 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:02.223 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:02.223 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:16:02.223 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:02.223 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:02.224 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:16:02.224 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:16:02.224 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:02.224 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:16:02.225 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:16:02.225 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:16:02.225 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:16:02.225 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:16:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:01 gibba004 bash[30897]: cluster 2021-03-10T20:16:00.228743+0000 mgr.gibba009.xiladd (mgr.34457) 342 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:02.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:01 gibba004 bash[31878]: cluster 2021-03-10T20:16:00.228743+0000 mgr.gibba009.xiladd (mgr.34457) 342 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:01 gibba009 bash[26136]: cluster 2021-03-10T20:16:00.228743+0000 mgr.gibba009.xiladd (mgr.34457) 342 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:03.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[30897]: audit 2021-03-10T20:16:01.728788+0000 mgr.gibba009.xiladd (mgr.34457) 343 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[30897]: audit 2021-03-10T20:16:01.959713+0000 mgr.gibba009.xiladd (mgr.34457) 344 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[30897]: audit 2021-03-10T20:16:02.222623+0000 mon.a (mon.0) 582 : audit [DBG] from='client.? 172.21.2.104:0/3956054165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:03.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[31878]: audit 2021-03-10T20:16:01.728788+0000 mgr.gibba009.xiladd (mgr.34457) 343 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[31878]: audit 2021-03-10T20:16:01.959713+0000 mgr.gibba009.xiladd (mgr.34457) 344 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:02 gibba004 bash[31878]: audit 2021-03-10T20:16:02.222623+0000 mon.a (mon.0) 582 : audit [DBG] from='client.? 172.21.2.104:0/3956054165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:02 gibba009 bash[26136]: audit 2021-03-10T20:16:01.728788+0000 mgr.gibba009.xiladd (mgr.34457) 343 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:02 gibba009 bash[26136]: audit 2021-03-10T20:16:01.959713+0000 mgr.gibba009.xiladd (mgr.34457) 344 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:02 gibba009 bash[26136]: audit 2021-03-10T20:16:02.222623+0000 mon.a (mon.0) 582 : audit [DBG] from='client.? 172.21.2.104:0/3956054165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:03 gibba004 bash[30897]: cluster 2021-03-10T20:16:02.230076+0000 mgr.gibba009.xiladd (mgr.34457) 345 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:04.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:03 gibba004 bash[31878]: cluster 2021-03-10T20:16:02.230076+0000 mgr.gibba009.xiladd (mgr.34457) 345 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:04.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:03 gibba009 bash[26136]: cluster 2021-03-10T20:16:02.230076+0000 mgr.gibba009.xiladd (mgr.34457) 345 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:05 gibba004 bash[30897]: cluster 2021-03-10T20:16:04.231358+0000 mgr.gibba009.xiladd (mgr.34457) 346 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:06.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:05 gibba004 bash[31878]: cluster 2021-03-10T20:16:04.231358+0000 mgr.gibba009.xiladd (mgr.34457) 346 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:06.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:05 gibba009 bash[26136]: cluster 2021-03-10T20:16:04.231358+0000 mgr.gibba009.xiladd (mgr.34457) 346 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:07 gibba004 bash[30897]: cluster 2021-03-10T20:16:06.233236+0000 mgr.gibba009.xiladd (mgr.34457) 347 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:08.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:07 gibba004 bash[31878]: cluster 2021-03-10T20:16:06.233236+0000 mgr.gibba009.xiladd (mgr.34457) 347 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:07 gibba009 bash[26136]: cluster 2021-03-10T20:16:06.233236+0000 mgr.gibba009.xiladd (mgr.34457) 347 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:09 gibba004 bash[30897]: cluster 2021-03-10T20:16:08.234520+0000 mgr.gibba009.xiladd (mgr.34457) 348 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:10.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:09 gibba004 bash[31878]: cluster 2021-03-10T20:16:08.234520+0000 mgr.gibba009.xiladd (mgr.34457) 348 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:10.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:09 gibba009 bash[26136]: cluster 2021-03-10T20:16:08.234520+0000 mgr.gibba009.xiladd (mgr.34457) 348 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:11 gibba004 bash[30897]: cluster 2021-03-10T20:16:10.236312+0000 mgr.gibba009.xiladd (mgr.34457) 349 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:11 gibba004 bash[31878]: cluster 2021-03-10T20:16:10.236312+0000 mgr.gibba009.xiladd (mgr.34457) 349 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:11 gibba009 bash[26136]: cluster 2021-03-10T20:16:10.236312+0000 mgr.gibba009.xiladd (mgr.34457) 349 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:13 gibba004 bash[30897]: cluster 2021-03-10T20:16:12.237624+0000 mgr.gibba009.xiladd (mgr.34457) 350 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:13 gibba004 bash[31878]: cluster 2021-03-10T20:16:12.237624+0000 mgr.gibba009.xiladd (mgr.34457) 350 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:14.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:13 gibba009 bash[26136]: cluster 2021-03-10T20:16:12.237624+0000 mgr.gibba009.xiladd (mgr.34457) 350 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:15 gibba004 bash[30897]: cluster 2021-03-10T20:16:14.238886+0000 mgr.gibba009.xiladd (mgr.34457) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:15 gibba004 bash[30897]: cephadm 2021-03-10T20:16:14.677202+0000 mgr.gibba009.xiladd (mgr.34457) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:15 gibba004 bash[31878]: cluster 2021-03-10T20:16:14.238886+0000 mgr.gibba009.xiladd (mgr.34457) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:15 gibba004 bash[31878]: cephadm 2021-03-10T20:16:14.677202+0000 mgr.gibba009.xiladd (mgr.34457) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:15 gibba009 bash[26136]: cluster 2021-03-10T20:16:14.238886+0000 mgr.gibba009.xiladd (mgr.34457) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:15 gibba009 bash[26136]: cephadm 2021-03-10T20:16:14.677202+0000 mgr.gibba009.xiladd (mgr.34457) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:17 gibba004 bash[30897]: cluster 2021-03-10T20:16:16.240754+0000 mgr.gibba009.xiladd (mgr.34457) 353 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:18.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:17 gibba004 bash[31878]: cluster 2021-03-10T20:16:16.240754+0000 mgr.gibba009.xiladd (mgr.34457) 353 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:18.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:17 gibba009 bash[26136]: cluster 2021-03-10T20:16:16.240754+0000 mgr.gibba009.xiladd (mgr.34457) 353 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:19 gibba004 bash[30897]: cluster 2021-03-10T20:16:18.241971+0000 mgr.gibba009.xiladd (mgr.34457) 354 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:19 gibba004 bash[31878]: cluster 2021-03-10T20:16:18.241971+0000 mgr.gibba009.xiladd (mgr.34457) 354 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:20.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:19 gibba009 bash[26136]: cluster 2021-03-10T20:16:18.241971+0000 mgr.gibba009.xiladd (mgr.34457) 354 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:21 gibba004 bash[30897]: cluster 2021-03-10T20:16:20.243725+0000 mgr.gibba009.xiladd (mgr.34457) 355 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:21 gibba004 bash[31878]: cluster 2021-03-10T20:16:20.243725+0000 mgr.gibba009.xiladd (mgr.34457) 355 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:21 gibba009 bash[26136]: cluster 2021-03-10T20:16:20.243725+0000 mgr.gibba009.xiladd (mgr.34457) 355 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:23 gibba004 bash[30897]: cluster 2021-03-10T20:16:22.245295+0000 mgr.gibba009.xiladd (mgr.34457) 356 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:23 gibba004 bash[31878]: cluster 2021-03-10T20:16:22.245295+0000 mgr.gibba009.xiladd (mgr.34457) 356 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:23 gibba009 bash[26136]: cluster 2021-03-10T20:16:22.245295+0000 mgr.gibba009.xiladd (mgr.34457) 356 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:25 gibba004 bash[30897]: cluster 2021-03-10T20:16:24.246566+0000 mgr.gibba009.xiladd (mgr.34457) 357 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:25 gibba004 bash[31878]: cluster 2021-03-10T20:16:24.246566+0000 mgr.gibba009.xiladd (mgr.34457) 357 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:25 gibba009 bash[26136]: cluster 2021-03-10T20:16:24.246566+0000 mgr.gibba009.xiladd (mgr.34457) 357 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:27.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:27 gibba004 bash[30897]: cluster 2021-03-10T20:16:26.248459+0000 mgr.gibba009.xiladd (mgr.34457) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:27.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:27 gibba004 bash[31878]: cluster 2021-03-10T20:16:26.248459+0000 mgr.gibba009.xiladd (mgr.34457) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:27.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:27 gibba009 bash[26136]: cluster 2021-03-10T20:16:26.248459+0000 mgr.gibba009.xiladd (mgr.34457) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:29.834 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:29 gibba009 bash[26136]: cluster 2021-03-10T20:16:28.249827+0000 mgr.gibba009.xiladd (mgr.34457) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:29 gibba004 bash[30897]: cluster 2021-03-10T20:16:28.249827+0000 mgr.gibba009.xiladd (mgr.34457) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:30.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:29 gibba004 bash[31878]: cluster 2021-03-10T20:16:28.249827+0000 mgr.gibba009.xiladd (mgr.34457) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:30.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:30 gibba009 bash[26136]: cephadm 2021-03-10T20:16:29.689484+0000 mgr.gibba009.xiladd (mgr.34457) 360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:31.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:30 gibba004 bash[30897]: cephadm 2021-03-10T20:16:29.689484+0000 mgr.gibba009.xiladd (mgr.34457) 360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:31.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:30 gibba004 bash[31878]: cephadm 2021-03-10T20:16:29.689484+0000 mgr.gibba009.xiladd (mgr.34457) 360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:31.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:31 gibba009 bash[26136]: cluster 2021-03-10T20:16:30.251581+0000 mgr.gibba009.xiladd (mgr.34457) 361 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:31 gibba004 bash[30897]: cluster 2021-03-10T20:16:30.251581+0000 mgr.gibba009.xiladd (mgr.34457) 361 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:31 gibba004 bash[31878]: cluster 2021-03-10T20:16:30.251581+0000 mgr.gibba009.xiladd (mgr.34457) 361 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.470 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:16:32.699 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:16:32.700 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (5m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:16:32.700 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (10m) 49s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:16:32.700 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (5m) 49s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:16:32.701 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (6m) 49s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:16:32.701 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:16:32.701 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:16:32.701 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (4m) 49s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:16:32.702 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:16:32.702 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (10m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:16:32.702 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (10m) 49s ago 11m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:16:32.702 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:16:32.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:16:32.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:16:32.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:16:32.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (2m) 49s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:16:32.704 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (102s) 49s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:16:32.704 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (76s) 49s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:16:32.704 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (51s) 49s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:16:32.705 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (10m) 49s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:16:32.705 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:32.705 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 49s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:32.946 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:16:32.947 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:16:32.947 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:32.947 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:32.947 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:16:32.948 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:32.948 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:32.948 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:16:32.948 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:16:32.949 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:16:32.949 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:16:32.949 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:16:32.949 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:16:32.949 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:16:32.950 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:16:33.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:33 gibba009 bash[26136]: cluster 2021-03-10T20:16:32.253051+0000 mgr.gibba009.xiladd (mgr.34457) 362 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:33.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:33 gibba009 bash[26136]: audit 2021-03-10T20:16:32.461603+0000 mgr.gibba009.xiladd (mgr.34457) 363 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:33.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:33 gibba009 bash[26136]: audit 2021-03-10T20:16:32.688614+0000 mgr.gibba009.xiladd (mgr.34457) 364 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:33.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:33 gibba009 bash[26136]: audit 2021-03-10T20:16:32.947108+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.104:0/233632433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[30897]: cluster 2021-03-10T20:16:32.253051+0000 mgr.gibba009.xiladd (mgr.34457) 362 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[30897]: audit 2021-03-10T20:16:32.461603+0000 mgr.gibba009.xiladd (mgr.34457) 363 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:34.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[30897]: audit 2021-03-10T20:16:32.688614+0000 mgr.gibba009.xiladd (mgr.34457) 364 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:34.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[30897]: audit 2021-03-10T20:16:32.947108+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.104:0/233632433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:34.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[31878]: cluster 2021-03-10T20:16:32.253051+0000 mgr.gibba009.xiladd (mgr.34457) 362 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[31878]: audit 2021-03-10T20:16:32.461603+0000 mgr.gibba009.xiladd (mgr.34457) 363 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[31878]: audit 2021-03-10T20:16:32.688614+0000 mgr.gibba009.xiladd (mgr.34457) 364 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:33 gibba004 bash[31878]: audit 2021-03-10T20:16:32.947108+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.104:0/233632433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:35 gibba004 bash[30897]: cluster 2021-03-10T20:16:34.254298+0000 mgr.gibba009.xiladd (mgr.34457) 365 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:36.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:35 gibba004 bash[31878]: cluster 2021-03-10T20:16:34.254298+0000 mgr.gibba009.xiladd (mgr.34457) 365 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:35 gibba009 bash[26136]: cluster 2021-03-10T20:16:34.254298+0000 mgr.gibba009.xiladd (mgr.34457) 365 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:37 gibba004 bash[30897]: cluster 2021-03-10T20:16:36.256168+0000 mgr.gibba009.xiladd (mgr.34457) 366 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:37 gibba004 bash[31878]: cluster 2021-03-10T20:16:36.256168+0000 mgr.gibba009.xiladd (mgr.34457) 366 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:37 gibba009 bash[26136]: cluster 2021-03-10T20:16:36.256168+0000 mgr.gibba009.xiladd (mgr.34457) 366 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: cluster 2021-03-10T20:16:38.257639+0000 mgr.gibba009.xiladd (mgr.34457) 367 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.483113+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.483827+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.484297+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.484497+0000 mon.c (mon.1) 179 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.485302+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.485498+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.486734+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.487586+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.589850+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.591012+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.601151+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[30897]: audit 2021-03-10T20:16:39.602333+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: cluster 2021-03-10T20:16:38.257639+0000 mgr.gibba009.xiladd (mgr.34457) 367 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.483113+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.483827+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.484297+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.484497+0000 mon.c (mon.1) 179 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.485302+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.485498+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.486734+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.487586+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.589850+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.591012+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.601151+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:40.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:39 gibba004 bash[31878]: audit 2021-03-10T20:16:39.602333+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: cluster 2021-03-10T20:16:38.257639+0000 mgr.gibba009.xiladd (mgr.34457) 367 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.483113+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.483827+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.484297+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:16:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.484497+0000 mon.c (mon.1) 179 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.485302+0000 mon.c (mon.1) 180 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.485498+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.486734+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:16:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.487586+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:16:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.589850+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.591012+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.601151+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:39 gibba009 bash[26136]: audit 2021-03-10T20:16:39.602333+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:41 gibba004 bash[30897]: cluster 2021-03-10T20:16:40.259420+0000 mgr.gibba009.xiladd (mgr.34457) 368 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:41 gibba004 bash[31878]: cluster 2021-03-10T20:16:40.259420+0000 mgr.gibba009.xiladd (mgr.34457) 368 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:41 gibba009 bash[26136]: cluster 2021-03-10T20:16:40.259420+0000 mgr.gibba009.xiladd (mgr.34457) 368 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:43 gibba004 bash[30897]: cluster 2021-03-10T20:16:42.260942+0000 mgr.gibba009.xiladd (mgr.34457) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:43 gibba004 bash[31878]: cluster 2021-03-10T20:16:42.260942+0000 mgr.gibba009.xiladd (mgr.34457) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:43 gibba009 bash[26136]: cluster 2021-03-10T20:16:42.260942+0000 mgr.gibba009.xiladd (mgr.34457) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cluster 2021-03-10T20:16:44.262523+0000 mgr.gibba009.xiladd (mgr.34457) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.704196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.708664+0000 mgr.gibba009.xiladd (mgr.34457) 371 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:16:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.709673+0000 mgr.gibba009.xiladd (mgr.34457) 372 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:16:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.908544+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.912684+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.912913+0000 mgr.gibba009.xiladd (mgr.34457) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.915098+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.915752+0000 mgr.gibba009.xiladd (mgr.34457) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.917751+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.918314+0000 mgr.gibba009.xiladd (mgr.34457) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.918356+0000 mgr.gibba009.xiladd (mgr.34457) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:46.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.920115+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.920832+0000 mgr.gibba009.xiladd (mgr.34457) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.920870+0000 mgr.gibba009.xiladd (mgr.34457) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.922859+0000 mgr.gibba009.xiladd (mgr.34457) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.925571+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.926194+0000 mgr.gibba009.xiladd (mgr.34457) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:46.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.926231+0000 mgr.gibba009.xiladd (mgr.34457) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:46.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: audit 2021-03-10T20:16:44.928120+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cluster 2021-03-10T20:16:44.262523+0000 mgr.gibba009.xiladd (mgr.34457) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:46.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.704196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.708664+0000 mgr.gibba009.xiladd (mgr.34457) 371 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:16:46.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.709673+0000 mgr.gibba009.xiladd (mgr.34457) 372 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:16:46.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.908544+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.912684+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.912913+0000 mgr.gibba009.xiladd (mgr.34457) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.915098+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.915752+0000 mgr.gibba009.xiladd (mgr.34457) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.917751+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.918314+0000 mgr.gibba009.xiladd (mgr.34457) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.918356+0000 mgr.gibba009.xiladd (mgr.34457) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:46.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.920115+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.920832+0000 mgr.gibba009.xiladd (mgr.34457) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.920870+0000 mgr.gibba009.xiladd (mgr.34457) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.922859+0000 mgr.gibba009.xiladd (mgr.34457) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.925571+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.926194+0000 mgr.gibba009.xiladd (mgr.34457) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:46.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.926231+0000 mgr.gibba009.xiladd (mgr.34457) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:46.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: audit 2021-03-10T20:16:44.928120+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.928414+0000 mgr.gibba009.xiladd (mgr.34457) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:46.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.928861+0000 mgr.gibba009.xiladd (mgr.34457) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:46.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.931143+0000 mgr.gibba009.xiladd (mgr.34457) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:46.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.931183+0000 mgr.gibba009.xiladd (mgr.34457) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:46.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[30897]: cephadm 2021-03-10T20:16:44.931318+0000 mgr.gibba009.xiladd (mgr.34457) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:46.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.928414+0000 mgr.gibba009.xiladd (mgr.34457) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:46.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.928861+0000 mgr.gibba009.xiladd (mgr.34457) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:46.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.931143+0000 mgr.gibba009.xiladd (mgr.34457) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:46.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.931183+0000 mgr.gibba009.xiladd (mgr.34457) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:46.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:45 gibba004 bash[31878]: cephadm 2021-03-10T20:16:44.931318+0000 mgr.gibba009.xiladd (mgr.34457) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cluster 2021-03-10T20:16:44.262523+0000 mgr.gibba009.xiladd (mgr.34457) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.704196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.708664+0000 mgr.gibba009.xiladd (mgr.34457) 371 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:16:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.709673+0000 mgr.gibba009.xiladd (mgr.34457) 372 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:16:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.908544+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:16:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.912684+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.912913+0000 mgr.gibba009.xiladd (mgr.34457) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.915098+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.915752+0000 mgr.gibba009.xiladd (mgr.34457) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.917751+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.918314+0000 mgr.gibba009.xiladd (mgr.34457) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.918356+0000 mgr.gibba009.xiladd (mgr.34457) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.920115+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.920832+0000 mgr.gibba009.xiladd (mgr.34457) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.920870+0000 mgr.gibba009.xiladd (mgr.34457) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.922859+0000 mgr.gibba009.xiladd (mgr.34457) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.925571+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.926194+0000 mgr.gibba009.xiladd (mgr.34457) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.926231+0000 mgr.gibba009.xiladd (mgr.34457) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: audit 2021-03-10T20:16:44.928120+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.928414+0000 mgr.gibba009.xiladd (mgr.34457) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:46.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.928861+0000 mgr.gibba009.xiladd (mgr.34457) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:46.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.931143+0000 mgr.gibba009.xiladd (mgr.34457) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:46.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.931183+0000 mgr.gibba009.xiladd (mgr.34457) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:46.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:45 gibba009 bash[26136]: cephadm 2021-03-10T20:16:44.931318+0000 mgr.gibba009.xiladd (mgr.34457) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:16:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:47 gibba004 bash[30897]: cluster 2021-03-10T20:16:46.264324+0000 mgr.gibba009.xiladd (mgr.34457) 387 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:48.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:47 gibba004 bash[31878]: cluster 2021-03-10T20:16:46.264324+0000 mgr.gibba009.xiladd (mgr.34457) 387 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:47 gibba009 bash[26136]: cluster 2021-03-10T20:16:46.264324+0000 mgr.gibba009.xiladd (mgr.34457) 387 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:50.061 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:49 gibba004 bash[31878]: cluster 2021-03-10T20:16:48.265938+0000 mgr.gibba009.xiladd (mgr.34457) 388 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:50.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:49 gibba004 bash[30897]: cluster 2021-03-10T20:16:48.265938+0000 mgr.gibba009.xiladd (mgr.34457) 388 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:50.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:49 gibba009 bash[26136]: cluster 2021-03-10T20:16:48.265938+0000 mgr.gibba009.xiladd (mgr.34457) 388 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:51 gibba004 bash[30897]: cluster 2021-03-10T20:16:50.267666+0000 mgr.gibba009.xiladd (mgr.34457) 389 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:51 gibba004 bash[31878]: cluster 2021-03-10T20:16:50.267666+0000 mgr.gibba009.xiladd (mgr.34457) 389 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:51 gibba009 bash[26136]: cluster 2021-03-10T20:16:50.267666+0000 mgr.gibba009.xiladd (mgr.34457) 389 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:53 gibba004 bash[30897]: cluster 2021-03-10T20:16:52.269314+0000 mgr.gibba009.xiladd (mgr.34457) 390 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:54.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:53 gibba004 bash[31878]: cluster 2021-03-10T20:16:52.269314+0000 mgr.gibba009.xiladd (mgr.34457) 390 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:53 gibba009 bash[26136]: cluster 2021-03-10T20:16:52.269314+0000 mgr.gibba009.xiladd (mgr.34457) 390 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:56.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:55 gibba004 bash[30897]: cluster 2021-03-10T20:16:54.270616+0000 mgr.gibba009.xiladd (mgr.34457) 391 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:56.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:55 gibba004 bash[31878]: cluster 2021-03-10T20:16:54.270616+0000 mgr.gibba009.xiladd (mgr.34457) 391 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:56.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:55 gibba009 bash[26136]: cluster 2021-03-10T20:16:54.270616+0000 mgr.gibba009.xiladd (mgr.34457) 391 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:57 gibba004 bash[30897]: cluster 2021-03-10T20:16:56.272454+0000 mgr.gibba009.xiladd (mgr.34457) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:58.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:57 gibba004 bash[31878]: cluster 2021-03-10T20:16:56.272454+0000 mgr.gibba009.xiladd (mgr.34457) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:58.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:57 gibba009 bash[26136]: cluster 2021-03-10T20:16:56.272454+0000 mgr.gibba009.xiladd (mgr.34457) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:59.946 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:16:59 gibba009 bash[26136]: cluster 2021-03-10T20:16:58.273705+0000 mgr.gibba009.xiladd (mgr.34457) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:00.061 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:16:59 gibba004 bash[31878]: cluster 2021-03-10T20:16:58.273705+0000 mgr.gibba009.xiladd (mgr.34457) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:00.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:16:59 gibba004 bash[30897]: cluster 2021-03-10T20:16:58.273705+0000 mgr.gibba009.xiladd (mgr.34457) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:01.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:00 gibba004 bash[30897]: cephadm 2021-03-10T20:16:59.947368+0000 mgr.gibba009.xiladd (mgr.34457) 394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:01.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:00 gibba004 bash[31878]: cephadm 2021-03-10T20:16:59.947368+0000 mgr.gibba009.xiladd (mgr.34457) 394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:01.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:00 gibba009 bash[26136]: cephadm 2021-03-10T20:16:59.947368+0000 mgr.gibba009.xiladd (mgr.34457) 394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:01 gibba004 bash[30897]: cluster 2021-03-10T20:17:00.275205+0000 mgr.gibba009.xiladd (mgr.34457) 395 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:02.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:01 gibba004 bash[31878]: cluster 2021-03-10T20:17:00.275205+0000 mgr.gibba009.xiladd (mgr.34457) 395 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:01 gibba009 bash[26136]: cluster 2021-03-10T20:17:00.275205+0000 mgr.gibba009.xiladd (mgr.34457) 395 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:03.189 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:17:03.418 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:17:03.419 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (5m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:17:03.419 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (11m) 80s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:17:03.419 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (6m) 80s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:17:03.420 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (6m) 80s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:17:03.420 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (5m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:17:03.420 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (5m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:17:03.420 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (5m) 80s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:17:03.420 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:17:03.421 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (11m) 3m ago 11m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:17:03.421 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (11m) 80s ago 11m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:17:03.421 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:17:03.421 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:17:03.422 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:17:03.422 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:17:03.422 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (2m) 80s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:17:03.422 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (2m) 80s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:17:03.422 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (107s) 80s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:17:03.423 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (82s) 80s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:17:03.423 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (10m) 80s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:17:03.423 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:03.423 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 80s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:03.672 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:17:03.673 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:17:03.673 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:03.673 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:03.673 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:17:03.674 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:03.674 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:03.674 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:17:03.674 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:17:03.675 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:03.675 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:17:03.675 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:17:03.675 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:17:03.675 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:17:03.676 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:17:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:03 gibba004 bash[30897]: cluster 2021-03-10T20:17:02.276816+0000 mgr.gibba009.xiladd (mgr.34457) 396 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:04.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:03 gibba004 bash[30897]: audit 2021-03-10T20:17:03.672913+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.104:0/2397662315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:03 gibba004 bash[31878]: cluster 2021-03-10T20:17:02.276816+0000 mgr.gibba009.xiladd (mgr.34457) 396 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:03 gibba004 bash[31878]: audit 2021-03-10T20:17:03.672913+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.104:0/2397662315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:03 gibba009 bash[26136]: cluster 2021-03-10T20:17:02.276816+0000 mgr.gibba009.xiladd (mgr.34457) 396 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:04.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:03 gibba009 bash[26136]: audit 2021-03-10T20:17:03.672913+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.104:0/2397662315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:04 gibba004 bash[30897]: audit 2021-03-10T20:17:03.181374+0000 mgr.gibba009.xiladd (mgr.34457) 397 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:04 gibba004 bash[30897]: audit 2021-03-10T20:17:03.406762+0000 mgr.gibba009.xiladd (mgr.34457) 398 : audit [DBG] from='client.54313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:04 gibba004 bash[31878]: audit 2021-03-10T20:17:03.181374+0000 mgr.gibba009.xiladd (mgr.34457) 397 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:04 gibba004 bash[31878]: audit 2021-03-10T20:17:03.406762+0000 mgr.gibba009.xiladd (mgr.34457) 398 : audit [DBG] from='client.54313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:05.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:04 gibba009 bash[26136]: audit 2021-03-10T20:17:03.181374+0000 mgr.gibba009.xiladd (mgr.34457) 397 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:05.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:04 gibba009 bash[26136]: audit 2021-03-10T20:17:03.406762+0000 mgr.gibba009.xiladd (mgr.34457) 398 : audit [DBG] from='client.54313 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:06.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:05 gibba004 bash[30897]: cluster 2021-03-10T20:17:04.278060+0000 mgr.gibba009.xiladd (mgr.34457) 399 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:06.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:05 gibba004 bash[31878]: cluster 2021-03-10T20:17:04.278060+0000 mgr.gibba009.xiladd (mgr.34457) 399 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:06.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:05 gibba009 bash[26136]: cluster 2021-03-10T20:17:04.278060+0000 mgr.gibba009.xiladd (mgr.34457) 399 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:08.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:07 gibba004 bash[30897]: cluster 2021-03-10T20:17:06.279780+0000 mgr.gibba009.xiladd (mgr.34457) 400 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:08.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:07 gibba004 bash[31878]: cluster 2021-03-10T20:17:06.279780+0000 mgr.gibba009.xiladd (mgr.34457) 400 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:07 gibba009 bash[26136]: cluster 2021-03-10T20:17:06.279780+0000 mgr.gibba009.xiladd (mgr.34457) 400 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:09 gibba004 bash[30897]: cluster 2021-03-10T20:17:08.281159+0000 mgr.gibba009.xiladd (mgr.34457) 401 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:10.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:09 gibba004 bash[31878]: cluster 2021-03-10T20:17:08.281159+0000 mgr.gibba009.xiladd (mgr.34457) 401 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:10.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:09 gibba009 bash[26136]: cluster 2021-03-10T20:17:08.281159+0000 mgr.gibba009.xiladd (mgr.34457) 401 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:11 gibba004 bash[30897]: cluster 2021-03-10T20:17:10.282689+0000 mgr.gibba009.xiladd (mgr.34457) 402 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:11 gibba004 bash[31878]: cluster 2021-03-10T20:17:10.282689+0000 mgr.gibba009.xiladd (mgr.34457) 402 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:11 gibba009 bash[26136]: cluster 2021-03-10T20:17:10.282689+0000 mgr.gibba009.xiladd (mgr.34457) 402 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:14.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:13 gibba004 bash[30897]: cluster 2021-03-10T20:17:12.284270+0000 mgr.gibba009.xiladd (mgr.34457) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:14.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:13 gibba004 bash[31878]: cluster 2021-03-10T20:17:12.284270+0000 mgr.gibba009.xiladd (mgr.34457) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:14.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:13 gibba009 bash[26136]: cluster 2021-03-10T20:17:12.284270+0000 mgr.gibba009.xiladd (mgr.34457) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:16.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:15 gibba004 bash[30897]: cluster 2021-03-10T20:17:14.285559+0000 mgr.gibba009.xiladd (mgr.34457) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:16.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:15 gibba004 bash[30897]: cephadm 2021-03-10T20:17:14.963133+0000 mgr.gibba009.xiladd (mgr.34457) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:16.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:15 gibba004 bash[31878]: cluster 2021-03-10T20:17:14.285559+0000 mgr.gibba009.xiladd (mgr.34457) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:16.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:15 gibba004 bash[31878]: cephadm 2021-03-10T20:17:14.963133+0000 mgr.gibba009.xiladd (mgr.34457) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:15 gibba009 bash[26136]: cluster 2021-03-10T20:17:14.285559+0000 mgr.gibba009.xiladd (mgr.34457) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:15 gibba009 bash[26136]: cephadm 2021-03-10T20:17:14.963133+0000 mgr.gibba009.xiladd (mgr.34457) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:17 gibba004 bash[30897]: cluster 2021-03-10T20:17:16.287400+0000 mgr.gibba009.xiladd (mgr.34457) 406 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:18.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:17 gibba004 bash[31878]: cluster 2021-03-10T20:17:16.287400+0000 mgr.gibba009.xiladd (mgr.34457) 406 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:18.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:17 gibba009 bash[26136]: cluster 2021-03-10T20:17:16.287400+0000 mgr.gibba009.xiladd (mgr.34457) 406 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:19 gibba004 bash[30897]: cluster 2021-03-10T20:17:18.288994+0000 mgr.gibba009.xiladd (mgr.34457) 407 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:19 gibba004 bash[31878]: cluster 2021-03-10T20:17:18.288994+0000 mgr.gibba009.xiladd (mgr.34457) 407 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:20.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:19 gibba009 bash[26136]: cluster 2021-03-10T20:17:18.288994+0000 mgr.gibba009.xiladd (mgr.34457) 407 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:21 gibba004 bash[30897]: cluster 2021-03-10T20:17:20.290315+0000 mgr.gibba009.xiladd (mgr.34457) 408 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:21 gibba004 bash[31878]: cluster 2021-03-10T20:17:20.290315+0000 mgr.gibba009.xiladd (mgr.34457) 408 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:21 gibba009 bash[26136]: cluster 2021-03-10T20:17:20.290315+0000 mgr.gibba009.xiladd (mgr.34457) 408 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:24.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:23 gibba009 bash[26136]: cluster 2021-03-10T20:17:22.291778+0000 mgr.gibba009.xiladd (mgr.34457) 409 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:23 gibba004 bash[30897]: cluster 2021-03-10T20:17:22.291778+0000 mgr.gibba009.xiladd (mgr.34457) 409 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:24.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:23 gibba004 bash[31878]: cluster 2021-03-10T20:17:22.291778+0000 mgr.gibba009.xiladd (mgr.34457) 409 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:26.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:25 gibba009 bash[26136]: cluster 2021-03-10T20:17:24.293085+0000 mgr.gibba009.xiladd (mgr.34457) 410 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:25 gibba004 bash[30897]: cluster 2021-03-10T20:17:24.293085+0000 mgr.gibba009.xiladd (mgr.34457) 410 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:26.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:25 gibba004 bash[31878]: cluster 2021-03-10T20:17:24.293085+0000 mgr.gibba009.xiladd (mgr.34457) 410 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:27 gibba009 bash[26136]: cluster 2021-03-10T20:17:26.294764+0000 mgr.gibba009.xiladd (mgr.34457) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:27 gibba004 bash[30897]: cluster 2021-03-10T20:17:26.294764+0000 mgr.gibba009.xiladd (mgr.34457) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:27 gibba004 bash[31878]: cluster 2021-03-10T20:17:26.294764+0000 mgr.gibba009.xiladd (mgr.34457) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:29 gibba004 bash[30897]: cluster 2021-03-10T20:17:28.296313+0000 mgr.gibba009.xiladd (mgr.34457) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:30.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:29 gibba004 bash[31878]: cluster 2021-03-10T20:17:28.296313+0000 mgr.gibba009.xiladd (mgr.34457) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:30.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:29 gibba009 bash[26136]: cluster 2021-03-10T20:17:28.296313+0000 mgr.gibba009.xiladd (mgr.34457) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:31.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:30 gibba004 bash[30897]: cephadm 2021-03-10T20:17:29.979119+0000 mgr.gibba009.xiladd (mgr.34457) 413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:31.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:30 gibba004 bash[31878]: cephadm 2021-03-10T20:17:29.979119+0000 mgr.gibba009.xiladd (mgr.34457) 413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:31.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:30 gibba009 bash[26136]: cephadm 2021-03-10T20:17:29.979119+0000 mgr.gibba009.xiladd (mgr.34457) 413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:31 gibba004 bash[30897]: cluster 2021-03-10T20:17:30.298006+0000 mgr.gibba009.xiladd (mgr.34457) 414 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:31 gibba004 bash[31878]: cluster 2021-03-10T20:17:30.298006+0000 mgr.gibba009.xiladd (mgr.34457) 414 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:31 gibba009 bash[26136]: cluster 2021-03-10T20:17:30.298006+0000 mgr.gibba009.xiladd (mgr.34457) 414 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:33.915 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:17:34.142 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:17:34.142 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (6m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:17:34.143 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (11m) 110s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:17:34.143 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (6m) 110s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:17:34.143 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (7m) 110s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:17:34.143 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:17:34.144 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:17:34.144 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (5m) 110s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:17:34.144 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:17:34.144 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (12m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:17:34.144 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (12m) 110s ago 12m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:17:34.145 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:17:34.145 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:17:34.145 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:17:34.145 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:17:34.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (3m) 110s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:17:34.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (2m) 110s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:17:34.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (2m) 110s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:17:34.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (112s) 110s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:17:34.146 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (11m) 110s ago 12m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:17:34.147 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:34.147 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 110s ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:34.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:33 gibba004 bash[30897]: cluster 2021-03-10T20:17:32.299575+0000 mgr.gibba009.xiladd (mgr.34457) 415 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:34.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:33 gibba004 bash[31878]: cluster 2021-03-10T20:17:32.299575+0000 mgr.gibba009.xiladd (mgr.34457) 415 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:34.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:33 gibba009 bash[26136]: cluster 2021-03-10T20:17:32.299575+0000 mgr.gibba009.xiladd (mgr.34457) 415 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:34.389 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:17:34.389 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:17:34.389 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:34.390 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:34.390 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:17:34.390 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:34.390 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:34.391 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:17:34.391 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:17:34.391 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:17:34.391 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:17:34.392 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:17:34.392 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:17:34.392 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:17:34.393 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:17:35.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:34 gibba004 bash[30897]: audit 2021-03-10T20:17:33.908304+0000 mgr.gibba009.xiladd (mgr.34457) 416 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:35.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:34 gibba004 bash[30897]: audit 2021-03-10T20:17:34.389510+0000 mon.c (mon.1) 190 : audit [DBG] from='client.? 172.21.2.104:0/2019657122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:35.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:34 gibba004 bash[31878]: audit 2021-03-10T20:17:33.908304+0000 mgr.gibba009.xiladd (mgr.34457) 416 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:35.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:34 gibba004 bash[31878]: audit 2021-03-10T20:17:34.389510+0000 mon.c (mon.1) 190 : audit [DBG] from='client.? 172.21.2.104:0/2019657122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:35.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:34 gibba009 bash[26136]: audit 2021-03-10T20:17:33.908304+0000 mgr.gibba009.xiladd (mgr.34457) 416 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:35.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:34 gibba009 bash[26136]: audit 2021-03-10T20:17:34.389510+0000 mon.c (mon.1) 190 : audit [DBG] from='client.? 172.21.2.104:0/2019657122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:35 gibba004 bash[30897]: audit 2021-03-10T20:17:34.129525+0000 mgr.gibba009.xiladd (mgr.34457) 417 : audit [DBG] from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:35 gibba004 bash[30897]: cluster 2021-03-10T20:17:34.300805+0000 mgr.gibba009.xiladd (mgr.34457) 418 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:35 gibba004 bash[31878]: audit 2021-03-10T20:17:34.129525+0000 mgr.gibba009.xiladd (mgr.34457) 417 : audit [DBG] from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:35 gibba004 bash[31878]: cluster 2021-03-10T20:17:34.300805+0000 mgr.gibba009.xiladd (mgr.34457) 418 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:36.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:35 gibba009 bash[26136]: audit 2021-03-10T20:17:34.129525+0000 mgr.gibba009.xiladd (mgr.34457) 417 : audit [DBG] from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:36.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:35 gibba009 bash[26136]: cluster 2021-03-10T20:17:34.300805+0000 mgr.gibba009.xiladd (mgr.34457) 418 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:37 gibba004 bash[30897]: cluster 2021-03-10T20:17:36.302700+0000 mgr.gibba009.xiladd (mgr.34457) 419 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:38.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:37 gibba004 bash[31878]: cluster 2021-03-10T20:17:36.302700+0000 mgr.gibba009.xiladd (mgr.34457) 419 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:37 gibba009 bash[26136]: cluster 2021-03-10T20:17:36.302700+0000 mgr.gibba009.xiladd (mgr.34457) 419 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: cluster 2021-03-10T20:17:38.304286+0000 mgr.gibba009.xiladd (mgr.34457) 420 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.495261+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.495988+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.496390+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.496679+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.497665+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.497742+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.499051+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.499895+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.596221+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.597350+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.605424+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[30897]: audit 2021-03-10T20:17:39.606585+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: cluster 2021-03-10T20:17:38.304286+0000 mgr.gibba009.xiladd (mgr.34457) 420 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.495261+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.495988+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.496390+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.496679+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.497665+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.497742+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.499051+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.499895+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.596221+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.597350+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.605424+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:39 gibba004 bash[31878]: audit 2021-03-10T20:17:39.606585+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:40.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: cluster 2021-03-10T20:17:38.304286+0000 mgr.gibba009.xiladd (mgr.34457) 420 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.495261+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.495988+0000 mon.c (mon.1) 192 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.496390+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:17:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.496679+0000 mon.c (mon.1) 193 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.497665+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.497742+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.499051+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:17:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.499895+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:17:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.596221+0000 mon.c (mon.1) 195 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.597350+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.605424+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:39 gibba009 bash[26136]: audit 2021-03-10T20:17:39.606585+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:41 gibba004 bash[30897]: cluster 2021-03-10T20:17:40.305950+0000 mgr.gibba009.xiladd (mgr.34457) 421 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:42.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:41 gibba004 bash[31878]: cluster 2021-03-10T20:17:40.305950+0000 mgr.gibba009.xiladd (mgr.34457) 421 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:42.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:41 gibba009 bash[26136]: cluster 2021-03-10T20:17:40.305950+0000 mgr.gibba009.xiladd (mgr.34457) 421 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:43 gibba004 bash[30897]: cluster 2021-03-10T20:17:42.307635+0000 mgr.gibba009.xiladd (mgr.34457) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:44.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:43 gibba004 bash[31878]: cluster 2021-03-10T20:17:42.307635+0000 mgr.gibba009.xiladd (mgr.34457) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:44.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:43 gibba009 bash[26136]: cluster 2021-03-10T20:17:42.307635+0000 mgr.gibba009.xiladd (mgr.34457) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: cluster 2021-03-10T20:17:44.308904+0000 mgr.gibba009.xiladd (mgr.34457) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:44.993446+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: cephadm 2021-03-10T20:17:44.999955+0000 mgr.gibba009.xiladd (mgr.34457) 424 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:17:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.001777+0000 mgr.gibba009.xiladd (mgr.34457) 425 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:17:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.214005+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:17:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.217671+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.219292+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.220654+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.221654+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.224522+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[30897]: audit 2021-03-10T20:17:45.226356+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: cluster 2021-03-10T20:17:44.308904+0000 mgr.gibba009.xiladd (mgr.34457) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:44.993446+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: cephadm 2021-03-10T20:17:44.999955+0000 mgr.gibba009.xiladd (mgr.34457) 424 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:17:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.001777+0000 mgr.gibba009.xiladd (mgr.34457) 425 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:17:46.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.214005+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:17:46.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.217671+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.219292+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.220654+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.221654+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.224522+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:45 gibba004 bash[31878]: audit 2021-03-10T20:17:45.226356+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: cluster 2021-03-10T20:17:44.308904+0000 mgr.gibba009.xiladd (mgr.34457) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:44.993446+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: cephadm 2021-03-10T20:17:44.999955+0000 mgr.gibba009.xiladd (mgr.34457) 424 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:17:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.001777+0000 mgr.gibba009.xiladd (mgr.34457) 425 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:17:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.214005+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:17:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.217671+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.219292+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.220654+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.221654+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.224522+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:45 gibba009 bash[26136]: audit 2021-03-10T20:17:45.226356+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:47.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.218306+0000 mgr.gibba009.xiladd (mgr.34457) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.220107+0000 mgr.gibba009.xiladd (mgr.34457) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.221446+0000 mgr.gibba009.xiladd (mgr.34457) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.221483+0000 mgr.gibba009.xiladd (mgr.34457) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.222692+0000 mgr.gibba009.xiladd (mgr.34457) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.222725+0000 mgr.gibba009.xiladd (mgr.34457) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.223678+0000 mgr.gibba009.xiladd (mgr.34457) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.225215+0000 mgr.gibba009.xiladd (mgr.34457) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.225251+0000 mgr.gibba009.xiladd (mgr.34457) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.226853+0000 mgr.gibba009.xiladd (mgr.34457) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.227173+0000 mgr.gibba009.xiladd (mgr.34457) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.228996+0000 mgr.gibba009.xiladd (mgr.34457) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.229033+0000 mgr.gibba009.xiladd (mgr.34457) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:47.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[30897]: cephadm 2021-03-10T20:17:45.229158+0000 mgr.gibba009.xiladd (mgr.34457) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.218306+0000 mgr.gibba009.xiladd (mgr.34457) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.220107+0000 mgr.gibba009.xiladd (mgr.34457) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.221446+0000 mgr.gibba009.xiladd (mgr.34457) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.221483+0000 mgr.gibba009.xiladd (mgr.34457) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.222692+0000 mgr.gibba009.xiladd (mgr.34457) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.222725+0000 mgr.gibba009.xiladd (mgr.34457) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.223678+0000 mgr.gibba009.xiladd (mgr.34457) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.225215+0000 mgr.gibba009.xiladd (mgr.34457) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.225251+0000 mgr.gibba009.xiladd (mgr.34457) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.226853+0000 mgr.gibba009.xiladd (mgr.34457) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.227173+0000 mgr.gibba009.xiladd (mgr.34457) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.228996+0000 mgr.gibba009.xiladd (mgr.34457) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.229033+0000 mgr.gibba009.xiladd (mgr.34457) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:46 gibba004 bash[31878]: cephadm 2021-03-10T20:17:45.229158+0000 mgr.gibba009.xiladd (mgr.34457) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.218306+0000 mgr.gibba009.xiladd (mgr.34457) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.220107+0000 mgr.gibba009.xiladd (mgr.34457) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.221446+0000 mgr.gibba009.xiladd (mgr.34457) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.221483+0000 mgr.gibba009.xiladd (mgr.34457) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.222692+0000 mgr.gibba009.xiladd (mgr.34457) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.222725+0000 mgr.gibba009.xiladd (mgr.34457) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.223678+0000 mgr.gibba009.xiladd (mgr.34457) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.225215+0000 mgr.gibba009.xiladd (mgr.34457) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.225251+0000 mgr.gibba009.xiladd (mgr.34457) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.226853+0000 mgr.gibba009.xiladd (mgr.34457) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.227173+0000 mgr.gibba009.xiladd (mgr.34457) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.228996+0000 mgr.gibba009.xiladd (mgr.34457) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.229033+0000 mgr.gibba009.xiladd (mgr.34457) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:46 gibba009 bash[26136]: cephadm 2021-03-10T20:17:45.229158+0000 mgr.gibba009.xiladd (mgr.34457) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:17:48.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:47 gibba004 bash[30897]: cluster 2021-03-10T20:17:46.310695+0000 mgr.gibba009.xiladd (mgr.34457) 440 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:48.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:47 gibba004 bash[31878]: cluster 2021-03-10T20:17:46.310695+0000 mgr.gibba009.xiladd (mgr.34457) 440 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:48.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:47 gibba009 bash[26136]: cluster 2021-03-10T20:17:46.310695+0000 mgr.gibba009.xiladd (mgr.34457) 440 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:50.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:49 gibba004 bash[30897]: cluster 2021-03-10T20:17:48.312254+0000 mgr.gibba009.xiladd (mgr.34457) 441 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:50.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:49 gibba004 bash[31878]: cluster 2021-03-10T20:17:48.312254+0000 mgr.gibba009.xiladd (mgr.34457) 441 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:50.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:49 gibba009 bash[26136]: cluster 2021-03-10T20:17:48.312254+0000 mgr.gibba009.xiladd (mgr.34457) 441 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:52.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:51 gibba004 bash[30897]: cluster 2021-03-10T20:17:50.313734+0000 mgr.gibba009.xiladd (mgr.34457) 442 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:52.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:51 gibba004 bash[31878]: cluster 2021-03-10T20:17:50.313734+0000 mgr.gibba009.xiladd (mgr.34457) 442 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:52.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:51 gibba009 bash[26136]: cluster 2021-03-10T20:17:50.313734+0000 mgr.gibba009.xiladd (mgr.34457) 442 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:53 gibba004 bash[30897]: cluster 2021-03-10T20:17:52.315282+0000 mgr.gibba009.xiladd (mgr.34457) 443 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:53 gibba004 bash[31878]: cluster 2021-03-10T20:17:52.315282+0000 mgr.gibba009.xiladd (mgr.34457) 443 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:53 gibba009 bash[26136]: cluster 2021-03-10T20:17:52.315282+0000 mgr.gibba009.xiladd (mgr.34457) 443 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:55 gibba004 bash[30897]: cluster 2021-03-10T20:17:54.316515+0000 mgr.gibba009.xiladd (mgr.34457) 444 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:56.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:55 gibba004 bash[31878]: cluster 2021-03-10T20:17:54.316515+0000 mgr.gibba009.xiladd (mgr.34457) 444 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:56.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:55 gibba009 bash[26136]: cluster 2021-03-10T20:17:54.316515+0000 mgr.gibba009.xiladd (mgr.34457) 444 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:57 gibba004 bash[30897]: cluster 2021-03-10T20:17:56.318543+0000 mgr.gibba009.xiladd (mgr.34457) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:58.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:57 gibba004 bash[31878]: cluster 2021-03-10T20:17:56.318543+0000 mgr.gibba009.xiladd (mgr.34457) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:58.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:57 gibba009 bash[26136]: cluster 2021-03-10T20:17:56.318543+0000 mgr.gibba009.xiladd (mgr.34457) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:17:59 gibba004 bash[30897]: cluster 2021-03-10T20:17:58.320129+0000 mgr.gibba009.xiladd (mgr.34457) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:00.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:17:59 gibba004 bash[31878]: cluster 2021-03-10T20:17:58.320129+0000 mgr.gibba009.xiladd (mgr.34457) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:00.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:17:59 gibba009 bash[26136]: cluster 2021-03-10T20:17:58.320129+0000 mgr.gibba009.xiladd (mgr.34457) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:02 gibba004 bash[30897]: cephadm 2021-03-10T20:18:00.230492+0000 mgr.gibba009.xiladd (mgr.34457) 447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:02 gibba004 bash[30897]: cluster 2021-03-10T20:18:00.321814+0000 mgr.gibba009.xiladd (mgr.34457) 448 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:02 gibba004 bash[31878]: cephadm 2021-03-10T20:18:00.230492+0000 mgr.gibba009.xiladd (mgr.34457) 447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:02 gibba004 bash[31878]: cluster 2021-03-10T20:18:00.321814+0000 mgr.gibba009.xiladd (mgr.34457) 448 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:02 gibba009 bash[26136]: cephadm 2021-03-10T20:18:00.230492+0000 mgr.gibba009.xiladd (mgr.34457) 447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:02 gibba009 bash[26136]: cluster 2021-03-10T20:18:00.321814+0000 mgr.gibba009.xiladd (mgr.34457) 448 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:04 gibba004 bash[30897]: cluster 2021-03-10T20:18:02.323159+0000 mgr.gibba009.xiladd (mgr.34457) 449 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:04 gibba004 bash[31878]: cluster 2021-03-10T20:18:02.323159+0000 mgr.gibba009.xiladd (mgr.34457) 449 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:04.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:04 gibba009 bash[26136]: cluster 2021-03-10T20:18:02.323159+0000 mgr.gibba009.xiladd (mgr.34457) 449 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:04.634 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:18:04.880 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:18:04.880 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (6m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:18:04.880 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:18:04.881 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:18:04.881 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:18:04.881 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:18:04.881 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:18:04.882 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:18:04.882 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:18:04.882 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (12m) 4m ago 12m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:18:04.882 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (12m) 2m ago 12m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:18:04.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:18:04.883 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:18:04.883 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:18:04.883 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:18:04.883 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:18:04.883 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:18:04.884 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:18:04.884 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:18:04.884 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (11m) 2m ago 12m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:18:04.884 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:04.885 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:05.130 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:18:05.130 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:18:05.131 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:05.131 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:05.131 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:18:05.131 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:05.131 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:05.132 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:18:05.132 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:18:05.132 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:05.132 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:18:05.133 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:18:05.133 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:18:05.133 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:18:05.133 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:18:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[30897]: cluster 2021-03-10T20:18:04.324387+0000 mgr.gibba009.xiladd (mgr.34457) 450 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[30897]: audit 2021-03-10T20:18:04.626389+0000 mgr.gibba009.xiladd (mgr.34457) 451 : audit [DBG] from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[30897]: audit 2021-03-10T20:18:04.853472+0000 mgr.gibba009.xiladd (mgr.34457) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[30897]: audit 2021-03-10T20:18:05.130754+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.104:0/1654080333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[31878]: cluster 2021-03-10T20:18:04.324387+0000 mgr.gibba009.xiladd (mgr.34457) 450 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:06.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[31878]: audit 2021-03-10T20:18:04.626389+0000 mgr.gibba009.xiladd (mgr.34457) 451 : audit [DBG] from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[31878]: audit 2021-03-10T20:18:04.853472+0000 mgr.gibba009.xiladd (mgr.34457) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:06 gibba004 bash[31878]: audit 2021-03-10T20:18:05.130754+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.104:0/1654080333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:06.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:06 gibba009 bash[26136]: cluster 2021-03-10T20:18:04.324387+0000 mgr.gibba009.xiladd (mgr.34457) 450 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:06.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:06 gibba009 bash[26136]: audit 2021-03-10T20:18:04.626389+0000 mgr.gibba009.xiladd (mgr.34457) 451 : audit [DBG] from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:06 gibba009 bash[26136]: audit 2021-03-10T20:18:04.853472+0000 mgr.gibba009.xiladd (mgr.34457) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:06.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:06 gibba009 bash[26136]: audit 2021-03-10T20:18:05.130754+0000 mon.c (mon.1) 204 : audit [DBG] from='client.? 172.21.2.104:0/1654080333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:08 gibba004 bash[30897]: cluster 2021-03-10T20:18:06.326265+0000 mgr.gibba009.xiladd (mgr.34457) 453 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:08.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:08 gibba004 bash[31878]: cluster 2021-03-10T20:18:06.326265+0000 mgr.gibba009.xiladd (mgr.34457) 453 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:08 gibba009 bash[26136]: cluster 2021-03-10T20:18:06.326265+0000 mgr.gibba009.xiladd (mgr.34457) 453 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:10.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:10 gibba004 bash[30897]: cluster 2021-03-10T20:18:08.327913+0000 mgr.gibba009.xiladd (mgr.34457) 454 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:10.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:10 gibba004 bash[31878]: cluster 2021-03-10T20:18:08.327913+0000 mgr.gibba009.xiladd (mgr.34457) 454 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:10.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:10 gibba009 bash[26136]: cluster 2021-03-10T20:18:08.327913+0000 mgr.gibba009.xiladd (mgr.34457) 454 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:11 gibba004 bash[30897]: cluster 2021-03-10T20:18:10.329549+0000 mgr.gibba009.xiladd (mgr.34457) 455 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:11 gibba004 bash[31878]: cluster 2021-03-10T20:18:10.329549+0000 mgr.gibba009.xiladd (mgr.34457) 455 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:11 gibba009 bash[26136]: cluster 2021-03-10T20:18:10.329549+0000 mgr.gibba009.xiladd (mgr.34457) 455 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:13 gibba004 bash[30897]: cluster 2021-03-10T20:18:12.331153+0000 mgr.gibba009.xiladd (mgr.34457) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:13 gibba004 bash[31878]: cluster 2021-03-10T20:18:12.331153+0000 mgr.gibba009.xiladd (mgr.34457) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:13 gibba009 bash[26136]: cluster 2021-03-10T20:18:12.331153+0000 mgr.gibba009.xiladd (mgr.34457) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:16.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:15 gibba004 bash[30897]: cluster 2021-03-10T20:18:14.332391+0000 mgr.gibba009.xiladd (mgr.34457) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:16.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:15 gibba004 bash[31878]: cluster 2021-03-10T20:18:14.332391+0000 mgr.gibba009.xiladd (mgr.34457) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:15 gibba009 bash[26136]: cluster 2021-03-10T20:18:14.332391+0000 mgr.gibba009.xiladd (mgr.34457) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:16 gibba004 bash[30897]: cephadm 2021-03-10T20:18:15.246495+0000 mgr.gibba009.xiladd (mgr.34457) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:17.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:16 gibba004 bash[31878]: cephadm 2021-03-10T20:18:15.246495+0000 mgr.gibba009.xiladd (mgr.34457) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:17.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:16 gibba009 bash[26136]: cephadm 2021-03-10T20:18:15.246495+0000 mgr.gibba009.xiladd (mgr.34457) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:17 gibba004 bash[30897]: cluster 2021-03-10T20:18:16.333970+0000 mgr.gibba009.xiladd (mgr.34457) 459 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:18.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:17 gibba004 bash[31878]: cluster 2021-03-10T20:18:16.333970+0000 mgr.gibba009.xiladd (mgr.34457) 459 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:18.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:17 gibba009 bash[26136]: cluster 2021-03-10T20:18:16.333970+0000 mgr.gibba009.xiladd (mgr.34457) 459 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:20.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:19 gibba004 bash[30897]: cluster 2021-03-10T20:18:18.335605+0000 mgr.gibba009.xiladd (mgr.34457) 460 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:19 gibba004 bash[31878]: cluster 2021-03-10T20:18:18.335605+0000 mgr.gibba009.xiladd (mgr.34457) 460 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:20.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:19 gibba009 bash[26136]: cluster 2021-03-10T20:18:18.335605+0000 mgr.gibba009.xiladd (mgr.34457) 460 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:21 gibba004 bash[30897]: cluster 2021-03-10T20:18:20.337308+0000 mgr.gibba009.xiladd (mgr.34457) 461 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:21 gibba004 bash[31878]: cluster 2021-03-10T20:18:20.337308+0000 mgr.gibba009.xiladd (mgr.34457) 461 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:22.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:21 gibba009 bash[26136]: cluster 2021-03-10T20:18:20.337308+0000 mgr.gibba009.xiladd (mgr.34457) 461 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:24.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:23 gibba004 bash[30897]: cluster 2021-03-10T20:18:22.338905+0000 mgr.gibba009.xiladd (mgr.34457) 462 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:24.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:23 gibba004 bash[31878]: cluster 2021-03-10T20:18:22.338905+0000 mgr.gibba009.xiladd (mgr.34457) 462 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:24.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:23 gibba009 bash[26136]: cluster 2021-03-10T20:18:22.338905+0000 mgr.gibba009.xiladd (mgr.34457) 462 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:25 gibba004 bash[30897]: cluster 2021-03-10T20:18:24.340091+0000 mgr.gibba009.xiladd (mgr.34457) 463 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:25 gibba004 bash[31878]: cluster 2021-03-10T20:18:24.340091+0000 mgr.gibba009.xiladd (mgr.34457) 463 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:26.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:25 gibba009 bash[26136]: cluster 2021-03-10T20:18:24.340091+0000 mgr.gibba009.xiladd (mgr.34457) 463 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:28.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:27 gibba004 bash[30897]: cluster 2021-03-10T20:18:26.341673+0000 mgr.gibba009.xiladd (mgr.34457) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:28.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:27 gibba004 bash[31878]: cluster 2021-03-10T20:18:26.341673+0000 mgr.gibba009.xiladd (mgr.34457) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:27 gibba009 bash[26136]: cluster 2021-03-10T20:18:26.341673+0000 mgr.gibba009.xiladd (mgr.34457) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:30.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:29 gibba004 bash[30897]: cluster 2021-03-10T20:18:28.343040+0000 mgr.gibba009.xiladd (mgr.34457) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:30.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:29 gibba004 bash[31878]: cluster 2021-03-10T20:18:28.343040+0000 mgr.gibba009.xiladd (mgr.34457) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:29 gibba009 bash[26136]: cluster 2021-03-10T20:18:28.343040+0000 mgr.gibba009.xiladd (mgr.34457) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:31 gibba004 bash[30897]: cephadm 2021-03-10T20:18:30.262414+0000 mgr.gibba009.xiladd (mgr.34457) 466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:31 gibba004 bash[30897]: cluster 2021-03-10T20:18:30.344411+0000 mgr.gibba009.xiladd (mgr.34457) 467 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:32.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:31 gibba004 bash[31878]: cephadm 2021-03-10T20:18:30.262414+0000 mgr.gibba009.xiladd (mgr.34457) 466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:32.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:31 gibba004 bash[31878]: cluster 2021-03-10T20:18:30.344411+0000 mgr.gibba009.xiladd (mgr.34457) 467 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:32.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:31 gibba009 bash[26136]: cephadm 2021-03-10T20:18:30.262414+0000 mgr.gibba009.xiladd (mgr.34457) 466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:32.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:31 gibba009 bash[26136]: cluster 2021-03-10T20:18:30.344411+0000 mgr.gibba009.xiladd (mgr.34457) 467 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:33 gibba004 bash[30897]: cluster 2021-03-10T20:18:32.345992+0000 mgr.gibba009.xiladd (mgr.34457) 468 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:34.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:33 gibba004 bash[31878]: cluster 2021-03-10T20:18:32.345992+0000 mgr.gibba009.xiladd (mgr.34457) 468 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:34.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:33 gibba009 bash[26136]: cluster 2021-03-10T20:18:32.345992+0000 mgr.gibba009.xiladd (mgr.34457) 468 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:35.377 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:18:35.609 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:18:35.610 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:18:35.610 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:18:35.610 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:18:35.611 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (8m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:18:35.611 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (7m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:18:35.612 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:18:35.612 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:18:35.613 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:18:35.614 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:18:35.614 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (13m) 2m ago 13m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:18:35.614 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:18:35.615 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:18:35.615 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:18:35.616 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:18:35.616 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:18:35.617 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:18:35.617 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:18:35.617 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:18:35.618 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (12m) 2m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:18:35.618 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:35.619 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:35.861 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:18:35.861 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:18:35.861 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:35.861 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:35.862 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:18:35.862 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:35.862 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:35.862 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:18:35.863 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:18:35.863 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:18:35.863 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:18:35.863 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:18:35.863 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:18:35.864 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:18:35.864 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:18:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:35 gibba004 bash[30897]: cluster 2021-03-10T20:18:34.347180+0000 mgr.gibba009.xiladd (mgr.34457) 469 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:36.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:35 gibba004 bash[31878]: cluster 2021-03-10T20:18:34.347180+0000 mgr.gibba009.xiladd (mgr.34457) 469 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:35 gibba009 bash[26136]: cluster 2021-03-10T20:18:34.347180+0000 mgr.gibba009.xiladd (mgr.34457) 469 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[30897]: audit 2021-03-10T20:18:35.369974+0000 mgr.gibba009.xiladd (mgr.34457) 470 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[30897]: audit 2021-03-10T20:18:35.598167+0000 mgr.gibba009.xiladd (mgr.34457) 471 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[30897]: audit 2021-03-10T20:18:35.861200+0000 mon.a (mon.0) 598 : audit [DBG] from='client.? 172.21.2.104:0/2546081945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[31878]: audit 2021-03-10T20:18:35.369974+0000 mgr.gibba009.xiladd (mgr.34457) 470 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[31878]: audit 2021-03-10T20:18:35.598167+0000 mgr.gibba009.xiladd (mgr.34457) 471 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:36 gibba004 bash[31878]: audit 2021-03-10T20:18:35.861200+0000 mon.a (mon.0) 598 : audit [DBG] from='client.? 172.21.2.104:0/2546081945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:37.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:36 gibba009 bash[26136]: audit 2021-03-10T20:18:35.369974+0000 mgr.gibba009.xiladd (mgr.34457) 470 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:36 gibba009 bash[26136]: audit 2021-03-10T20:18:35.598167+0000 mgr.gibba009.xiladd (mgr.34457) 471 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:37.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:36 gibba009 bash[26136]: audit 2021-03-10T20:18:35.861200+0000 mon.a (mon.0) 598 : audit [DBG] from='client.? 172.21.2.104:0/2546081945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:37 gibba004 bash[30897]: cluster 2021-03-10T20:18:36.348800+0000 mgr.gibba009.xiladd (mgr.34457) 472 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:37 gibba004 bash[31878]: cluster 2021-03-10T20:18:36.348800+0000 mgr.gibba009.xiladd (mgr.34457) 472 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:37 gibba009 bash[26136]: cluster 2021-03-10T20:18:36.348800+0000 mgr.gibba009.xiladd (mgr.34457) 472 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: cluster 2021-03-10T20:18:38.350140+0000 mgr.gibba009.xiladd (mgr.34457) 473 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.506751+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.507471+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.507973+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.508171+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.509086+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.509216+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.510625+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.511448+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.604593+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.605710+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.609291+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[30897]: audit 2021-03-10T20:18:39.610352+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: cluster 2021-03-10T20:18:38.350140+0000 mgr.gibba009.xiladd (mgr.34457) 473 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.506751+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.507471+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.507973+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.508171+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.509086+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.509216+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.510625+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.511448+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.604593+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.605710+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.609291+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:39 gibba004 bash[31878]: audit 2021-03-10T20:18:39.610352+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: cluster 2021-03-10T20:18:38.350140+0000 mgr.gibba009.xiladd (mgr.34457) 473 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.506751+0000 mon.c (mon.1) 205 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.507471+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.507973+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:18:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.508171+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.509086+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.509216+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.510625+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:18:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.511448+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.604593+0000 mon.c (mon.1) 209 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.605710+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.609291+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:39 gibba009 bash[26136]: audit 2021-03-10T20:18:39.610352+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:41 gibba004 bash[30897]: cluster 2021-03-10T20:18:40.351586+0000 mgr.gibba009.xiladd (mgr.34457) 474 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:41 gibba004 bash[31878]: cluster 2021-03-10T20:18:40.351586+0000 mgr.gibba009.xiladd (mgr.34457) 474 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:41 gibba009 bash[26136]: cluster 2021-03-10T20:18:40.351586+0000 mgr.gibba009.xiladd (mgr.34457) 474 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:43 gibba004 bash[30897]: cluster 2021-03-10T20:18:42.353092+0000 mgr.gibba009.xiladd (mgr.34457) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:43 gibba004 bash[31878]: cluster 2021-03-10T20:18:42.353092+0000 mgr.gibba009.xiladd (mgr.34457) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:44.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:43 gibba009 bash[26136]: cluster 2021-03-10T20:18:42.353092+0000 mgr.gibba009.xiladd (mgr.34457) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: cluster 2021-03-10T20:18:44.354356+0000 mgr.gibba009.xiladd (mgr.34457) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.277892+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.509424+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:18:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.513446+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.514824+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.516719+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.836 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.517880+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.520629+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:45 gibba009 bash[26136]: audit 2021-03-10T20:18:45.522209+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: cluster 2021-03-10T20:18:44.354356+0000 mgr.gibba009.xiladd (mgr.34457) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.277892+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.509424+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:18:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.513446+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.514824+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.516719+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.517880+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.520629+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[30897]: audit 2021-03-10T20:18:45.522209+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: cluster 2021-03-10T20:18:44.354356+0000 mgr.gibba009.xiladd (mgr.34457) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.277892+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.509424+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:18:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.513446+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:46.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.514824+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.516719+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.517880+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.520629+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:46.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:45 gibba004 bash[31878]: audit 2021-03-10T20:18:45.522209+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.284821+0000 mgr.gibba009.xiladd (mgr.34457) 477 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:18:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.286716+0000 mgr.gibba009.xiladd (mgr.34457) 478 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:18:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.513973+0000 mgr.gibba009.xiladd (mgr.34457) 479 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.515777+0000 mgr.gibba009.xiladd (mgr.34457) 480 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.517495+0000 mgr.gibba009.xiladd (mgr.34457) 481 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.517543+0000 mgr.gibba009.xiladd (mgr.34457) 482 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.518896+0000 mgr.gibba009.xiladd (mgr.34457) 483 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.518940+0000 mgr.gibba009.xiladd (mgr.34457) 484 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.520052+0000 mgr.gibba009.xiladd (mgr.34457) 485 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:47.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.521478+0000 mgr.gibba009.xiladd (mgr.34457) 486 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.521520+0000 mgr.gibba009.xiladd (mgr.34457) 487 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.522892+0000 mgr.gibba009.xiladd (mgr.34457) 488 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:47.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.523284+0000 mgr.gibba009.xiladd (mgr.34457) 489 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.524547+0000 mgr.gibba009.xiladd (mgr.34457) 490 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.524594+0000 mgr.gibba009.xiladd (mgr.34457) 491 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:47.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[30897]: cephadm 2021-03-10T20:18:45.524826+0000 mgr.gibba009.xiladd (mgr.34457) 492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:47.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.284821+0000 mgr.gibba009.xiladd (mgr.34457) 477 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:18:47.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.286716+0000 mgr.gibba009.xiladd (mgr.34457) 478 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:18:47.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.513973+0000 mgr.gibba009.xiladd (mgr.34457) 479 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:47.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.515777+0000 mgr.gibba009.xiladd (mgr.34457) 480 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:47.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.517495+0000 mgr.gibba009.xiladd (mgr.34457) 481 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.517543+0000 mgr.gibba009.xiladd (mgr.34457) 482 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.518896+0000 mgr.gibba009.xiladd (mgr.34457) 483 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.518940+0000 mgr.gibba009.xiladd (mgr.34457) 484 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:47.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.520052+0000 mgr.gibba009.xiladd (mgr.34457) 485 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.521478+0000 mgr.gibba009.xiladd (mgr.34457) 486 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.521520+0000 mgr.gibba009.xiladd (mgr.34457) 487 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.522892+0000 mgr.gibba009.xiladd (mgr.34457) 488 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.523284+0000 mgr.gibba009.xiladd (mgr.34457) 489 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:47.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.524547+0000 mgr.gibba009.xiladd (mgr.34457) 490 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.524594+0000 mgr.gibba009.xiladd (mgr.34457) 491 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:47.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:46 gibba004 bash[31878]: cephadm 2021-03-10T20:18:45.524826+0000 mgr.gibba009.xiladd (mgr.34457) 492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:47.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.284821+0000 mgr.gibba009.xiladd (mgr.34457) 477 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:18:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.286716+0000 mgr.gibba009.xiladd (mgr.34457) 478 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:18:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.513973+0000 mgr.gibba009.xiladd (mgr.34457) 479 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.515777+0000 mgr.gibba009.xiladd (mgr.34457) 480 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.517495+0000 mgr.gibba009.xiladd (mgr.34457) 481 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.517543+0000 mgr.gibba009.xiladd (mgr.34457) 482 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.518896+0000 mgr.gibba009.xiladd (mgr.34457) 483 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.518940+0000 mgr.gibba009.xiladd (mgr.34457) 484 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.520052+0000 mgr.gibba009.xiladd (mgr.34457) 485 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.521478+0000 mgr.gibba009.xiladd (mgr.34457) 486 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.521520+0000 mgr.gibba009.xiladd (mgr.34457) 487 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.522892+0000 mgr.gibba009.xiladd (mgr.34457) 488 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.523284+0000 mgr.gibba009.xiladd (mgr.34457) 489 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.524547+0000 mgr.gibba009.xiladd (mgr.34457) 490 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:47.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.524594+0000 mgr.gibba009.xiladd (mgr.34457) 491 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:47.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:46 gibba009 bash[26136]: cephadm 2021-03-10T20:18:45.524826+0000 mgr.gibba009.xiladd (mgr.34457) 492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:18:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:47 gibba004 bash[30897]: cluster 2021-03-10T20:18:46.356066+0000 mgr.gibba009.xiladd (mgr.34457) 493 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:48.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:47 gibba004 bash[31878]: cluster 2021-03-10T20:18:46.356066+0000 mgr.gibba009.xiladd (mgr.34457) 493 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:47 gibba009 bash[26136]: cluster 2021-03-10T20:18:46.356066+0000 mgr.gibba009.xiladd (mgr.34457) 493 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:49 gibba004 bash[30897]: cluster 2021-03-10T20:18:48.357611+0000 mgr.gibba009.xiladd (mgr.34457) 494 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:49 gibba004 bash[31878]: cluster 2021-03-10T20:18:48.357611+0000 mgr.gibba009.xiladd (mgr.34457) 494 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:50.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:49 gibba009 bash[26136]: cluster 2021-03-10T20:18:48.357611+0000 mgr.gibba009.xiladd (mgr.34457) 494 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:51 gibba004 bash[30897]: cluster 2021-03-10T20:18:50.359219+0000 mgr.gibba009.xiladd (mgr.34457) 495 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:52.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:51 gibba004 bash[31878]: cluster 2021-03-10T20:18:50.359219+0000 mgr.gibba009.xiladd (mgr.34457) 495 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:52.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:51 gibba009 bash[26136]: cluster 2021-03-10T20:18:50.359219+0000 mgr.gibba009.xiladd (mgr.34457) 495 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:53 gibba004 bash[30897]: cluster 2021-03-10T20:18:52.360743+0000 mgr.gibba009.xiladd (mgr.34457) 496 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:53 gibba004 bash[31878]: cluster 2021-03-10T20:18:52.360743+0000 mgr.gibba009.xiladd (mgr.34457) 496 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:53 gibba009 bash[26136]: cluster 2021-03-10T20:18:52.360743+0000 mgr.gibba009.xiladd (mgr.34457) 496 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:56.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:55 gibba004 bash[30897]: cluster 2021-03-10T20:18:54.361992+0000 mgr.gibba009.xiladd (mgr.34457) 497 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:56.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:55 gibba004 bash[31878]: cluster 2021-03-10T20:18:54.361992+0000 mgr.gibba009.xiladd (mgr.34457) 497 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:56.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:55 gibba009 bash[26136]: cluster 2021-03-10T20:18:54.361992+0000 mgr.gibba009.xiladd (mgr.34457) 497 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:57 gibba004 bash[30897]: cluster 2021-03-10T20:18:56.363814+0000 mgr.gibba009.xiladd (mgr.34457) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:58.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:57 gibba004 bash[31878]: cluster 2021-03-10T20:18:56.363814+0000 mgr.gibba009.xiladd (mgr.34457) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:58.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:57 gibba009 bash[26136]: cluster 2021-03-10T20:18:56.363814+0000 mgr.gibba009.xiladd (mgr.34457) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:00.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:18:59 gibba004 bash[30897]: cluster 2021-03-10T20:18:58.365402+0000 mgr.gibba009.xiladd (mgr.34457) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:00.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:18:59 gibba004 bash[31878]: cluster 2021-03-10T20:18:58.365402+0000 mgr.gibba009.xiladd (mgr.34457) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:00.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:18:59 gibba009 bash[26136]: cluster 2021-03-10T20:18:58.365402+0000 mgr.gibba009.xiladd (mgr.34457) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:01 gibba004 bash[30897]: cluster 2021-03-10T20:19:00.366881+0000 mgr.gibba009.xiladd (mgr.34457) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:02.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:01 gibba004 bash[30897]: cephadm 2021-03-10T20:19:00.540824+0000 mgr.gibba009.xiladd (mgr.34457) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:01 gibba004 bash[31878]: cluster 2021-03-10T20:19:00.366881+0000 mgr.gibba009.xiladd (mgr.34457) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:02.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:01 gibba004 bash[31878]: cephadm 2021-03-10T20:19:00.540824+0000 mgr.gibba009.xiladd (mgr.34457) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:01 gibba009 bash[26136]: cluster 2021-03-10T20:19:00.366881+0000 mgr.gibba009.xiladd (mgr.34457) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:01 gibba009 bash[26136]: cephadm 2021-03-10T20:19:00.540824+0000 mgr.gibba009.xiladd (mgr.34457) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:03 gibba009 bash[26136]: cluster 2021-03-10T20:19:02.368477+0000 mgr.gibba009.xiladd (mgr.34457) 502 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:03 gibba004 bash[30897]: cluster 2021-03-10T20:19:02.368477+0000 mgr.gibba009.xiladd (mgr.34457) 502 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:04.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:03 gibba004 bash[31878]: cluster 2021-03-10T20:19:02.368477+0000 mgr.gibba009.xiladd (mgr.34457) 502 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:06.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:05 gibba009 bash[26136]: cluster 2021-03-10T20:19:04.369752+0000 mgr.gibba009.xiladd (mgr.34457) 503 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:06.102 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:19:06.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:05 gibba004 bash[30897]: cluster 2021-03-10T20:19:04.369752+0000 mgr.gibba009.xiladd (mgr.34457) 503 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:06.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:05 gibba004 bash[31878]: cluster 2021-03-10T20:19:04.369752+0000 mgr.gibba009.xiladd (mgr.34457) 503 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:06.328 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:19:06.329 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:19:06.329 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:19:06.330 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:19:06.330 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:19:06.331 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:19:06.331 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:19:06.331 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:19:06.332 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:19:06.332 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (13m) 5m ago 13m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:19:06.333 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (13m) 3m ago 13m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:19:06.333 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:19:06.333 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:19:06.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:19:06.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:19:06.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:19:06.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:19:06.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:19:06.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:19:06.335 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (12m) 3m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:19:06.335 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:06.336 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:06.577 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:19:06.577 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:19:06.578 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:06.578 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:06.579 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:19:06.579 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:06.580 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:06.580 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:19:06.580 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:19:06.581 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:06.581 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:19:06.581 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:19:06.582 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:19:06.582 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:19:06.583 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:19:07.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:06 gibba004 bash[31878]: audit 2021-03-10T20:19:06.577706+0000 mon.c (mon.1) 218 : audit [DBG] from='client.? 172.21.2.104:0/2361567500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:07.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:06 gibba004 bash[30897]: audit 2021-03-10T20:19:06.577706+0000 mon.c (mon.1) 218 : audit [DBG] from='client.? 172.21.2.104:0/2361567500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:07.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:06 gibba009 bash[26136]: audit 2021-03-10T20:19:06.577706+0000 mon.c (mon.1) 218 : audit [DBG] from='client.? 172.21.2.104:0/2361567500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[30897]: audit 2021-03-10T20:19:06.094913+0000 mgr.gibba009.xiladd (mgr.34457) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[30897]: audit 2021-03-10T20:19:06.318025+0000 mgr.gibba009.xiladd (mgr.34457) 505 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[30897]: cluster 2021-03-10T20:19:06.370819+0000 mgr.gibba009.xiladd (mgr.34457) 506 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[31878]: audit 2021-03-10T20:19:06.094913+0000 mgr.gibba009.xiladd (mgr.34457) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[31878]: audit 2021-03-10T20:19:06.318025+0000 mgr.gibba009.xiladd (mgr.34457) 505 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:07 gibba004 bash[31878]: cluster 2021-03-10T20:19:06.370819+0000 mgr.gibba009.xiladd (mgr.34457) 506 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:07 gibba009 bash[26136]: audit 2021-03-10T20:19:06.094913+0000 mgr.gibba009.xiladd (mgr.34457) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:07 gibba009 bash[26136]: audit 2021-03-10T20:19:06.318025+0000 mgr.gibba009.xiladd (mgr.34457) 505 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:07 gibba009 bash[26136]: cluster 2021-03-10T20:19:06.370819+0000 mgr.gibba009.xiladd (mgr.34457) 506 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:09 gibba004 bash[30897]: cluster 2021-03-10T20:19:08.372230+0000 mgr.gibba009.xiladd (mgr.34457) 507 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:10.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:09 gibba004 bash[31878]: cluster 2021-03-10T20:19:08.372230+0000 mgr.gibba009.xiladd (mgr.34457) 507 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:10.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:09 gibba009 bash[26136]: cluster 2021-03-10T20:19:08.372230+0000 mgr.gibba009.xiladd (mgr.34457) 507 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:11 gibba004 bash[30897]: cluster 2021-03-10T20:19:10.373729+0000 mgr.gibba009.xiladd (mgr.34457) 508 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:12.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:11 gibba004 bash[31878]: cluster 2021-03-10T20:19:10.373729+0000 mgr.gibba009.xiladd (mgr.34457) 508 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:12.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:11 gibba009 bash[26136]: cluster 2021-03-10T20:19:10.373729+0000 mgr.gibba009.xiladd (mgr.34457) 508 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:13 gibba004 bash[30897]: cluster 2021-03-10T20:19:12.375201+0000 mgr.gibba009.xiladd (mgr.34457) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:13 gibba004 bash[31878]: cluster 2021-03-10T20:19:12.375201+0000 mgr.gibba009.xiladd (mgr.34457) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:14.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:13 gibba009 bash[26136]: cluster 2021-03-10T20:19:12.375201+0000 mgr.gibba009.xiladd (mgr.34457) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:15 gibba004 bash[30897]: cluster 2021-03-10T20:19:14.376580+0000 mgr.gibba009.xiladd (mgr.34457) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:15 gibba004 bash[31878]: cluster 2021-03-10T20:19:14.376580+0000 mgr.gibba009.xiladd (mgr.34457) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:16.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:15 gibba009 bash[26136]: cluster 2021-03-10T20:19:14.376580+0000 mgr.gibba009.xiladd (mgr.34457) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:17.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:16 gibba004 bash[30897]: cephadm 2021-03-10T20:19:15.556923+0000 mgr.gibba009.xiladd (mgr.34457) 511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:17.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:16 gibba004 bash[31878]: cephadm 2021-03-10T20:19:15.556923+0000 mgr.gibba009.xiladd (mgr.34457) 511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:17.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:16 gibba009 bash[26136]: cephadm 2021-03-10T20:19:15.556923+0000 mgr.gibba009.xiladd (mgr.34457) 511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:17 gibba004 bash[30897]: cluster 2021-03-10T20:19:16.378174+0000 mgr.gibba009.xiladd (mgr.34457) 512 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:17 gibba004 bash[31878]: cluster 2021-03-10T20:19:16.378174+0000 mgr.gibba009.xiladd (mgr.34457) 512 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:18.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:17 gibba009 bash[26136]: cluster 2021-03-10T20:19:16.378174+0000 mgr.gibba009.xiladd (mgr.34457) 512 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:19 gibba004 bash[30897]: cluster 2021-03-10T20:19:18.379686+0000 mgr.gibba009.xiladd (mgr.34457) 513 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:19 gibba004 bash[31878]: cluster 2021-03-10T20:19:18.379686+0000 mgr.gibba009.xiladd (mgr.34457) 513 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:20.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:19 gibba009 bash[26136]: cluster 2021-03-10T20:19:18.379686+0000 mgr.gibba009.xiladd (mgr.34457) 513 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:21 gibba004 bash[31878]: cluster 2021-03-10T20:19:20.381326+0000 mgr.gibba009.xiladd (mgr.34457) 514 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:21 gibba004 bash[30897]: cluster 2021-03-10T20:19:20.381326+0000 mgr.gibba009.xiladd (mgr.34457) 514 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:22.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:21 gibba009 bash[26136]: cluster 2021-03-10T20:19:20.381326+0000 mgr.gibba009.xiladd (mgr.34457) 514 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:23 gibba004 bash[30897]: cluster 2021-03-10T20:19:22.382935+0000 mgr.gibba009.xiladd (mgr.34457) 515 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:24.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:23 gibba004 bash[31878]: cluster 2021-03-10T20:19:22.382935+0000 mgr.gibba009.xiladd (mgr.34457) 515 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:24.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:23 gibba009 bash[26136]: cluster 2021-03-10T20:19:22.382935+0000 mgr.gibba009.xiladd (mgr.34457) 515 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:25 gibba004 bash[30897]: cluster 2021-03-10T20:19:24.384163+0000 mgr.gibba009.xiladd (mgr.34457) 516 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:26.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:25 gibba004 bash[31878]: cluster 2021-03-10T20:19:24.384163+0000 mgr.gibba009.xiladd (mgr.34457) 516 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:26.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:25 gibba009 bash[26136]: cluster 2021-03-10T20:19:24.384163+0000 mgr.gibba009.xiladd (mgr.34457) 516 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:27 gibba004 bash[30897]: cluster 2021-03-10T20:19:26.385797+0000 mgr.gibba009.xiladd (mgr.34457) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:27 gibba004 bash[31878]: cluster 2021-03-10T20:19:26.385797+0000 mgr.gibba009.xiladd (mgr.34457) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:28.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:27 gibba009 bash[26136]: cluster 2021-03-10T20:19:26.385797+0000 mgr.gibba009.xiladd (mgr.34457) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:29 gibba004 bash[30897]: cluster 2021-03-10T20:19:28.387257+0000 mgr.gibba009.xiladd (mgr.34457) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:30.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:29 gibba004 bash[31878]: cluster 2021-03-10T20:19:28.387257+0000 mgr.gibba009.xiladd (mgr.34457) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:30.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:29 gibba009 bash[26136]: cluster 2021-03-10T20:19:28.387257+0000 mgr.gibba009.xiladd (mgr.34457) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:31 gibba004 bash[30897]: cluster 2021-03-10T20:19:30.388550+0000 mgr.gibba009.xiladd (mgr.34457) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:31 gibba004 bash[30897]: cephadm 2021-03-10T20:19:30.566084+0000 mgr.gibba009.xiladd (mgr.34457) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:31 gibba004 bash[31878]: cluster 2021-03-10T20:19:30.388550+0000 mgr.gibba009.xiladd (mgr.34457) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:31 gibba004 bash[31878]: cephadm 2021-03-10T20:19:30.566084+0000 mgr.gibba009.xiladd (mgr.34457) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:31 gibba009 bash[26136]: cluster 2021-03-10T20:19:30.388550+0000 mgr.gibba009.xiladd (mgr.34457) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:31 gibba009 bash[26136]: cephadm 2021-03-10T20:19:30.566084+0000 mgr.gibba009.xiladd (mgr.34457) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:33 gibba004 bash[30897]: cluster 2021-03-10T20:19:32.389947+0000 mgr.gibba009.xiladd (mgr.34457) 521 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:34.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:33 gibba004 bash[31878]: cluster 2021-03-10T20:19:32.389947+0000 mgr.gibba009.xiladd (mgr.34457) 521 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:34.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:33 gibba009 bash[26136]: cluster 2021-03-10T20:19:32.389947+0000 mgr.gibba009.xiladd (mgr.34457) 521 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:35 gibba004 bash[30897]: cluster 2021-03-10T20:19:34.391143+0000 mgr.gibba009.xiladd (mgr.34457) 522 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:35 gibba004 bash[31878]: cluster 2021-03-10T20:19:34.391143+0000 mgr.gibba009.xiladd (mgr.34457) 522 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:36.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:35 gibba009 bash[26136]: cluster 2021-03-10T20:19:34.391143+0000 mgr.gibba009.xiladd (mgr.34457) 522 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:36.822 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:19:37.051 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:19:37.051 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:19:37.051 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:19:37.052 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:19:37.052 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (9m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:19:37.052 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (8m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:19:37.052 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:19:37.052 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:19:37.053 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:19:37.053 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (14m) 5m ago 14m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:19:37.053 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (14m) 3m ago 14m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:19:37.053 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:19:37.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:19:37.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:19:37.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:19:37.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:19:37.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:19:37.055 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:19:37.055 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:19:37.055 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (13m) 3m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:19:37.055 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:37.056 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:37.302 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:19:37.302 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:19:37.303 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:37.303 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:37.303 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:19:37.303 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:37.304 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:37.304 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:19:37.304 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:19:37.304 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:19:37.304 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:19:37.305 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:19:37.305 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:19:37.305 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:19:37.305 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:19:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[30897]: cluster 2021-03-10T20:19:36.392980+0000 mgr.gibba009.xiladd (mgr.34457) 523 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[30897]: audit 2021-03-10T20:19:36.815139+0000 mgr.gibba009.xiladd (mgr.34457) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[30897]: audit 2021-03-10T20:19:37.041155+0000 mgr.gibba009.xiladd (mgr.34457) 525 : audit [DBG] from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[30897]: audit 2021-03-10T20:19:37.302868+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.2.104:0/420056444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[31878]: cluster 2021-03-10T20:19:36.392980+0000 mgr.gibba009.xiladd (mgr.34457) 523 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[31878]: audit 2021-03-10T20:19:36.815139+0000 mgr.gibba009.xiladd (mgr.34457) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[31878]: audit 2021-03-10T20:19:37.041155+0000 mgr.gibba009.xiladd (mgr.34457) 525 : audit [DBG] from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:37 gibba004 bash[31878]: audit 2021-03-10T20:19:37.302868+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.2.104:0/420056444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:37 gibba009 bash[26136]: cluster 2021-03-10T20:19:36.392980+0000 mgr.gibba009.xiladd (mgr.34457) 523 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:37 gibba009 bash[26136]: audit 2021-03-10T20:19:36.815139+0000 mgr.gibba009.xiladd (mgr.34457) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:37 gibba009 bash[26136]: audit 2021-03-10T20:19:37.041155+0000 mgr.gibba009.xiladd (mgr.34457) 525 : audit [DBG] from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:37 gibba009 bash[26136]: audit 2021-03-10T20:19:37.302868+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.2.104:0/420056444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: cluster 2021-03-10T20:19:38.394368+0000 mgr.gibba009.xiladd (mgr.34457) 526 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.516922+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.517607+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.518096+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.518282+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.518949+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.519520+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.520541+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.521305+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.611383+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.612533+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.612979+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[30897]: audit 2021-03-10T20:19:39.614009+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: cluster 2021-03-10T20:19:38.394368+0000 mgr.gibba009.xiladd (mgr.34457) 526 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.516922+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.517607+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.518096+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.518282+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.518949+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.519520+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.520541+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.521305+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.611383+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.612533+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.612979+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:39 gibba004 bash[31878]: audit 2021-03-10T20:19:39.614009+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:40.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: cluster 2021-03-10T20:19:38.394368+0000 mgr.gibba009.xiladd (mgr.34457) 526 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:40.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.516922+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.517607+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.518096+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:19:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.518282+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.518949+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.519520+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.520541+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:19:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.521305+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:19:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.611383+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.612533+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.612979+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:39 gibba009 bash[26136]: audit 2021-03-10T20:19:39.614009+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:42.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:41 gibba004 bash[31878]: cluster 2021-03-10T20:19:40.395889+0000 mgr.gibba009.xiladd (mgr.34457) 527 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:41 gibba004 bash[30897]: cluster 2021-03-10T20:19:40.395889+0000 mgr.gibba009.xiladd (mgr.34457) 527 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:42.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:41 gibba009 bash[26136]: cluster 2021-03-10T20:19:40.395889+0000 mgr.gibba009.xiladd (mgr.34457) 527 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:44.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:44 gibba004 bash[31878]: cluster 2021-03-10T20:19:42.397256+0000 mgr.gibba009.xiladd (mgr.34457) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:44 gibba004 bash[30897]: cluster 2021-03-10T20:19:42.397256+0000 mgr.gibba009.xiladd (mgr.34457) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:44.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:44 gibba009 bash[26136]: cluster 2021-03-10T20:19:42.397256+0000 mgr.gibba009.xiladd (mgr.34457) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:46.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: cluster 2021-03-10T20:19:44.398552+0000 mgr.gibba009.xiladd (mgr.34457) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:46.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.581300+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.805227+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:19:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.809135+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.810417+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.811655+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.812733+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.815251+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:46 gibba009 bash[26136]: audit 2021-03-10T20:19:45.816849+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: cluster 2021-03-10T20:19:44.398552+0000 mgr.gibba009.xiladd (mgr.34457) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.581300+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.805227+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:19:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.809135+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.810417+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.811655+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.812733+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.815251+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[30897]: audit 2021-03-10T20:19:45.816849+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: cluster 2021-03-10T20:19:44.398552+0000 mgr.gibba009.xiladd (mgr.34457) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.581300+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.805227+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:19:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.809135+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.810417+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.811655+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.812733+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.815251+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:46 gibba004 bash[31878]: audit 2021-03-10T20:19:45.816849+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:47.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.587905+0000 mgr.gibba009.xiladd (mgr.34457) 530 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:19:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.589998+0000 mgr.gibba009.xiladd (mgr.34457) 531 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:19:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.809767+0000 mgr.gibba009.xiladd (mgr.34457) 532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.811320+0000 mgr.gibba009.xiladd (mgr.34457) 533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.812539+0000 mgr.gibba009.xiladd (mgr.34457) 534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.812588+0000 mgr.gibba009.xiladd (mgr.34457) 535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.813709+0000 mgr.gibba009.xiladd (mgr.34457) 536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.813746+0000 mgr.gibba009.xiladd (mgr.34457) 537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.814788+0000 mgr.gibba009.xiladd (mgr.34457) 538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.816112+0000 mgr.gibba009.xiladd (mgr.34457) 539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.816147+0000 mgr.gibba009.xiladd (mgr.34457) 540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.817571+0000 mgr.gibba009.xiladd (mgr.34457) 541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.817896+0000 mgr.gibba009.xiladd (mgr.34457) 542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:47.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.818862+0000 mgr.gibba009.xiladd (mgr.34457) 543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:47.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.818899+0000 mgr.gibba009.xiladd (mgr.34457) 544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:47.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[30897]: cephadm 2021-03-10T20:19:45.819074+0000 mgr.gibba009.xiladd (mgr.34457) 545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.587905+0000 mgr.gibba009.xiladd (mgr.34457) 530 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:19:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.589998+0000 mgr.gibba009.xiladd (mgr.34457) 531 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:19:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.809767+0000 mgr.gibba009.xiladd (mgr.34457) 532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.811320+0000 mgr.gibba009.xiladd (mgr.34457) 533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.812539+0000 mgr.gibba009.xiladd (mgr.34457) 534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.812588+0000 mgr.gibba009.xiladd (mgr.34457) 535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.813709+0000 mgr.gibba009.xiladd (mgr.34457) 536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.813746+0000 mgr.gibba009.xiladd (mgr.34457) 537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.814788+0000 mgr.gibba009.xiladd (mgr.34457) 538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.816112+0000 mgr.gibba009.xiladd (mgr.34457) 539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.816147+0000 mgr.gibba009.xiladd (mgr.34457) 540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.817571+0000 mgr.gibba009.xiladd (mgr.34457) 541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.817896+0000 mgr.gibba009.xiladd (mgr.34457) 542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.818862+0000 mgr.gibba009.xiladd (mgr.34457) 543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:47.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.818899+0000 mgr.gibba009.xiladd (mgr.34457) 544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:47.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:47 gibba004 bash[31878]: cephadm 2021-03-10T20:19:45.819074+0000 mgr.gibba009.xiladd (mgr.34457) 545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.587905+0000 mgr.gibba009.xiladd (mgr.34457) 530 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:19:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.589998+0000 mgr.gibba009.xiladd (mgr.34457) 531 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:19:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.809767+0000 mgr.gibba009.xiladd (mgr.34457) 532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.811320+0000 mgr.gibba009.xiladd (mgr.34457) 533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.812539+0000 mgr.gibba009.xiladd (mgr.34457) 534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.812588+0000 mgr.gibba009.xiladd (mgr.34457) 535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.813709+0000 mgr.gibba009.xiladd (mgr.34457) 536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.813746+0000 mgr.gibba009.xiladd (mgr.34457) 537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.814788+0000 mgr.gibba009.xiladd (mgr.34457) 538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.816112+0000 mgr.gibba009.xiladd (mgr.34457) 539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.816147+0000 mgr.gibba009.xiladd (mgr.34457) 540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.817571+0000 mgr.gibba009.xiladd (mgr.34457) 541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.817896+0000 mgr.gibba009.xiladd (mgr.34457) 542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:47.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.818862+0000 mgr.gibba009.xiladd (mgr.34457) 543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:47.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.818899+0000 mgr.gibba009.xiladd (mgr.34457) 544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:47.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:47 gibba009 bash[26136]: cephadm 2021-03-10T20:19:45.819074+0000 mgr.gibba009.xiladd (mgr.34457) 545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:19:48.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:48 gibba004 bash[30897]: cluster 2021-03-10T20:19:46.400452+0000 mgr.gibba009.xiladd (mgr.34457) 546 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:48.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:48 gibba004 bash[31878]: cluster 2021-03-10T20:19:46.400452+0000 mgr.gibba009.xiladd (mgr.34457) 546 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:48.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:48 gibba009 bash[26136]: cluster 2021-03-10T20:19:46.400452+0000 mgr.gibba009.xiladd (mgr.34457) 546 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:50.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:50 gibba004 bash[30897]: cluster 2021-03-10T20:19:48.402109+0000 mgr.gibba009.xiladd (mgr.34457) 547 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:50.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:50 gibba004 bash[31878]: cluster 2021-03-10T20:19:48.402109+0000 mgr.gibba009.xiladd (mgr.34457) 547 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:50.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:50 gibba009 bash[26136]: cluster 2021-03-10T20:19:48.402109+0000 mgr.gibba009.xiladd (mgr.34457) 547 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:52.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:52 gibba004 bash[30897]: cluster 2021-03-10T20:19:50.403704+0000 mgr.gibba009.xiladd (mgr.34457) 548 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:52.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:52 gibba004 bash[31878]: cluster 2021-03-10T20:19:50.403704+0000 mgr.gibba009.xiladd (mgr.34457) 548 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:52.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:52 gibba009 bash[26136]: cluster 2021-03-10T20:19:50.403704+0000 mgr.gibba009.xiladd (mgr.34457) 548 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:54 gibba004 bash[30897]: cluster 2021-03-10T20:19:52.405243+0000 mgr.gibba009.xiladd (mgr.34457) 549 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:54.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:54 gibba004 bash[31878]: cluster 2021-03-10T20:19:52.405243+0000 mgr.gibba009.xiladd (mgr.34457) 549 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:54.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:54 gibba009 bash[26136]: cluster 2021-03-10T20:19:52.405243+0000 mgr.gibba009.xiladd (mgr.34457) 549 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:56 gibba004 bash[30897]: cluster 2021-03-10T20:19:54.406609+0000 mgr.gibba009.xiladd (mgr.34457) 550 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:56.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:56 gibba004 bash[31878]: cluster 2021-03-10T20:19:54.406609+0000 mgr.gibba009.xiladd (mgr.34457) 550 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:56.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:56 gibba009 bash[26136]: cluster 2021-03-10T20:19:54.406609+0000 mgr.gibba009.xiladd (mgr.34457) 550 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:58.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:19:58 gibba009 bash[26136]: cluster 2021-03-10T20:19:56.408498+0000 mgr.gibba009.xiladd (mgr.34457) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:58.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:19:58 gibba004 bash[30897]: cluster 2021-03-10T20:19:56.408498+0000 mgr.gibba009.xiladd (mgr.34457) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:58.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:19:58 gibba004 bash[31878]: cluster 2021-03-10T20:19:56.408498+0000 mgr.gibba009.xiladd (mgr.34457) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:00.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:00 gibba004 bash[31878]: cluster 2021-03-10T20:19:58.410174+0000 mgr.gibba009.xiladd (mgr.34457) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:00.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:00 gibba004 bash[31878]: cluster 2021-03-10T20:20:00.000189+0000 mon.a (mon.0) 614 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:00 gibba004 bash[30897]: debug 2021-03-10T20:19:59.996+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:00 gibba004 bash[30897]: cluster 2021-03-10T20:19:58.410174+0000 mgr.gibba009.xiladd (mgr.34457) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:00.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:00 gibba004 bash[30897]: cluster 2021-03-10T20:20:00.000189+0000 mon.a (mon.0) 614 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:00 gibba009 bash[26136]: cluster 2021-03-10T20:19:58.410174+0000 mgr.gibba009.xiladd (mgr.34457) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:00.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:00 gibba009 bash[26136]: cluster 2021-03-10T20:20:00.000189+0000 mon.a (mon.0) 614 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:02 gibba004 bash[30897]: cluster 2021-03-10T20:20:00.411773+0000 mgr.gibba009.xiladd (mgr.34457) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:02 gibba004 bash[30897]: cephadm 2021-03-10T20:20:00.835020+0000 mgr.gibba009.xiladd (mgr.34457) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:02 gibba004 bash[31878]: cluster 2021-03-10T20:20:00.411773+0000 mgr.gibba009.xiladd (mgr.34457) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:02 gibba004 bash[31878]: cephadm 2021-03-10T20:20:00.835020+0000 mgr.gibba009.xiladd (mgr.34457) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:02.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:02 gibba009 bash[26136]: cluster 2021-03-10T20:20:00.411773+0000 mgr.gibba009.xiladd (mgr.34457) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:02.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:02 gibba009 bash[26136]: cephadm 2021-03-10T20:20:00.835020+0000 mgr.gibba009.xiladd (mgr.34457) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:03.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:03 gibba004 bash[30897]: cluster 2021-03-10T20:20:02.413393+0000 mgr.gibba009.xiladd (mgr.34457) 555 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:03.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:03 gibba004 bash[31878]: cluster 2021-03-10T20:20:02.413393+0000 mgr.gibba009.xiladd (mgr.34457) 555 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:03.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:03 gibba009 bash[26136]: cluster 2021-03-10T20:20:02.413393+0000 mgr.gibba009.xiladd (mgr.34457) 555 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:06.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:05 gibba004 bash[30897]: cluster 2021-03-10T20:20:04.414634+0000 mgr.gibba009.xiladd (mgr.34457) 556 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:06.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:05 gibba004 bash[31878]: cluster 2021-03-10T20:20:04.414634+0000 mgr.gibba009.xiladd (mgr.34457) 556 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:06.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:05 gibba009 bash[26136]: cluster 2021-03-10T20:20:04.414634+0000 mgr.gibba009.xiladd (mgr.34457) 556 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:07.549 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:20:07.779 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:20:07.779 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:20:07.780 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:20:07.780 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:20:07.780 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:20:07.780 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:20:07.781 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:20:07.781 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:20:07.781 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:20:07.781 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (14m) 6m ago 14m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:20:07.781 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (14m) 4m ago 14m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:20:07.782 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:20:07.782 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:20:07.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:20:07.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:20:07.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:20:07.784 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:20:07.784 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:20:07.784 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:20:07.784 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (13m) 4m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:20:07.785 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:07.785 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:08.030 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:20:08.031 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:20:08.031 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:08.031 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:08.032 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:20:08.032 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:08.032 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:08.032 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:20:08.032 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:20:08.033 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:08.033 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:20:08.033 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:20:08.033 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:20:08.034 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:20:08.034 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:20:08.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:07 gibba004 bash[30897]: cluster 2021-03-10T20:20:06.416284+0000 mgr.gibba009.xiladd (mgr.34457) 557 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:08.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:07 gibba004 bash[31878]: cluster 2021-03-10T20:20:06.416284+0000 mgr.gibba009.xiladd (mgr.34457) 557 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:08.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:07 gibba009 bash[26136]: cluster 2021-03-10T20:20:06.416284+0000 mgr.gibba009.xiladd (mgr.34457) 557 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:09.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[30897]: audit 2021-03-10T20:20:07.542081+0000 mgr.gibba009.xiladd (mgr.34457) 558 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[30897]: audit 2021-03-10T20:20:07.768609+0000 mgr.gibba009.xiladd (mgr.34457) 559 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[30897]: audit 2021-03-10T20:20:08.031282+0000 mon.a (mon.0) 615 : audit [DBG] from='client.? 172.21.2.104:0/992554494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[31878]: audit 2021-03-10T20:20:07.542081+0000 mgr.gibba009.xiladd (mgr.34457) 558 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[31878]: audit 2021-03-10T20:20:07.768609+0000 mgr.gibba009.xiladd (mgr.34457) 559 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:08 gibba004 bash[31878]: audit 2021-03-10T20:20:08.031282+0000 mon.a (mon.0) 615 : audit [DBG] from='client.? 172.21.2.104:0/992554494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:09.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:08 gibba009 bash[26136]: audit 2021-03-10T20:20:07.542081+0000 mgr.gibba009.xiladd (mgr.34457) 558 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:08 gibba009 bash[26136]: audit 2021-03-10T20:20:07.768609+0000 mgr.gibba009.xiladd (mgr.34457) 559 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:09.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:08 gibba009 bash[26136]: audit 2021-03-10T20:20:08.031282+0000 mon.a (mon.0) 615 : audit [DBG] from='client.? 172.21.2.104:0/992554494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:10.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:09 gibba004 bash[30897]: cluster 2021-03-10T20:20:08.417930+0000 mgr.gibba009.xiladd (mgr.34457) 560 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:10.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:09 gibba004 bash[31878]: cluster 2021-03-10T20:20:08.417930+0000 mgr.gibba009.xiladd (mgr.34457) 560 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:10.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:09 gibba009 bash[26136]: cluster 2021-03-10T20:20:08.417930+0000 mgr.gibba009.xiladd (mgr.34457) 560 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:12.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:11 gibba004 bash[30897]: cluster 2021-03-10T20:20:10.419395+0000 mgr.gibba009.xiladd (mgr.34457) 561 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:12.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:11 gibba004 bash[31878]: cluster 2021-03-10T20:20:10.419395+0000 mgr.gibba009.xiladd (mgr.34457) 561 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:12.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:11 gibba009 bash[26136]: cluster 2021-03-10T20:20:10.419395+0000 mgr.gibba009.xiladd (mgr.34457) 561 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:14.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:13 gibba004 bash[30897]: cluster 2021-03-10T20:20:12.420901+0000 mgr.gibba009.xiladd (mgr.34457) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:14.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:13 gibba004 bash[31878]: cluster 2021-03-10T20:20:12.420901+0000 mgr.gibba009.xiladd (mgr.34457) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:14.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:13 gibba009 bash[26136]: cluster 2021-03-10T20:20:12.420901+0000 mgr.gibba009.xiladd (mgr.34457) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:16.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:15 gibba004 bash[30897]: cluster 2021-03-10T20:20:14.422168+0000 mgr.gibba009.xiladd (mgr.34457) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:16.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:15 gibba004 bash[31878]: cluster 2021-03-10T20:20:14.422168+0000 mgr.gibba009.xiladd (mgr.34457) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:16.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:15 gibba009 bash[26136]: cluster 2021-03-10T20:20:14.422168+0000 mgr.gibba009.xiladd (mgr.34457) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:17.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:16 gibba004 bash[30897]: cephadm 2021-03-10T20:20:15.850837+0000 mgr.gibba009.xiladd (mgr.34457) 564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:17.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:16 gibba004 bash[31878]: cephadm 2021-03-10T20:20:15.850837+0000 mgr.gibba009.xiladd (mgr.34457) 564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:17.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:16 gibba009 bash[26136]: cephadm 2021-03-10T20:20:15.850837+0000 mgr.gibba009.xiladd (mgr.34457) 564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:17 gibba004 bash[30897]: cluster 2021-03-10T20:20:16.423892+0000 mgr.gibba009.xiladd (mgr.34457) 565 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:18.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:17 gibba004 bash[31878]: cluster 2021-03-10T20:20:16.423892+0000 mgr.gibba009.xiladd (mgr.34457) 565 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:18.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:17 gibba009 bash[26136]: cluster 2021-03-10T20:20:16.423892+0000 mgr.gibba009.xiladd (mgr.34457) 565 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:20.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:19 gibba004 bash[30897]: cluster 2021-03-10T20:20:18.425555+0000 mgr.gibba009.xiladd (mgr.34457) 566 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:19 gibba004 bash[31878]: cluster 2021-03-10T20:20:18.425555+0000 mgr.gibba009.xiladd (mgr.34457) 566 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:20.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:19 gibba009 bash[26136]: cluster 2021-03-10T20:20:18.425555+0000 mgr.gibba009.xiladd (mgr.34457) 566 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:22.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:21 gibba004 bash[30897]: cluster 2021-03-10T20:20:20.427205+0000 mgr.gibba009.xiladd (mgr.34457) 567 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:21 gibba004 bash[31878]: cluster 2021-03-10T20:20:20.427205+0000 mgr.gibba009.xiladd (mgr.34457) 567 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:22.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:21 gibba009 bash[26136]: cluster 2021-03-10T20:20:20.427205+0000 mgr.gibba009.xiladd (mgr.34457) 567 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:24.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:23 gibba004 bash[30897]: cluster 2021-03-10T20:20:22.428846+0000 mgr.gibba009.xiladd (mgr.34457) 568 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:24.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:23 gibba004 bash[31878]: cluster 2021-03-10T20:20:22.428846+0000 mgr.gibba009.xiladd (mgr.34457) 568 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:24.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:23 gibba009 bash[26136]: cluster 2021-03-10T20:20:22.428846+0000 mgr.gibba009.xiladd (mgr.34457) 568 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:25 gibba004 bash[30897]: cluster 2021-03-10T20:20:24.430091+0000 mgr.gibba009.xiladd (mgr.34457) 569 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:26.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:25 gibba004 bash[31878]: cluster 2021-03-10T20:20:24.430091+0000 mgr.gibba009.xiladd (mgr.34457) 569 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:26.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:25 gibba009 bash[26136]: cluster 2021-03-10T20:20:24.430091+0000 mgr.gibba009.xiladd (mgr.34457) 569 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:28.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:27 gibba004 bash[30897]: cluster 2021-03-10T20:20:26.431978+0000 mgr.gibba009.xiladd (mgr.34457) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:28.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:27 gibba004 bash[31878]: cluster 2021-03-10T20:20:26.431978+0000 mgr.gibba009.xiladd (mgr.34457) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:27 gibba009 bash[26136]: cluster 2021-03-10T20:20:26.431978+0000 mgr.gibba009.xiladd (mgr.34457) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:29 gibba004 bash[30897]: cluster 2021-03-10T20:20:28.433663+0000 mgr.gibba009.xiladd (mgr.34457) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:30.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:29 gibba004 bash[31878]: cluster 2021-03-10T20:20:28.433663+0000 mgr.gibba009.xiladd (mgr.34457) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:30.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:29 gibba009 bash[26136]: cluster 2021-03-10T20:20:28.433663+0000 mgr.gibba009.xiladd (mgr.34457) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:31 gibba004 bash[30897]: cluster 2021-03-10T20:20:30.435286+0000 mgr.gibba009.xiladd (mgr.34457) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:31 gibba004 bash[30897]: cephadm 2021-03-10T20:20:30.866798+0000 mgr.gibba009.xiladd (mgr.34457) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:32.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:31 gibba004 bash[31878]: cluster 2021-03-10T20:20:30.435286+0000 mgr.gibba009.xiladd (mgr.34457) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:32.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:31 gibba004 bash[31878]: cephadm 2021-03-10T20:20:30.866798+0000 mgr.gibba009.xiladd (mgr.34457) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:32.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:31 gibba009 bash[26136]: cluster 2021-03-10T20:20:30.435286+0000 mgr.gibba009.xiladd (mgr.34457) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:32.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:31 gibba009 bash[26136]: cephadm 2021-03-10T20:20:30.866798+0000 mgr.gibba009.xiladd (mgr.34457) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:34.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:33 gibba004 bash[30897]: cluster 2021-03-10T20:20:32.436948+0000 mgr.gibba009.xiladd (mgr.34457) 574 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:34.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:33 gibba004 bash[31878]: cluster 2021-03-10T20:20:32.436948+0000 mgr.gibba009.xiladd (mgr.34457) 574 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:34.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:33 gibba009 bash[26136]: cluster 2021-03-10T20:20:32.436948+0000 mgr.gibba009.xiladd (mgr.34457) 574 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:36.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:35 gibba004 bash[30897]: cluster 2021-03-10T20:20:34.438312+0000 mgr.gibba009.xiladd (mgr.34457) 575 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:36.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:35 gibba004 bash[31878]: cluster 2021-03-10T20:20:34.438312+0000 mgr.gibba009.xiladd (mgr.34457) 575 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:35 gibba009 bash[26136]: cluster 2021-03-10T20:20:34.438312+0000 mgr.gibba009.xiladd (mgr.34457) 575 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:38.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:37 gibba004 bash[30897]: cluster 2021-03-10T20:20:36.440305+0000 mgr.gibba009.xiladd (mgr.34457) 576 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:37 gibba004 bash[31878]: cluster 2021-03-10T20:20:36.440305+0000 mgr.gibba009.xiladd (mgr.34457) 576 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:37 gibba009 bash[26136]: cluster 2021-03-10T20:20:36.440305+0000 mgr.gibba009.xiladd (mgr.34457) 576 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:38.273 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:20:38.501 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:20:38.501 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:20:38.501 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:20:38.502 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:20:38.502 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:20:38.502 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (9m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:20:38.502 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:20:38.503 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:20:38.503 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:20:38.503 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (15m) 6m ago 15m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:20:38.503 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (15m) 4m ago 15m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:20:38.504 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:20:38.504 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:20:38.504 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:20:38.504 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:20:38.505 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:20:38.506 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:20:38.506 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:20:38.506 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:20:38.507 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (14m) 4m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:20:38.507 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:38.507 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:38.748 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:20:38.749 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:20:38.749 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:38.749 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:38.749 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:20:38.750 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:38.750 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:38.750 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:20:38.750 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:20:38.751 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:20:38.751 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:20:38.751 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:20:38.751 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:20:38.751 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:20:38.752 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:20:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:38.265187+0000 mgr.gibba009.xiladd (mgr.34457) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: cluster 2021-03-10T20:20:38.442029+0000 mgr.gibba009.xiladd (mgr.34457) 578 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:38.490306+0000 mgr.gibba009.xiladd (mgr.34457) 579 : audit [DBG] from='client.54439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:38.749190+0000 mon.c (mon.1) 232 : audit [DBG] from='client.? 172.21.2.104:0/3512593239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.528502+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.529237+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.529702+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.530332+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.530877+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.531596+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.531838+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.532761+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.617053+0000 mon.c (mon.1) 237 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.617722+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.618250+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[30897]: audit 2021-03-10T20:20:39.619373+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:38.265187+0000 mgr.gibba009.xiladd (mgr.34457) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: cluster 2021-03-10T20:20:38.442029+0000 mgr.gibba009.xiladd (mgr.34457) 578 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:38.490306+0000 mgr.gibba009.xiladd (mgr.34457) 579 : audit [DBG] from='client.54439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:38.749190+0000 mon.c (mon.1) 232 : audit [DBG] from='client.? 172.21.2.104:0/3512593239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.528502+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.529237+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.529702+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.530332+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.530877+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.531596+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.531838+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.532761+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.617053+0000 mon.c (mon.1) 237 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.617722+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.618250+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:39 gibba004 bash[31878]: audit 2021-03-10T20:20:39.619373+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:40.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:38.265187+0000 mgr.gibba009.xiladd (mgr.34457) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: cluster 2021-03-10T20:20:38.442029+0000 mgr.gibba009.xiladd (mgr.34457) 578 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:38.490306+0000 mgr.gibba009.xiladd (mgr.34457) 579 : audit [DBG] from='client.54439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:38.749190+0000 mon.c (mon.1) 232 : audit [DBG] from='client.? 172.21.2.104:0/3512593239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.528502+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.529237+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.529702+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:20:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.530332+0000 mon.c (mon.1) 235 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.530877+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T20:20:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.531596+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.531838+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.532761+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:20:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.617053+0000 mon.c (mon.1) 237 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.617722+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.618250+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:39 gibba009 bash[26136]: audit 2021-03-10T20:20:39.619373+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:42.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:41 gibba004 bash[30897]: cluster 2021-03-10T20:20:40.443645+0000 mgr.gibba009.xiladd (mgr.34457) 580 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:42.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:41 gibba004 bash[31878]: cluster 2021-03-10T20:20:40.443645+0000 mgr.gibba009.xiladd (mgr.34457) 580 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:41 gibba009 bash[26136]: cluster 2021-03-10T20:20:40.443645+0000 mgr.gibba009.xiladd (mgr.34457) 580 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:43 gibba004 bash[30897]: cluster 2021-03-10T20:20:42.445136+0000 mgr.gibba009.xiladd (mgr.34457) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:44.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:43 gibba004 bash[31878]: cluster 2021-03-10T20:20:42.445136+0000 mgr.gibba009.xiladd (mgr.34457) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:44.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:43 gibba009 bash[26136]: cluster 2021-03-10T20:20:42.445136+0000 mgr.gibba009.xiladd (mgr.34457) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:46.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:45 gibba004 bash[30897]: cluster 2021-03-10T20:20:44.446398+0000 mgr.gibba009.xiladd (mgr.34457) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:46.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:45 gibba004 bash[31878]: cluster 2021-03-10T20:20:44.446398+0000 mgr.gibba009.xiladd (mgr.34457) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:46.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:45 gibba009 bash[26136]: cluster 2021-03-10T20:20:44.446398+0000 mgr.gibba009.xiladd (mgr.34457) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:45.882520+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: cephadm 2021-03-10T20:20:45.889341+0000 mgr.gibba009.xiladd (mgr.34457) 583 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:20:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: cephadm 2021-03-10T20:20:45.890796+0000 mgr.gibba009.xiladd (mgr.34457) 584 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:20:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.109114+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:20:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.112945+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.114426+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.115648+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.117172+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.120327+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[30897]: audit 2021-03-10T20:20:46.121838+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:45.882520+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: cephadm 2021-03-10T20:20:45.889341+0000 mgr.gibba009.xiladd (mgr.34457) 583 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:20:47.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: cephadm 2021-03-10T20:20:45.890796+0000 mgr.gibba009.xiladd (mgr.34457) 584 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:20:47.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.109114+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:20:47.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.112945+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.114426+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.115648+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.117172+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.120327+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:46 gibba004 bash[31878]: audit 2021-03-10T20:20:46.121838+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:45.882520+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: cephadm 2021-03-10T20:20:45.889341+0000 mgr.gibba009.xiladd (mgr.34457) 583 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:20:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: cephadm 2021-03-10T20:20:45.890796+0000 mgr.gibba009.xiladd (mgr.34457) 584 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:20:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.109114+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:20:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.112945+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.114426+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.115648+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.117172+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.120327+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:46 gibba009 bash[26136]: audit 2021-03-10T20:20:46.121838+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.113580+0000 mgr.gibba009.xiladd (mgr.34457) 585 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.115146+0000 mgr.gibba009.xiladd (mgr.34457) 586 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.116550+0000 mgr.gibba009.xiladd (mgr.34457) 587 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.116603+0000 mgr.gibba009.xiladd (mgr.34457) 588 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.117985+0000 mgr.gibba009.xiladd (mgr.34457) 589 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.118026+0000 mgr.gibba009.xiladd (mgr.34457) 590 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.119248+0000 mgr.gibba009.xiladd (mgr.34457) 591 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.120987+0000 mgr.gibba009.xiladd (mgr.34457) 592 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.121027+0000 mgr.gibba009.xiladd (mgr.34457) 593 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.122392+0000 mgr.gibba009.xiladd (mgr.34457) 594 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.122754+0000 mgr.gibba009.xiladd (mgr.34457) 595 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.123926+0000 mgr.gibba009.xiladd (mgr.34457) 596 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.123970+0000 mgr.gibba009.xiladd (mgr.34457) 597 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cephadm 2021-03-10T20:20:46.124111+0000 mgr.gibba009.xiladd (mgr.34457) 598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:48.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[30897]: cluster 2021-03-10T20:20:46.448254+0000 mgr.gibba009.xiladd (mgr.34457) 599 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.113580+0000 mgr.gibba009.xiladd (mgr.34457) 585 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.115146+0000 mgr.gibba009.xiladd (mgr.34457) 586 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.116550+0000 mgr.gibba009.xiladd (mgr.34457) 587 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.116603+0000 mgr.gibba009.xiladd (mgr.34457) 588 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.117985+0000 mgr.gibba009.xiladd (mgr.34457) 589 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.118026+0000 mgr.gibba009.xiladd (mgr.34457) 590 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.119248+0000 mgr.gibba009.xiladd (mgr.34457) 591 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:48.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.120987+0000 mgr.gibba009.xiladd (mgr.34457) 592 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:48.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.121027+0000 mgr.gibba009.xiladd (mgr.34457) 593 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:48.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.122392+0000 mgr.gibba009.xiladd (mgr.34457) 594 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:48.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.122754+0000 mgr.gibba009.xiladd (mgr.34457) 595 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:48.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.123926+0000 mgr.gibba009.xiladd (mgr.34457) 596 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:48.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.123970+0000 mgr.gibba009.xiladd (mgr.34457) 597 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:48.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cephadm 2021-03-10T20:20:46.124111+0000 mgr.gibba009.xiladd (mgr.34457) 598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:48.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:47 gibba004 bash[31878]: cluster 2021-03-10T20:20:46.448254+0000 mgr.gibba009.xiladd (mgr.34457) 599 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.113580+0000 mgr.gibba009.xiladd (mgr.34457) 585 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:48.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.115146+0000 mgr.gibba009.xiladd (mgr.34457) 586 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.116550+0000 mgr.gibba009.xiladd (mgr.34457) 587 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.116603+0000 mgr.gibba009.xiladd (mgr.34457) 588 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.117985+0000 mgr.gibba009.xiladd (mgr.34457) 589 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.118026+0000 mgr.gibba009.xiladd (mgr.34457) 590 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.119248+0000 mgr.gibba009.xiladd (mgr.34457) 591 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.120987+0000 mgr.gibba009.xiladd (mgr.34457) 592 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.121027+0000 mgr.gibba009.xiladd (mgr.34457) 593 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.122392+0000 mgr.gibba009.xiladd (mgr.34457) 594 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.122754+0000 mgr.gibba009.xiladd (mgr.34457) 595 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.123926+0000 mgr.gibba009.xiladd (mgr.34457) 596 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.123970+0000 mgr.gibba009.xiladd (mgr.34457) 597 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cephadm 2021-03-10T20:20:46.124111+0000 mgr.gibba009.xiladd (mgr.34457) 598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:20:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:47 gibba009 bash[26136]: cluster 2021-03-10T20:20:46.448254+0000 mgr.gibba009.xiladd (mgr.34457) 599 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:49 gibba004 bash[30897]: cluster 2021-03-10T20:20:48.449933+0000 mgr.gibba009.xiladd (mgr.34457) 600 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:49 gibba004 bash[31878]: cluster 2021-03-10T20:20:48.449933+0000 mgr.gibba009.xiladd (mgr.34457) 600 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:50.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:49 gibba009 bash[26136]: cluster 2021-03-10T20:20:48.449933+0000 mgr.gibba009.xiladd (mgr.34457) 600 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:51 gibba004 bash[30897]: cluster 2021-03-10T20:20:50.451312+0000 mgr.gibba009.xiladd (mgr.34457) 601 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:51 gibba004 bash[31878]: cluster 2021-03-10T20:20:50.451312+0000 mgr.gibba009.xiladd (mgr.34457) 601 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.084 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:51 gibba009 bash[26136]: cluster 2021-03-10T20:20:50.451312+0000 mgr.gibba009.xiladd (mgr.34457) 601 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:53 gibba004 bash[30897]: cluster 2021-03-10T20:20:52.452889+0000 mgr.gibba009.xiladd (mgr.34457) 602 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:53 gibba004 bash[31878]: cluster 2021-03-10T20:20:52.452889+0000 mgr.gibba009.xiladd (mgr.34457) 602 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:53 gibba009 bash[26136]: cluster 2021-03-10T20:20:52.452889+0000 mgr.gibba009.xiladd (mgr.34457) 602 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:56.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:55 gibba004 bash[30897]: cluster 2021-03-10T20:20:54.454238+0000 mgr.gibba009.xiladd (mgr.34457) 603 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:56.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:55 gibba004 bash[31878]: cluster 2021-03-10T20:20:54.454238+0000 mgr.gibba009.xiladd (mgr.34457) 603 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:56.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:55 gibba009 bash[26136]: cluster 2021-03-10T20:20:54.454238+0000 mgr.gibba009.xiladd (mgr.34457) 603 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:57 gibba004 bash[30897]: cluster 2021-03-10T20:20:56.456060+0000 mgr.gibba009.xiladd (mgr.34457) 604 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:58.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:57 gibba004 bash[31878]: cluster 2021-03-10T20:20:56.456060+0000 mgr.gibba009.xiladd (mgr.34457) 604 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:58.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:57 gibba009 bash[26136]: cluster 2021-03-10T20:20:56.456060+0000 mgr.gibba009.xiladd (mgr.34457) 604 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:00.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:20:59 gibba004 bash[30897]: cluster 2021-03-10T20:20:58.457723+0000 mgr.gibba009.xiladd (mgr.34457) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:00.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:20:59 gibba004 bash[31878]: cluster 2021-03-10T20:20:58.457723+0000 mgr.gibba009.xiladd (mgr.34457) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:00.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:20:59 gibba009 bash[26136]: cluster 2021-03-10T20:20:58.457723+0000 mgr.gibba009.xiladd (mgr.34457) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:02.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:01 gibba004 bash[30897]: cluster 2021-03-10T20:21:00.459335+0000 mgr.gibba009.xiladd (mgr.34457) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:02.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:01 gibba004 bash[31878]: cluster 2021-03-10T20:21:00.459335+0000 mgr.gibba009.xiladd (mgr.34457) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:01 gibba009 bash[26136]: cluster 2021-03-10T20:21:00.459335+0000 mgr.gibba009.xiladd (mgr.34457) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:03.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:02 gibba004 bash[30897]: cephadm 2021-03-10T20:21:01.140037+0000 mgr.gibba009.xiladd (mgr.34457) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:03.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:02 gibba004 bash[31878]: cephadm 2021-03-10T20:21:01.140037+0000 mgr.gibba009.xiladd (mgr.34457) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:03.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:02 gibba009 bash[26136]: cephadm 2021-03-10T20:21:01.140037+0000 mgr.gibba009.xiladd (mgr.34457) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:04.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:03 gibba004 bash[30897]: cluster 2021-03-10T20:21:02.461009+0000 mgr.gibba009.xiladd (mgr.34457) 608 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:04.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:03 gibba004 bash[31878]: cluster 2021-03-10T20:21:02.461009+0000 mgr.gibba009.xiladd (mgr.34457) 608 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:04.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:03 gibba009 bash[26136]: cluster 2021-03-10T20:21:02.461009+0000 mgr.gibba009.xiladd (mgr.34457) 608 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:06.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:05 gibba004 bash[30897]: cluster 2021-03-10T20:21:04.462252+0000 mgr.gibba009.xiladd (mgr.34457) 609 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:06.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:05 gibba004 bash[31878]: cluster 2021-03-10T20:21:04.462252+0000 mgr.gibba009.xiladd (mgr.34457) 609 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:06.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:05 gibba009 bash[26136]: cluster 2021-03-10T20:21:04.462252+0000 mgr.gibba009.xiladd (mgr.34457) 609 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:08.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:07 gibba004 bash[30897]: cluster 2021-03-10T20:21:06.463849+0000 mgr.gibba009.xiladd (mgr.34457) 610 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:08.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:07 gibba004 bash[31878]: cluster 2021-03-10T20:21:06.463849+0000 mgr.gibba009.xiladd (mgr.34457) 610 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:08.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:07 gibba009 bash[26136]: cluster 2021-03-10T20:21:06.463849+0000 mgr.gibba009.xiladd (mgr.34457) 610 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:08.995 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:21:09.250 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:21:09.251 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:21:09.251 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:21:09.252 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:21:09.252 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:21:09.252 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:21:09.253 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:21:09.253 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:21:09.254 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:21:09.262 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (15m) 7m ago 15m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:21:09.263 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (15m) 5m ago 15m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:21:09.263 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:21:09.263 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:21:09.263 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:21:09.264 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:21:09.264 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:21:09.264 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:21:09.264 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:21:09.264 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:21:09.265 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (14m) 5m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:21:09.265 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:09.265 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:09.506 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:21:09.506 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:21:09.507 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:09.507 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:09.507 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:21:09.507 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:09.507 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:09.508 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:21:09.508 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:21:09.508 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:09.508 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:21:09.508 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:21:09.509 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:21:09.509 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:21:09.509 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:21:10.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:09 gibba009 bash[26136]: cluster 2021-03-10T20:21:08.465561+0000 mgr.gibba009.xiladd (mgr.34457) 611 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:10.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:09 gibba009 bash[26136]: audit 2021-03-10T20:21:08.987860+0000 mgr.gibba009.xiladd (mgr.34457) 612 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:10.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:09 gibba009 bash[26136]: audit 2021-03-10T20:21:09.506649+0000 mon.c (mon.1) 246 : audit [DBG] from='client.? 172.21.2.104:0/476097864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[30897]: cluster 2021-03-10T20:21:08.465561+0000 mgr.gibba009.xiladd (mgr.34457) 611 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[30897]: audit 2021-03-10T20:21:08.987860+0000 mgr.gibba009.xiladd (mgr.34457) 612 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:10.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[30897]: audit 2021-03-10T20:21:09.506649+0000 mon.c (mon.1) 246 : audit [DBG] from='client.? 172.21.2.104:0/476097864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[31878]: cluster 2021-03-10T20:21:08.465561+0000 mgr.gibba009.xiladd (mgr.34457) 611 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[31878]: audit 2021-03-10T20:21:08.987860+0000 mgr.gibba009.xiladd (mgr.34457) 612 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:09 gibba004 bash[31878]: audit 2021-03-10T20:21:09.506649+0000 mon.c (mon.1) 246 : audit [DBG] from='client.? 172.21.2.104:0/476097864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:11.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:10 gibba009 bash[26136]: audit 2021-03-10T20:21:09.211576+0000 mgr.gibba009.xiladd (mgr.34457) 613 : audit [DBG] from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:11.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:10 gibba004 bash[30897]: audit 2021-03-10T20:21:09.211576+0000 mgr.gibba009.xiladd (mgr.34457) 613 : audit [DBG] from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:11.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:10 gibba004 bash[31878]: audit 2021-03-10T20:21:09.211576+0000 mgr.gibba009.xiladd (mgr.34457) 613 : audit [DBG] from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:12.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:11 gibba009 bash[26136]: cluster 2021-03-10T20:21:10.467107+0000 mgr.gibba009.xiladd (mgr.34457) 614 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:11 gibba004 bash[30897]: cluster 2021-03-10T20:21:10.467107+0000 mgr.gibba009.xiladd (mgr.34457) 614 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:12.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:11 gibba004 bash[31878]: cluster 2021-03-10T20:21:10.467107+0000 mgr.gibba009.xiladd (mgr.34457) 614 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:13 gibba004 bash[30897]: cluster 2021-03-10T20:21:12.468620+0000 mgr.gibba009.xiladd (mgr.34457) 615 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:13 gibba004 bash[31878]: cluster 2021-03-10T20:21:12.468620+0000 mgr.gibba009.xiladd (mgr.34457) 615 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:14.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:13 gibba009 bash[26136]: cluster 2021-03-10T20:21:12.468620+0000 mgr.gibba009.xiladd (mgr.34457) 615 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:16.154 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:15 gibba009 bash[26136]: cluster 2021-03-10T20:21:14.469937+0000 mgr.gibba009.xiladd (mgr.34457) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:15 gibba004 bash[30897]: cluster 2021-03-10T20:21:14.469937+0000 mgr.gibba009.xiladd (mgr.34457) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:16.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:15 gibba004 bash[31878]: cluster 2021-03-10T20:21:14.469937+0000 mgr.gibba009.xiladd (mgr.34457) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:17 gibba004 bash[30897]: cephadm 2021-03-10T20:21:16.156036+0000 mgr.gibba009.xiladd (mgr.34457) 617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:17 gibba004 bash[30897]: cluster 2021-03-10T20:21:16.471629+0000 mgr.gibba009.xiladd (mgr.34457) 618 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:17 gibba004 bash[31878]: cephadm 2021-03-10T20:21:16.156036+0000 mgr.gibba009.xiladd (mgr.34457) 617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:17 gibba004 bash[31878]: cluster 2021-03-10T20:21:16.471629+0000 mgr.gibba009.xiladd (mgr.34457) 618 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:18.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:17 gibba009 bash[26136]: cephadm 2021-03-10T20:21:16.156036+0000 mgr.gibba009.xiladd (mgr.34457) 617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:18.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:17 gibba009 bash[26136]: cluster 2021-03-10T20:21:16.471629+0000 mgr.gibba009.xiladd (mgr.34457) 618 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:19 gibba004 bash[30897]: cluster 2021-03-10T20:21:18.473375+0000 mgr.gibba009.xiladd (mgr.34457) 619 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:20.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:19 gibba004 bash[31878]: cluster 2021-03-10T20:21:18.473375+0000 mgr.gibba009.xiladd (mgr.34457) 619 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:20.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:19 gibba009 bash[26136]: cluster 2021-03-10T20:21:18.473375+0000 mgr.gibba009.xiladd (mgr.34457) 619 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:21 gibba004 bash[30897]: cluster 2021-03-10T20:21:20.474975+0000 mgr.gibba009.xiladd (mgr.34457) 620 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:22.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:21 gibba004 bash[31878]: cluster 2021-03-10T20:21:20.474975+0000 mgr.gibba009.xiladd (mgr.34457) 620 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:22.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:21 gibba009 bash[26136]: cluster 2021-03-10T20:21:20.474975+0000 mgr.gibba009.xiladd (mgr.34457) 620 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:23 gibba004 bash[30897]: cluster 2021-03-10T20:21:22.476393+0000 mgr.gibba009.xiladd (mgr.34457) 621 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:24.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:23 gibba004 bash[31878]: cluster 2021-03-10T20:21:22.476393+0000 mgr.gibba009.xiladd (mgr.34457) 621 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:24.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:23 gibba009 bash[26136]: cluster 2021-03-10T20:21:22.476393+0000 mgr.gibba009.xiladd (mgr.34457) 621 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:25 gibba004 bash[30897]: cluster 2021-03-10T20:21:24.477694+0000 mgr.gibba009.xiladd (mgr.34457) 622 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:26.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:25 gibba004 bash[31878]: cluster 2021-03-10T20:21:24.477694+0000 mgr.gibba009.xiladd (mgr.34457) 622 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:26.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:25 gibba009 bash[26136]: cluster 2021-03-10T20:21:24.477694+0000 mgr.gibba009.xiladd (mgr.34457) 622 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:27 gibba004 bash[30897]: cluster 2021-03-10T20:21:26.479286+0000 mgr.gibba009.xiladd (mgr.34457) 623 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:27 gibba004 bash[31878]: cluster 2021-03-10T20:21:26.479286+0000 mgr.gibba009.xiladd (mgr.34457) 623 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:28.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:27 gibba009 bash[26136]: cluster 2021-03-10T20:21:26.479286+0000 mgr.gibba009.xiladd (mgr.34457) 623 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:29 gibba004 bash[30897]: cluster 2021-03-10T20:21:28.480999+0000 mgr.gibba009.xiladd (mgr.34457) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:30.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:29 gibba004 bash[31878]: cluster 2021-03-10T20:21:28.480999+0000 mgr.gibba009.xiladd (mgr.34457) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:30.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:29 gibba009 bash[26136]: cluster 2021-03-10T20:21:28.480999+0000 mgr.gibba009.xiladd (mgr.34457) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:31 gibba004 bash[30897]: cluster 2021-03-10T20:21:30.482342+0000 mgr.gibba009.xiladd (mgr.34457) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:32.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:31 gibba004 bash[31878]: cluster 2021-03-10T20:21:30.482342+0000 mgr.gibba009.xiladd (mgr.34457) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:32.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:31 gibba009 bash[26136]: cluster 2021-03-10T20:21:30.482342+0000 mgr.gibba009.xiladd (mgr.34457) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:33.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:32 gibba004 bash[30897]: cephadm 2021-03-10T20:21:31.172117+0000 mgr.gibba009.xiladd (mgr.34457) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:33.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:32 gibba004 bash[31878]: cephadm 2021-03-10T20:21:31.172117+0000 mgr.gibba009.xiladd (mgr.34457) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:33.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:32 gibba009 bash[26136]: cephadm 2021-03-10T20:21:31.172117+0000 mgr.gibba009.xiladd (mgr.34457) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:33 gibba004 bash[30897]: cluster 2021-03-10T20:21:32.483690+0000 mgr.gibba009.xiladd (mgr.34457) 627 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:34.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:33 gibba004 bash[31878]: cluster 2021-03-10T20:21:32.483690+0000 mgr.gibba009.xiladd (mgr.34457) 627 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:34.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:33 gibba009 bash[26136]: cluster 2021-03-10T20:21:32.483690+0000 mgr.gibba009.xiladd (mgr.34457) 627 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:35 gibba004 bash[30897]: cluster 2021-03-10T20:21:34.484944+0000 mgr.gibba009.xiladd (mgr.34457) 628 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:36.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:35 gibba004 bash[31878]: cluster 2021-03-10T20:21:34.484944+0000 mgr.gibba009.xiladd (mgr.34457) 628 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:36.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:35 gibba009 bash[26136]: cluster 2021-03-10T20:21:34.484944+0000 mgr.gibba009.xiladd (mgr.34457) 628 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:37 gibba004 bash[30897]: cluster 2021-03-10T20:21:36.486656+0000 mgr.gibba009.xiladd (mgr.34457) 629 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:38.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:37 gibba004 bash[31878]: cluster 2021-03-10T20:21:36.486656+0000 mgr.gibba009.xiladd (mgr.34457) 629 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:38.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:37 gibba009 bash[26136]: cluster 2021-03-10T20:21:36.486656+0000 mgr.gibba009.xiladd (mgr.34457) 629 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:39.753 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:21:39.977 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:21:39.977 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:21:39.977 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:21:39.977 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:21:39.978 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:21:39.978 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (10m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:21:39.978 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:21:39.978 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:21:39.979 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:21:39.979 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (16m) 7m ago 16m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:21:39.979 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (16m) 5m ago 16m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:21:39.979 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:21:39.979 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:21:39.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:21:39.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:21:39.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:21:39.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:21:39.981 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:21:39.981 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:21:39.981 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (15m) 5m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:21:39.981 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:39.981 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:40.226 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:21:40.226 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:21:40.227 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:40.227 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:40.227 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:21:40.227 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:40.228 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:40.228 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:21:40.228 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:21:40.228 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:21:40.228 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:21:40.229 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:21:40.229 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:21:40.229 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:21:40.229 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:21:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: cluster 2021-03-10T20:21:38.488292+0000 mgr.gibba009.xiladd (mgr.34457) 630 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.540537+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.540741+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.540916+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.541110+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.541166+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.541677+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.541857+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.542077+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.623955+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.624071+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.624485+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[30897]: audit 2021-03-10T20:21:39.624749+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:40.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: cluster 2021-03-10T20:21:38.488292+0000 mgr.gibba009.xiladd (mgr.34457) 630 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:40.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.540537+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.540741+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.540916+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.541110+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.541166+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.541677+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.541857+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.542077+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.623955+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.624071+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.624485+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:39 gibba004 bash[31878]: audit 2021-03-10T20:21:39.624749+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:40.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: cluster 2021-03-10T20:21:38.488292+0000 mgr.gibba009.xiladd (mgr.34457) 630 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.540537+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.540741+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.540916+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.541110+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:21:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.541166+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.541677+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.541857+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:21:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.542077+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:21:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.623955+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.624071+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.624485+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:39 gibba009 bash[26136]: audit 2021-03-10T20:21:39.624749+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:41.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[30897]: audit 2021-03-10T20:21:39.745965+0000 mgr.gibba009.xiladd (mgr.34457) 631 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[30897]: audit 2021-03-10T20:21:39.969095+0000 mgr.gibba009.xiladd (mgr.34457) 632 : audit [DBG] from='client.44496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[30897]: audit 2021-03-10T20:21:40.226872+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.2.104:0/2244055577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:41.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[31878]: audit 2021-03-10T20:21:39.745965+0000 mgr.gibba009.xiladd (mgr.34457) 631 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[31878]: audit 2021-03-10T20:21:39.969095+0000 mgr.gibba009.xiladd (mgr.34457) 632 : audit [DBG] from='client.44496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:40 gibba004 bash[31878]: audit 2021-03-10T20:21:40.226872+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.2.104:0/2244055577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:41.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:40 gibba009 bash[26136]: audit 2021-03-10T20:21:39.745965+0000 mgr.gibba009.xiladd (mgr.34457) 631 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:40 gibba009 bash[26136]: audit 2021-03-10T20:21:39.969095+0000 mgr.gibba009.xiladd (mgr.34457) 632 : audit [DBG] from='client.44496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:41.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:40 gibba009 bash[26136]: audit 2021-03-10T20:21:40.226872+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.2.104:0/2244055577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:41 gibba004 bash[30897]: cluster 2021-03-10T20:21:40.489917+0000 mgr.gibba009.xiladd (mgr.34457) 633 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:42.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:41 gibba004 bash[31878]: cluster 2021-03-10T20:21:40.489917+0000 mgr.gibba009.xiladd (mgr.34457) 633 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:42.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:41 gibba009 bash[26136]: cluster 2021-03-10T20:21:40.489917+0000 mgr.gibba009.xiladd (mgr.34457) 633 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:43 gibba004 bash[30897]: cluster 2021-03-10T20:21:42.491601+0000 mgr.gibba009.xiladd (mgr.34457) 634 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:44.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:43 gibba004 bash[31878]: cluster 2021-03-10T20:21:42.491601+0000 mgr.gibba009.xiladd (mgr.34457) 634 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:44.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:43 gibba009 bash[26136]: cluster 2021-03-10T20:21:42.491601+0000 mgr.gibba009.xiladd (mgr.34457) 634 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:46.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:45 gibba004 bash[30897]: cluster 2021-03-10T20:21:44.493044+0000 mgr.gibba009.xiladd (mgr.34457) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:46.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:45 gibba004 bash[31878]: cluster 2021-03-10T20:21:44.493044+0000 mgr.gibba009.xiladd (mgr.34457) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:46.334 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:45 gibba009 bash[26136]: cluster 2021-03-10T20:21:44.493044+0000 mgr.gibba009.xiladd (mgr.34457) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.188027+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.398194+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.401929+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.605180+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.609233+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.610891+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.612536+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.614023+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.617717+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:46 gibba004 bash[30897]: audit 2021-03-10T20:21:46.619319+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.188027+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.398194+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.401929+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.605180+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.609233+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.610891+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.612536+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.614023+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.617717+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:47 gibba004 bash[31878]: audit 2021-03-10T20:21:46.619319+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.188027+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.398194+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.401929+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.605180+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:21:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.609233+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:47.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.610891+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.612536+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.614023+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.617717+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:47.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:47 gibba009 bash[26136]: audit 2021-03-10T20:21:46.619319+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.400400+0000 mgr.gibba009.xiladd (mgr.34457) 636 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:21:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.404361+0000 mgr.gibba009.xiladd (mgr.34457) 637 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:21:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cluster 2021-03-10T20:21:46.493648+0000 mgr.gibba009.xiladd (mgr.34457) 638 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.609395+0000 mgr.gibba009.xiladd (mgr.34457) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.611379+0000 mgr.gibba009.xiladd (mgr.34457) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.612974+0000 mgr.gibba009.xiladd (mgr.34457) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.613049+0000 mgr.gibba009.xiladd (mgr.34457) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.614528+0000 mgr.gibba009.xiladd (mgr.34457) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.614588+0000 mgr.gibba009.xiladd (mgr.34457) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.615853+0000 mgr.gibba009.xiladd (mgr.34457) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.618110+0000 mgr.gibba009.xiladd (mgr.34457) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.618170+0000 mgr.gibba009.xiladd (mgr.34457) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.619560+0000 mgr.gibba009.xiladd (mgr.34457) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.619907+0000 mgr.gibba009.xiladd (mgr.34457) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.621108+0000 mgr.gibba009.xiladd (mgr.34457) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.621202+0000 mgr.gibba009.xiladd (mgr.34457) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[30897]: cephadm 2021-03-10T20:21:46.621334+0000 mgr.gibba009.xiladd (mgr.34457) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.400400+0000 mgr.gibba009.xiladd (mgr.34457) 636 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:21:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.404361+0000 mgr.gibba009.xiladd (mgr.34457) 637 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:21:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cluster 2021-03-10T20:21:46.493648+0000 mgr.gibba009.xiladd (mgr.34457) 638 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.609395+0000 mgr.gibba009.xiladd (mgr.34457) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.611379+0000 mgr.gibba009.xiladd (mgr.34457) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.612974+0000 mgr.gibba009.xiladd (mgr.34457) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.613049+0000 mgr.gibba009.xiladd (mgr.34457) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.614528+0000 mgr.gibba009.xiladd (mgr.34457) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.614588+0000 mgr.gibba009.xiladd (mgr.34457) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.615853+0000 mgr.gibba009.xiladd (mgr.34457) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.618110+0000 mgr.gibba009.xiladd (mgr.34457) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.618170+0000 mgr.gibba009.xiladd (mgr.34457) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.619560+0000 mgr.gibba009.xiladd (mgr.34457) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.619907+0000 mgr.gibba009.xiladd (mgr.34457) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.621108+0000 mgr.gibba009.xiladd (mgr.34457) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.621202+0000 mgr.gibba009.xiladd (mgr.34457) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:48 gibba004 bash[31878]: cephadm 2021-03-10T20:21:46.621334+0000 mgr.gibba009.xiladd (mgr.34457) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:48.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.400400+0000 mgr.gibba009.xiladd (mgr.34457) 636 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:21:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.404361+0000 mgr.gibba009.xiladd (mgr.34457) 637 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:21:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cluster 2021-03-10T20:21:46.493648+0000 mgr.gibba009.xiladd (mgr.34457) 638 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.609395+0000 mgr.gibba009.xiladd (mgr.34457) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.611379+0000 mgr.gibba009.xiladd (mgr.34457) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.612974+0000 mgr.gibba009.xiladd (mgr.34457) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.613049+0000 mgr.gibba009.xiladd (mgr.34457) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.614528+0000 mgr.gibba009.xiladd (mgr.34457) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.614588+0000 mgr.gibba009.xiladd (mgr.34457) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.615853+0000 mgr.gibba009.xiladd (mgr.34457) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.618110+0000 mgr.gibba009.xiladd (mgr.34457) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.618170+0000 mgr.gibba009.xiladd (mgr.34457) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.619560+0000 mgr.gibba009.xiladd (mgr.34457) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.619907+0000 mgr.gibba009.xiladd (mgr.34457) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.621108+0000 mgr.gibba009.xiladd (mgr.34457) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.621202+0000 mgr.gibba009.xiladd (mgr.34457) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:48 gibba009 bash[26136]: cephadm 2021-03-10T20:21:46.621334+0000 mgr.gibba009.xiladd (mgr.34457) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:21:50.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:50 gibba004 bash[30897]: cluster 2021-03-10T20:21:48.495048+0000 mgr.gibba009.xiladd (mgr.34457) 653 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:50.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:50 gibba004 bash[31878]: cluster 2021-03-10T20:21:48.495048+0000 mgr.gibba009.xiladd (mgr.34457) 653 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:50.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:50 gibba009 bash[26136]: cluster 2021-03-10T20:21:48.495048+0000 mgr.gibba009.xiladd (mgr.34457) 653 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:52.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:52 gibba004 bash[30897]: cluster 2021-03-10T20:21:50.496680+0000 mgr.gibba009.xiladd (mgr.34457) 654 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:52.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:52 gibba004 bash[31878]: cluster 2021-03-10T20:21:50.496680+0000 mgr.gibba009.xiladd (mgr.34457) 654 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:52.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:52 gibba009 bash[26136]: cluster 2021-03-10T20:21:50.496680+0000 mgr.gibba009.xiladd (mgr.34457) 654 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:54 gibba004 bash[30897]: cluster 2021-03-10T20:21:52.498376+0000 mgr.gibba009.xiladd (mgr.34457) 655 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:54.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:54 gibba004 bash[31878]: cluster 2021-03-10T20:21:52.498376+0000 mgr.gibba009.xiladd (mgr.34457) 655 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:54.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:54 gibba009 bash[26136]: cluster 2021-03-10T20:21:52.498376+0000 mgr.gibba009.xiladd (mgr.34457) 655 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:56 gibba004 bash[30897]: cluster 2021-03-10T20:21:54.499769+0000 mgr.gibba009.xiladd (mgr.34457) 656 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:56.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:56 gibba004 bash[31878]: cluster 2021-03-10T20:21:54.499769+0000 mgr.gibba009.xiladd (mgr.34457) 656 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:56.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:56 gibba009 bash[26136]: cluster 2021-03-10T20:21:54.499769+0000 mgr.gibba009.xiladd (mgr.34457) 656 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:21:58 gibba004 bash[30897]: cluster 2021-03-10T20:21:56.501724+0000 mgr.gibba009.xiladd (mgr.34457) 657 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:58.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:21:58 gibba004 bash[31878]: cluster 2021-03-10T20:21:56.501724+0000 mgr.gibba009.xiladd (mgr.34457) 657 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:58.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:21:58 gibba009 bash[26136]: cluster 2021-03-10T20:21:56.501724+0000 mgr.gibba009.xiladd (mgr.34457) 657 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:00 gibba004 bash[30897]: cluster 2021-03-10T20:21:58.503411+0000 mgr.gibba009.xiladd (mgr.34457) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:00.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:00 gibba004 bash[31878]: cluster 2021-03-10T20:21:58.503411+0000 mgr.gibba009.xiladd (mgr.34457) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:00.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:00 gibba009 bash[26136]: cluster 2021-03-10T20:21:58.503411+0000 mgr.gibba009.xiladd (mgr.34457) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:02 gibba004 bash[30897]: cluster 2021-03-10T20:22:00.505094+0000 mgr.gibba009.xiladd (mgr.34457) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:02.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:02 gibba004 bash[31878]: cluster 2021-03-10T20:22:00.505094+0000 mgr.gibba009.xiladd (mgr.34457) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:02 gibba009 bash[26136]: cluster 2021-03-10T20:22:00.505094+0000 mgr.gibba009.xiladd (mgr.34457) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:03 gibba009 bash[26136]: cephadm 2021-03-10T20:22:01.637098+0000 mgr.gibba009.xiladd (mgr.34457) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:03.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:03 gibba004 bash[30897]: cephadm 2021-03-10T20:22:01.637098+0000 mgr.gibba009.xiladd (mgr.34457) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:03.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:03 gibba004 bash[31878]: cephadm 2021-03-10T20:22:01.637098+0000 mgr.gibba009.xiladd (mgr.34457) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:04.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:04 gibba009 bash[26136]: cluster 2021-03-10T20:22:02.506536+0000 mgr.gibba009.xiladd (mgr.34457) 661 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:04 gibba004 bash[30897]: cluster 2021-03-10T20:22:02.506536+0000 mgr.gibba009.xiladd (mgr.34457) 661 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:04.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:04 gibba004 bash[31878]: cluster 2021-03-10T20:22:02.506536+0000 mgr.gibba009.xiladd (mgr.34457) 661 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:06.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:06 gibba009 bash[26136]: cluster 2021-03-10T20:22:04.507787+0000 mgr.gibba009.xiladd (mgr.34457) 662 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:06 gibba004 bash[30897]: cluster 2021-03-10T20:22:04.507787+0000 mgr.gibba009.xiladd (mgr.34457) 662 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:06.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:06 gibba004 bash[31878]: cluster 2021-03-10T20:22:04.507787+0000 mgr.gibba009.xiladd (mgr.34457) 662 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:08 gibba004 bash[30897]: cluster 2021-03-10T20:22:06.509628+0000 mgr.gibba009.xiladd (mgr.34457) 663 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:08.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:08 gibba004 bash[31878]: cluster 2021-03-10T20:22:06.509628+0000 mgr.gibba009.xiladd (mgr.34457) 663 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:08.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:08 gibba009 bash[26136]: cluster 2021-03-10T20:22:06.509628+0000 mgr.gibba009.xiladd (mgr.34457) 663 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:10.469 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:22:10.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:10 gibba004 bash[30897]: cluster 2021-03-10T20:22:08.511142+0000 mgr.gibba009.xiladd (mgr.34457) 664 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:10.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:10 gibba004 bash[31878]: cluster 2021-03-10T20:22:08.511142+0000 mgr.gibba009.xiladd (mgr.34457) 664 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:10.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:10 gibba009 bash[26136]: cluster 2021-03-10T20:22:08.511142+0000 mgr.gibba009.xiladd (mgr.34457) 664 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:10.699 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:22:10.700 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:22:10.700 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:22:10.700 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:22:10.700 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:22:10.701 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:22:10.701 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:22:10.701 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:22:10.701 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:22:10.702 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (16m) 8m ago 16m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:22:10.702 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (16m) 6m ago 16m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:22:10.702 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:22:10.702 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:22:10.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:22:10.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:22:10.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:22:10.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:22:10.703 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:22:10.704 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:22:10.704 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (16m) 6m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:22:10.704 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:10.704 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:10.949 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:22:10.949 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:22:10.950 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:10.950 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:10.950 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:22:10.951 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:10.951 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:10.951 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:22:10.951 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:22:10.952 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:10.952 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:22:10.952 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:22:10.952 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:22:10.953 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:22:10.953 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:22:11.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:11 gibba004 bash[30897]: audit 2021-03-10T20:22:10.949624+0000 mon.c (mon.1) 260 : audit [DBG] from='client.? 172.21.2.104:0/995956178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:11.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:11 gibba004 bash[31878]: audit 2021-03-10T20:22:10.949624+0000 mon.c (mon.1) 260 : audit [DBG] from='client.? 172.21.2.104:0/995956178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:11.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:11 gibba009 bash[26136]: audit 2021-03-10T20:22:10.949624+0000 mon.c (mon.1) 260 : audit [DBG] from='client.? 172.21.2.104:0/995956178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[30897]: audit 2021-03-10T20:22:10.461832+0000 mgr.gibba009.xiladd (mgr.34457) 665 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:12.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[30897]: cluster 2021-03-10T20:22:10.512799+0000 mgr.gibba009.xiladd (mgr.34457) 666 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:12.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[30897]: audit 2021-03-10T20:22:10.688007+0000 mgr.gibba009.xiladd (mgr.34457) 667 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[31878]: audit 2021-03-10T20:22:10.461832+0000 mgr.gibba009.xiladd (mgr.34457) 665 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[31878]: cluster 2021-03-10T20:22:10.512799+0000 mgr.gibba009.xiladd (mgr.34457) 666 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:12.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:12 gibba004 bash[31878]: audit 2021-03-10T20:22:10.688007+0000 mgr.gibba009.xiladd (mgr.34457) 667 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:12.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:12 gibba009 bash[26136]: audit 2021-03-10T20:22:10.461832+0000 mgr.gibba009.xiladd (mgr.34457) 665 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:12.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:12 gibba009 bash[26136]: cluster 2021-03-10T20:22:10.512799+0000 mgr.gibba009.xiladd (mgr.34457) 666 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:12.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:12 gibba009 bash[26136]: audit 2021-03-10T20:22:10.688007+0000 mgr.gibba009.xiladd (mgr.34457) 667 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:14 gibba004 bash[30897]: cluster 2021-03-10T20:22:12.514089+0000 mgr.gibba009.xiladd (mgr.34457) 668 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:14.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:14 gibba004 bash[31878]: cluster 2021-03-10T20:22:12.514089+0000 mgr.gibba009.xiladd (mgr.34457) 668 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:14.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:14 gibba009 bash[26136]: cluster 2021-03-10T20:22:12.514089+0000 mgr.gibba009.xiladd (mgr.34457) 668 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:16.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:16 gibba004 bash[30897]: cluster 2021-03-10T20:22:14.515340+0000 mgr.gibba009.xiladd (mgr.34457) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:16.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:16 gibba004 bash[31878]: cluster 2021-03-10T20:22:14.515340+0000 mgr.gibba009.xiladd (mgr.34457) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:16.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:16 gibba009 bash[26136]: cluster 2021-03-10T20:22:14.515340+0000 mgr.gibba009.xiladd (mgr.34457) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:18.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:18 gibba004 bash[30897]: cluster 2021-03-10T20:22:16.517095+0000 mgr.gibba009.xiladd (mgr.34457) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:18.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:18 gibba004 bash[30897]: cephadm 2021-03-10T20:22:16.653188+0000 mgr.gibba009.xiladd (mgr.34457) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:18 gibba004 bash[31878]: cluster 2021-03-10T20:22:16.517095+0000 mgr.gibba009.xiladd (mgr.34457) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:18 gibba004 bash[31878]: cephadm 2021-03-10T20:22:16.653188+0000 mgr.gibba009.xiladd (mgr.34457) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:18.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:18 gibba009 bash[26136]: cluster 2021-03-10T20:22:16.517095+0000 mgr.gibba009.xiladd (mgr.34457) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:18.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:18 gibba009 bash[26136]: cephadm 2021-03-10T20:22:16.653188+0000 mgr.gibba009.xiladd (mgr.34457) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:20.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:19 gibba004 bash[30897]: cluster 2021-03-10T20:22:18.518739+0000 mgr.gibba009.xiladd (mgr.34457) 672 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:20.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:19 gibba004 bash[31878]: cluster 2021-03-10T20:22:18.518739+0000 mgr.gibba009.xiladd (mgr.34457) 672 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:20.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:19 gibba009 bash[26136]: cluster 2021-03-10T20:22:18.518739+0000 mgr.gibba009.xiladd (mgr.34457) 672 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:21 gibba004 bash[30897]: cluster 2021-03-10T20:22:20.520243+0000 mgr.gibba009.xiladd (mgr.34457) 673 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:22.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:21 gibba004 bash[31878]: cluster 2021-03-10T20:22:20.520243+0000 mgr.gibba009.xiladd (mgr.34457) 673 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:22.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:21 gibba009 bash[26136]: cluster 2021-03-10T20:22:20.520243+0000 mgr.gibba009.xiladd (mgr.34457) 673 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:23 gibba004 bash[30897]: cluster 2021-03-10T20:22:22.521841+0000 mgr.gibba009.xiladd (mgr.34457) 674 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:23 gibba004 bash[31878]: cluster 2021-03-10T20:22:22.521841+0000 mgr.gibba009.xiladd (mgr.34457) 674 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:23 gibba009 bash[26136]: cluster 2021-03-10T20:22:22.521841+0000 mgr.gibba009.xiladd (mgr.34457) 674 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:25 gibba004 bash[30897]: cluster 2021-03-10T20:22:24.523085+0000 mgr.gibba009.xiladd (mgr.34457) 675 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:26.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:25 gibba004 bash[31878]: cluster 2021-03-10T20:22:24.523085+0000 mgr.gibba009.xiladd (mgr.34457) 675 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:26.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:25 gibba009 bash[26136]: cluster 2021-03-10T20:22:24.523085+0000 mgr.gibba009.xiladd (mgr.34457) 675 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:28.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:27 gibba004 bash[30897]: cluster 2021-03-10T20:22:26.524935+0000 mgr.gibba009.xiladd (mgr.34457) 676 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:28.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:27 gibba004 bash[31878]: cluster 2021-03-10T20:22:26.524935+0000 mgr.gibba009.xiladd (mgr.34457) 676 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:28.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:27 gibba009 bash[26136]: cluster 2021-03-10T20:22:26.524935+0000 mgr.gibba009.xiladd (mgr.34457) 676 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:30.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:29 gibba004 bash[30897]: cluster 2021-03-10T20:22:28.526309+0000 mgr.gibba009.xiladd (mgr.34457) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:30.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:29 gibba004 bash[31878]: cluster 2021-03-10T20:22:28.526309+0000 mgr.gibba009.xiladd (mgr.34457) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:30.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:29 gibba009 bash[26136]: cluster 2021-03-10T20:22:28.526309+0000 mgr.gibba009.xiladd (mgr.34457) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:32.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:31 gibba004 bash[30897]: cluster 2021-03-10T20:22:30.527941+0000 mgr.gibba009.xiladd (mgr.34457) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:32.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:31 gibba004 bash[31878]: cluster 2021-03-10T20:22:30.527941+0000 mgr.gibba009.xiladd (mgr.34457) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:32.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:31 gibba009 bash[26136]: cluster 2021-03-10T20:22:30.527941+0000 mgr.gibba009.xiladd (mgr.34457) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:33.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:32 gibba004 bash[30897]: cephadm 2021-03-10T20:22:31.669289+0000 mgr.gibba009.xiladd (mgr.34457) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:33.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:32 gibba004 bash[31878]: cephadm 2021-03-10T20:22:31.669289+0000 mgr.gibba009.xiladd (mgr.34457) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:33.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:32 gibba009 bash[26136]: cephadm 2021-03-10T20:22:31.669289+0000 mgr.gibba009.xiladd (mgr.34457) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:34.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:33 gibba004 bash[30897]: cluster 2021-03-10T20:22:32.529469+0000 mgr.gibba009.xiladd (mgr.34457) 680 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:34.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:33 gibba004 bash[31878]: cluster 2021-03-10T20:22:32.529469+0000 mgr.gibba009.xiladd (mgr.34457) 680 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:34.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:33 gibba009 bash[26136]: cluster 2021-03-10T20:22:32.529469+0000 mgr.gibba009.xiladd (mgr.34457) 680 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:35 gibba004 bash[30897]: cluster 2021-03-10T20:22:34.531021+0000 mgr.gibba009.xiladd (mgr.34457) 681 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:36.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:35 gibba004 bash[31878]: cluster 2021-03-10T20:22:34.531021+0000 mgr.gibba009.xiladd (mgr.34457) 681 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:36.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:35 gibba009 bash[26136]: cluster 2021-03-10T20:22:34.531021+0000 mgr.gibba009.xiladd (mgr.34457) 681 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:37 gibba004 bash[30897]: cluster 2021-03-10T20:22:36.532775+0000 mgr.gibba009.xiladd (mgr.34457) 682 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:38.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:37 gibba004 bash[31878]: cluster 2021-03-10T20:22:36.532775+0000 mgr.gibba009.xiladd (mgr.34457) 682 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:38.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:37 gibba009 bash[26136]: cluster 2021-03-10T20:22:36.532775+0000 mgr.gibba009.xiladd (mgr.34457) 682 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: cluster 2021-03-10T20:22:38.534114+0000 mgr.gibba009.xiladd (mgr.34457) 683 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:40.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.549084+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.549790+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.550504+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.550526+0000 mon.c (mon.1) 263 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.551203+0000 mon.c (mon.1) 264 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.552718+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.553609+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.554753+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.631084+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.631693+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.632262+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:39 gibba009 bash[26136]: audit 2021-03-10T20:22:39.633570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: cluster 2021-03-10T20:22:38.534114+0000 mgr.gibba009.xiladd (mgr.34457) 683 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.549084+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.549790+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.550504+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.550526+0000 mon.c (mon.1) 263 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.551203+0000 mon.c (mon.1) 264 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.552718+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.553609+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.554753+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.631084+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.631693+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.632262+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[30897]: audit 2021-03-10T20:22:39.633570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: cluster 2021-03-10T20:22:38.534114+0000 mgr.gibba009.xiladd (mgr.34457) 683 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.549084+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.549790+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.550504+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:22:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.550526+0000 mon.c (mon.1) 263 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.551203+0000 mon.c (mon.1) 264 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.552718+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.553609+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:22:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.554753+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:22:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.631084+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.631693+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.632262+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:39 gibba004 bash[31878]: audit 2021-03-10T20:22:39.633570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:41.199 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:22:41.427 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:22:41.427 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:22:41.428 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:22:41.428 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:22:41.428 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:22:41.428 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (11m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:22:41.429 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:22:41.429 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:22:41.429 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:22:41.429 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (17m) 8m ago 17m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:22:41.430 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (17m) 6m ago 17m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:22:41.430 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:22:41.430 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:22:41.430 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:22:41.431 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:22:41.431 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:22:41.431 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:22:41.431 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:22:41.432 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:22:41.432 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (16m) 6m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:22:41.432 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:41.432 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:41.678 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:22:41.914 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:22:41.914 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:41.915 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:41.915 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:22:41.915 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:41.915 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:41.916 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:22:41.916 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:22:41.916 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:22:41.916 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:22:41.917 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:22:41.917 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:22:41.917 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:22:41.917 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:22:42.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:41 gibba009 bash[26136]: cluster 2021-03-10T20:22:40.535442+0000 mgr.gibba009.xiladd (mgr.34457) 684 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:42.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:41 gibba009 bash[26136]: audit 2021-03-10T20:22:41.678581+0000 mon.c (mon.1) 267 : audit [DBG] from='client.? 172.21.2.104:0/2379707569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:41 gibba004 bash[30897]: cluster 2021-03-10T20:22:40.535442+0000 mgr.gibba009.xiladd (mgr.34457) 684 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:41 gibba004 bash[30897]: audit 2021-03-10T20:22:41.678581+0000 mon.c (mon.1) 267 : audit [DBG] from='client.? 172.21.2.104:0/2379707569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:42.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:41 gibba004 bash[31878]: cluster 2021-03-10T20:22:40.535442+0000 mgr.gibba009.xiladd (mgr.34457) 684 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:41 gibba004 bash[31878]: audit 2021-03-10T20:22:41.678581+0000 mon.c (mon.1) 267 : audit [DBG] from='client.? 172.21.2.104:0/2379707569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:43.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:42 gibba004 bash[30897]: audit 2021-03-10T20:22:41.190725+0000 mgr.gibba009.xiladd (mgr.34457) 685 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:43.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:42 gibba004 bash[30897]: audit 2021-03-10T20:22:41.415535+0000 mgr.gibba009.xiladd (mgr.34457) 686 : audit [DBG] from='client.54511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:43.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:42 gibba004 bash[31878]: audit 2021-03-10T20:22:41.190725+0000 mgr.gibba009.xiladd (mgr.34457) 685 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:43.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:42 gibba004 bash[31878]: audit 2021-03-10T20:22:41.415535+0000 mgr.gibba009.xiladd (mgr.34457) 686 : audit [DBG] from='client.54511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:43.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:42 gibba009 bash[26136]: audit 2021-03-10T20:22:41.190725+0000 mgr.gibba009.xiladd (mgr.34457) 685 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:43.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:42 gibba009 bash[26136]: audit 2021-03-10T20:22:41.415535+0000 mgr.gibba009.xiladd (mgr.34457) 686 : audit [DBG] from='client.54511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:43 gibba004 bash[30897]: cluster 2021-03-10T20:22:42.536884+0000 mgr.gibba009.xiladd (mgr.34457) 687 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:44.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:43 gibba004 bash[31878]: cluster 2021-03-10T20:22:42.536884+0000 mgr.gibba009.xiladd (mgr.34457) 687 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:44.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:43 gibba009 bash[26136]: cluster 2021-03-10T20:22:42.536884+0000 mgr.gibba009.xiladd (mgr.34457) 687 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:45 gibba004 bash[30897]: cluster 2021-03-10T20:22:44.538145+0000 mgr.gibba009.xiladd (mgr.34457) 688 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:46.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:45 gibba004 bash[31878]: cluster 2021-03-10T20:22:44.538145+0000 mgr.gibba009.xiladd (mgr.34457) 688 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:46.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:45 gibba009 bash[26136]: cluster 2021-03-10T20:22:44.538145+0000 mgr.gibba009.xiladd (mgr.34457) 688 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:47.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:46 gibba004 bash[30897]: audit 2021-03-10T20:22:46.685317+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:47.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:46 gibba004 bash[31878]: audit 2021-03-10T20:22:46.685317+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:47.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:46 gibba009 bash[26136]: audit 2021-03-10T20:22:46.685317+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cluster 2021-03-10T20:22:46.539894+0000 mgr.gibba009.xiladd (mgr.34457) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.690498+0000 mgr.gibba009.xiladd (mgr.34457) 690 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:22:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.692398+0000 mgr.gibba009.xiladd (mgr.34457) 691 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:22:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.899614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:22:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.903338+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.903397+0000 mgr.gibba009.xiladd (mgr.34457) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.904698+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.905001+0000 mgr.gibba009.xiladd (mgr.34457) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.906251+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.906493+0000 mgr.gibba009.xiladd (mgr.34457) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.906528+0000 mgr.gibba009.xiladd (mgr.34457) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.907594+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.907900+0000 mgr.gibba009.xiladd (mgr.34457) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.907938+0000 mgr.gibba009.xiladd (mgr.34457) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.909106+0000 mgr.gibba009.xiladd (mgr.34457) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.910725+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.911030+0000 mgr.gibba009.xiladd (mgr.34457) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.911081+0000 mgr.gibba009.xiladd (mgr.34457) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.912383+0000 mgr.gibba009.xiladd (mgr.34457) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: audit 2021-03-10T20:22:46.912414+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.912757+0000 mgr.gibba009.xiladd (mgr.34457) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cluster 2021-03-10T20:22:46.539894+0000 mgr.gibba009.xiladd (mgr.34457) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.690498+0000 mgr.gibba009.xiladd (mgr.34457) 690 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:22:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.692398+0000 mgr.gibba009.xiladd (mgr.34457) 691 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:22:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.899614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:22:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.903338+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.903397+0000 mgr.gibba009.xiladd (mgr.34457) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.904698+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.905001+0000 mgr.gibba009.xiladd (mgr.34457) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.906251+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.906493+0000 mgr.gibba009.xiladd (mgr.34457) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.906528+0000 mgr.gibba009.xiladd (mgr.34457) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.907594+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.907900+0000 mgr.gibba009.xiladd (mgr.34457) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.907938+0000 mgr.gibba009.xiladd (mgr.34457) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.909106+0000 mgr.gibba009.xiladd (mgr.34457) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.910725+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.911030+0000 mgr.gibba009.xiladd (mgr.34457) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:48.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.911081+0000 mgr.gibba009.xiladd (mgr.34457) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:48.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.912383+0000 mgr.gibba009.xiladd (mgr.34457) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:48.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: audit 2021-03-10T20:22:46.912414+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.912757+0000 mgr.gibba009.xiladd (mgr.34457) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:48.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.914043+0000 mgr.gibba009.xiladd (mgr.34457) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:48.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.914080+0000 mgr.gibba009.xiladd (mgr.34457) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:48.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[30897]: cephadm 2021-03-10T20:22:46.914263+0000 mgr.gibba009.xiladd (mgr.34457) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:48.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.914043+0000 mgr.gibba009.xiladd (mgr.34457) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:48.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.914080+0000 mgr.gibba009.xiladd (mgr.34457) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:48.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:47 gibba004 bash[31878]: cephadm 2021-03-10T20:22:46.914263+0000 mgr.gibba009.xiladd (mgr.34457) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cluster 2021-03-10T20:22:46.539894+0000 mgr.gibba009.xiladd (mgr.34457) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.690498+0000 mgr.gibba009.xiladd (mgr.34457) 690 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:22:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.692398+0000 mgr.gibba009.xiladd (mgr.34457) 691 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:22:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.899614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:22:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.903338+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.903397+0000 mgr.gibba009.xiladd (mgr.34457) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.904698+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.905001+0000 mgr.gibba009.xiladd (mgr.34457) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.906251+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.906493+0000 mgr.gibba009.xiladd (mgr.34457) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.906528+0000 mgr.gibba009.xiladd (mgr.34457) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.907594+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.907900+0000 mgr.gibba009.xiladd (mgr.34457) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.907938+0000 mgr.gibba009.xiladd (mgr.34457) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.909106+0000 mgr.gibba009.xiladd (mgr.34457) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.910725+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.911030+0000 mgr.gibba009.xiladd (mgr.34457) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.911081+0000 mgr.gibba009.xiladd (mgr.34457) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.912383+0000 mgr.gibba009.xiladd (mgr.34457) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: audit 2021-03-10T20:22:46.912414+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.912757+0000 mgr.gibba009.xiladd (mgr.34457) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.914043+0000 mgr.gibba009.xiladd (mgr.34457) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.914080+0000 mgr.gibba009.xiladd (mgr.34457) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:47 gibba009 bash[26136]: cephadm 2021-03-10T20:22:46.914263+0000 mgr.gibba009.xiladd (mgr.34457) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:22:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:49 gibba004 bash[30897]: cluster 2021-03-10T20:22:48.541518+0000 mgr.gibba009.xiladd (mgr.34457) 706 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:50.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:49 gibba004 bash[31878]: cluster 2021-03-10T20:22:48.541518+0000 mgr.gibba009.xiladd (mgr.34457) 706 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:50.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:49 gibba009 bash[26136]: cluster 2021-03-10T20:22:48.541518+0000 mgr.gibba009.xiladd (mgr.34457) 706 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:52.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:51 gibba004 bash[30897]: cluster 2021-03-10T20:22:50.542988+0000 mgr.gibba009.xiladd (mgr.34457) 707 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:52.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:51 gibba004 bash[31878]: cluster 2021-03-10T20:22:50.542988+0000 mgr.gibba009.xiladd (mgr.34457) 707 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:52.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:51 gibba009 bash[26136]: cluster 2021-03-10T20:22:50.542988+0000 mgr.gibba009.xiladd (mgr.34457) 707 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:53 gibba004 bash[30897]: cluster 2021-03-10T20:22:52.544619+0000 mgr.gibba009.xiladd (mgr.34457) 708 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:54.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:53 gibba004 bash[31878]: cluster 2021-03-10T20:22:52.544619+0000 mgr.gibba009.xiladd (mgr.34457) 708 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:54.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:53 gibba009 bash[26136]: cluster 2021-03-10T20:22:52.544619+0000 mgr.gibba009.xiladd (mgr.34457) 708 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:55 gibba004 bash[30897]: cluster 2021-03-10T20:22:54.545936+0000 mgr.gibba009.xiladd (mgr.34457) 709 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:56.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:55 gibba004 bash[31878]: cluster 2021-03-10T20:22:54.545936+0000 mgr.gibba009.xiladd (mgr.34457) 709 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:56.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:55 gibba009 bash[26136]: cluster 2021-03-10T20:22:54.545936+0000 mgr.gibba009.xiladd (mgr.34457) 709 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:57 gibba004 bash[30897]: cluster 2021-03-10T20:22:56.547927+0000 mgr.gibba009.xiladd (mgr.34457) 710 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:57 gibba004 bash[31878]: cluster 2021-03-10T20:22:56.547927+0000 mgr.gibba009.xiladd (mgr.34457) 710 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:58.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:57 gibba009 bash[26136]: cluster 2021-03-10T20:22:56.547927+0000 mgr.gibba009.xiladd (mgr.34457) 710 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:22:59 gibba004 bash[30897]: cluster 2021-03-10T20:22:58.549779+0000 mgr.gibba009.xiladd (mgr.34457) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:22:59 gibba004 bash[31878]: cluster 2021-03-10T20:22:58.549779+0000 mgr.gibba009.xiladd (mgr.34457) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:00.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:22:59 gibba009 bash[26136]: cluster 2021-03-10T20:22:58.549779+0000 mgr.gibba009.xiladd (mgr.34457) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:01 gibba004 bash[30897]: cluster 2021-03-10T20:23:00.551475+0000 mgr.gibba009.xiladd (mgr.34457) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:01 gibba004 bash[31878]: cluster 2021-03-10T20:23:00.551475+0000 mgr.gibba009.xiladd (mgr.34457) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:01 gibba009 bash[26136]: cluster 2021-03-10T20:23:00.551475+0000 mgr.gibba009.xiladd (mgr.34457) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:03.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:02 gibba004 bash[30897]: cephadm 2021-03-10T20:23:01.930404+0000 mgr.gibba009.xiladd (mgr.34457) 713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:03.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:02 gibba004 bash[31878]: cephadm 2021-03-10T20:23:01.930404+0000 mgr.gibba009.xiladd (mgr.34457) 713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:03.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:02 gibba009 bash[26136]: cephadm 2021-03-10T20:23:01.930404+0000 mgr.gibba009.xiladd (mgr.34457) 713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:03 gibba004 bash[30897]: cluster 2021-03-10T20:23:02.553017+0000 mgr.gibba009.xiladd (mgr.34457) 714 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:03 gibba004 bash[31878]: cluster 2021-03-10T20:23:02.553017+0000 mgr.gibba009.xiladd (mgr.34457) 714 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:04.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:03 gibba009 bash[26136]: cluster 2021-03-10T20:23:02.553017+0000 mgr.gibba009.xiladd (mgr.34457) 714 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:05 gibba004 bash[30897]: cluster 2021-03-10T20:23:04.554315+0000 mgr.gibba009.xiladd (mgr.34457) 715 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:05 gibba004 bash[31878]: cluster 2021-03-10T20:23:04.554315+0000 mgr.gibba009.xiladd (mgr.34457) 715 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:06.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:05 gibba009 bash[26136]: cluster 2021-03-10T20:23:04.554315+0000 mgr.gibba009.xiladd (mgr.34457) 715 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:07 gibba004 bash[30897]: cluster 2021-03-10T20:23:06.556034+0000 mgr.gibba009.xiladd (mgr.34457) 716 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:07 gibba004 bash[31878]: cluster 2021-03-10T20:23:06.556034+0000 mgr.gibba009.xiladd (mgr.34457) 716 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:07 gibba009 bash[26136]: cluster 2021-03-10T20:23:06.556034+0000 mgr.gibba009.xiladd (mgr.34457) 716 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:10 gibba004 bash[30897]: cluster 2021-03-10T20:23:08.557744+0000 mgr.gibba009.xiladd (mgr.34457) 717 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:10 gibba004 bash[31878]: cluster 2021-03-10T20:23:08.557744+0000 mgr.gibba009.xiladd (mgr.34457) 717 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:10.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:10 gibba009 bash[26136]: cluster 2021-03-10T20:23:08.557744+0000 mgr.gibba009.xiladd (mgr.34457) 717 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:11.931 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:23:12.162 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:23:12.162 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (12m) 9m ago 17m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:23:12.162 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:23:12.163 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:23:12.163 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:23:12.163 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:23:12.163 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:23:12.163 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:23:12.164 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:23:12.164 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (17m) 9m ago 17m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:23:12.164 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (17m) 7m ago 17m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:23:12.164 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:23:12.165 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:23:12.165 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:23:12.165 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:23:12.166 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:23:12.166 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:23:12.167 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:23:12.167 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:23:12.167 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (17m) 7m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:23:12.168 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:12.168 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:12.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:12 gibba004 bash[30897]: cluster 2021-03-10T20:23:10.559356+0000 mgr.gibba009.xiladd (mgr.34457) 718 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:12.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:12 gibba004 bash[31878]: cluster 2021-03-10T20:23:10.559356+0000 mgr.gibba009.xiladd (mgr.34457) 718 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:12.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:12 gibba009 bash[26136]: cluster 2021-03-10T20:23:10.559356+0000 mgr.gibba009.xiladd (mgr.34457) 718 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:12.413 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:23:12.413 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:23:12.413 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:12.414 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:12.414 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:23:12.414 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:12.415 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:12.415 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:23:12.415 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:23:12.416 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:12.416 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:23:12.416 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:23:12.417 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:23:12.417 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:23:12.417 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:23:13.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[30897]: audit 2021-03-10T20:23:11.923104+0000 mgr.gibba009.xiladd (mgr.34457) 719 : audit [DBG] from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[30897]: audit 2021-03-10T20:23:12.150052+0000 mgr.gibba009.xiladd (mgr.34457) 720 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[30897]: audit 2021-03-10T20:23:12.413007+0000 mon.c (mon.1) 275 : audit [DBG] from='client.? 172.21.2.104:0/1050240923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:13.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[31878]: audit 2021-03-10T20:23:11.923104+0000 mgr.gibba009.xiladd (mgr.34457) 719 : audit [DBG] from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[31878]: audit 2021-03-10T20:23:12.150052+0000 mgr.gibba009.xiladd (mgr.34457) 720 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:13 gibba004 bash[31878]: audit 2021-03-10T20:23:12.413007+0000 mon.c (mon.1) 275 : audit [DBG] from='client.? 172.21.2.104:0/1050240923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:13.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:13 gibba009 bash[26136]: audit 2021-03-10T20:23:11.923104+0000 mgr.gibba009.xiladd (mgr.34457) 719 : audit [DBG] from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:13 gibba009 bash[26136]: audit 2021-03-10T20:23:12.150052+0000 mgr.gibba009.xiladd (mgr.34457) 720 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:13.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:13 gibba009 bash[26136]: audit 2021-03-10T20:23:12.413007+0000 mon.c (mon.1) 275 : audit [DBG] from='client.? 172.21.2.104:0/1050240923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:14 gibba004 bash[30897]: cluster 2021-03-10T20:23:12.561008+0000 mgr.gibba009.xiladd (mgr.34457) 721 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:14.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:14 gibba004 bash[31878]: cluster 2021-03-10T20:23:12.561008+0000 mgr.gibba009.xiladd (mgr.34457) 721 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:14.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:14 gibba009 bash[26136]: cluster 2021-03-10T20:23:12.561008+0000 mgr.gibba009.xiladd (mgr.34457) 721 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:16 gibba004 bash[30897]: cluster 2021-03-10T20:23:14.562242+0000 mgr.gibba009.xiladd (mgr.34457) 722 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:16.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:16 gibba004 bash[31878]: cluster 2021-03-10T20:23:14.562242+0000 mgr.gibba009.xiladd (mgr.34457) 722 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:16.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:16 gibba009 bash[26136]: cluster 2021-03-10T20:23:14.562242+0000 mgr.gibba009.xiladd (mgr.34457) 722 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:18 gibba004 bash[30897]: cluster 2021-03-10T20:23:16.563844+0000 mgr.gibba009.xiladd (mgr.34457) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:18 gibba004 bash[30897]: cephadm 2021-03-10T20:23:16.946382+0000 mgr.gibba009.xiladd (mgr.34457) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:18 gibba004 bash[31878]: cluster 2021-03-10T20:23:16.563844+0000 mgr.gibba009.xiladd (mgr.34457) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:18 gibba004 bash[31878]: cephadm 2021-03-10T20:23:16.946382+0000 mgr.gibba009.xiladd (mgr.34457) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:18.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:18 gibba009 bash[26136]: cluster 2021-03-10T20:23:16.563844+0000 mgr.gibba009.xiladd (mgr.34457) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:18.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:18 gibba009 bash[26136]: cephadm 2021-03-10T20:23:16.946382+0000 mgr.gibba009.xiladd (mgr.34457) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:20 gibba004 bash[30897]: cluster 2021-03-10T20:23:18.565463+0000 mgr.gibba009.xiladd (mgr.34457) 725 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:20.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:20 gibba004 bash[31878]: cluster 2021-03-10T20:23:18.565463+0000 mgr.gibba009.xiladd (mgr.34457) 725 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:20.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:20 gibba009 bash[26136]: cluster 2021-03-10T20:23:18.565463+0000 mgr.gibba009.xiladd (mgr.34457) 725 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:22 gibba009 bash[26136]: cluster 2021-03-10T20:23:20.566837+0000 mgr.gibba009.xiladd (mgr.34457) 726 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:22 gibba004 bash[30897]: cluster 2021-03-10T20:23:20.566837+0000 mgr.gibba009.xiladd (mgr.34457) 726 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:22 gibba004 bash[31878]: cluster 2021-03-10T20:23:20.566837+0000 mgr.gibba009.xiladd (mgr.34457) 726 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:24.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:24 gibba009 bash[26136]: cluster 2021-03-10T20:23:22.568348+0000 mgr.gibba009.xiladd (mgr.34457) 727 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:24 gibba004 bash[30897]: cluster 2021-03-10T20:23:22.568348+0000 mgr.gibba009.xiladd (mgr.34457) 727 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:24.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:24 gibba004 bash[31878]: cluster 2021-03-10T20:23:22.568348+0000 mgr.gibba009.xiladd (mgr.34457) 727 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:26.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:26 gibba009 bash[26136]: cluster 2021-03-10T20:23:24.569617+0000 mgr.gibba009.xiladd (mgr.34457) 728 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:26 gibba004 bash[30897]: cluster 2021-03-10T20:23:24.569617+0000 mgr.gibba009.xiladd (mgr.34457) 728 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:26.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:26 gibba004 bash[31878]: cluster 2021-03-10T20:23:24.569617+0000 mgr.gibba009.xiladd (mgr.34457) 728 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:28 gibba004 bash[30897]: cluster 2021-03-10T20:23:26.571335+0000 mgr.gibba009.xiladd (mgr.34457) 729 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:28 gibba004 bash[31878]: cluster 2021-03-10T20:23:26.571335+0000 mgr.gibba009.xiladd (mgr.34457) 729 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:28.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:28 gibba009 bash[26136]: cluster 2021-03-10T20:23:26.571335+0000 mgr.gibba009.xiladd (mgr.34457) 729 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:30 gibba004 bash[30897]: cluster 2021-03-10T20:23:28.572773+0000 mgr.gibba009.xiladd (mgr.34457) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:30 gibba004 bash[31878]: cluster 2021-03-10T20:23:28.572773+0000 mgr.gibba009.xiladd (mgr.34457) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:30.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:30 gibba009 bash[26136]: cluster 2021-03-10T20:23:28.572773+0000 mgr.gibba009.xiladd (mgr.34457) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:32.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:32 gibba009 bash[26136]: cluster 2021-03-10T20:23:30.574140+0000 mgr.gibba009.xiladd (mgr.34457) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:32 gibba004 bash[30897]: cluster 2021-03-10T20:23:30.574140+0000 mgr.gibba009.xiladd (mgr.34457) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:32 gibba004 bash[31878]: cluster 2021-03-10T20:23:30.574140+0000 mgr.gibba009.xiladd (mgr.34457) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:33.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:33 gibba004 bash[30897]: cephadm 2021-03-10T20:23:31.962397+0000 mgr.gibba009.xiladd (mgr.34457) 732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:33.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:33 gibba004 bash[31878]: cephadm 2021-03-10T20:23:31.962397+0000 mgr.gibba009.xiladd (mgr.34457) 732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:33.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:33 gibba009 bash[26136]: cephadm 2021-03-10T20:23:31.962397+0000 mgr.gibba009.xiladd (mgr.34457) 732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:34 gibba004 bash[30897]: cluster 2021-03-10T20:23:32.575474+0000 mgr.gibba009.xiladd (mgr.34457) 733 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:34.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:34 gibba004 bash[31878]: cluster 2021-03-10T20:23:32.575474+0000 mgr.gibba009.xiladd (mgr.34457) 733 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:34.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:34 gibba009 bash[26136]: cluster 2021-03-10T20:23:32.575474+0000 mgr.gibba009.xiladd (mgr.34457) 733 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:36 gibba004 bash[30897]: cluster 2021-03-10T20:23:34.576299+0000 mgr.gibba009.xiladd (mgr.34457) 734 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:36 gibba004 bash[31878]: cluster 2021-03-10T20:23:34.576299+0000 mgr.gibba009.xiladd (mgr.34457) 734 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:36.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:36 gibba009 bash[26136]: cluster 2021-03-10T20:23:34.576299+0000 mgr.gibba009.xiladd (mgr.34457) 734 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:38 gibba004 bash[30897]: cluster 2021-03-10T20:23:36.578075+0000 mgr.gibba009.xiladd (mgr.34457) 735 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:38 gibba004 bash[31878]: cluster 2021-03-10T20:23:36.578075+0000 mgr.gibba009.xiladd (mgr.34457) 735 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:38.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:38 gibba009 bash[26136]: cluster 2021-03-10T20:23:36.578075+0000 mgr.gibba009.xiladd (mgr.34457) 735 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: cluster 2021-03-10T20:23:38.579487+0000 mgr.gibba009.xiladd (mgr.34457) 736 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.559658+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.560786+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.561051+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.561815+0000 mon.c (mon.1) 278 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.562006+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.563061+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.563319+0000 mon.c (mon.1) 279 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.564418+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.638626+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.639658+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.639900+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[30897]: audit 2021-03-10T20:23:39.640794+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: cluster 2021-03-10T20:23:38.579487+0000 mgr.gibba009.xiladd (mgr.34457) 736 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.559658+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.560786+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.561051+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.561815+0000 mon.c (mon.1) 278 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.562006+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.563061+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.563319+0000 mon.c (mon.1) 279 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.564418+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.638626+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.639658+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.639900+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:40 gibba004 bash[31878]: audit 2021-03-10T20:23:39.640794+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:40.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: cluster 2021-03-10T20:23:38.579487+0000 mgr.gibba009.xiladd (mgr.34457) 736 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:40.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.559658+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.560786+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.561051+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.561815+0000 mon.c (mon.1) 278 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.562006+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.563061+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:23:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.563319+0000 mon.c (mon.1) 279 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.564418+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:23:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.638626+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.639658+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.639900+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:40 gibba009 bash[26136]: audit 2021-03-10T20:23:39.640794+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:42.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:42 gibba004 bash[30897]: cluster 2021-03-10T20:23:40.580284+0000 mgr.gibba009.xiladd (mgr.34457) 737 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:42.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:42 gibba004 bash[31878]: cluster 2021-03-10T20:23:40.580284+0000 mgr.gibba009.xiladd (mgr.34457) 737 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:42.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:42 gibba009 bash[26136]: cluster 2021-03-10T20:23:40.580284+0000 mgr.gibba009.xiladd (mgr.34457) 737 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:42.657 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:23:42.882 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:23:42.882 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (12m) 9m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:23:42.883 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:23:42.883 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:23:42.883 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:23:42.883 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:23:42.883 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:23:42.884 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:23:42.884 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:23:42.884 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (18m) 9m ago 18m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:23:42.884 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (18m) 7m ago 18m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:23:42.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:23:42.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:23:42.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:23:42.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:23:42.886 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:23:42.886 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:23:42.886 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:23:42.886 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:23:42.887 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (17m) 7m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:23:42.887 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:42.887 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:43.128 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:23:43.128 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:23:43.128 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:43.129 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:43.129 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:23:43.129 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:43.129 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:43.129 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:23:43.130 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:23:43.130 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:23:43.130 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:23:43.130 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:23:43.131 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:23:43.131 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:23:43.131 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:23:43.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:43 gibba004 bash[30897]: audit 2021-03-10T20:23:43.128445+0000 mon.a (mon.0) 646 : audit [DBG] from='client.? 172.21.2.104:0/1694421346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:43.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:43 gibba004 bash[31878]: audit 2021-03-10T20:23:43.128445+0000 mon.a (mon.0) 646 : audit [DBG] from='client.? 172.21.2.104:0/1694421346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:43.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:43 gibba009 bash[26136]: audit 2021-03-10T20:23:43.128445+0000 mon.a (mon.0) 646 : audit [DBG] from='client.? 172.21.2.104:0/1694421346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[30897]: cluster 2021-03-10T20:23:42.581775+0000 mgr.gibba009.xiladd (mgr.34457) 738 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[30897]: audit 2021-03-10T20:23:42.649336+0000 mgr.gibba009.xiladd (mgr.34457) 739 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[30897]: audit 2021-03-10T20:23:42.870682+0000 mgr.gibba009.xiladd (mgr.34457) 740 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[31878]: cluster 2021-03-10T20:23:42.581775+0000 mgr.gibba009.xiladd (mgr.34457) 738 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[31878]: audit 2021-03-10T20:23:42.649336+0000 mgr.gibba009.xiladd (mgr.34457) 739 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:44.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:44 gibba004 bash[31878]: audit 2021-03-10T20:23:42.870682+0000 mgr.gibba009.xiladd (mgr.34457) 740 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:44.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:44 gibba009 bash[26136]: cluster 2021-03-10T20:23:42.581775+0000 mgr.gibba009.xiladd (mgr.34457) 738 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:44.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:44 gibba009 bash[26136]: audit 2021-03-10T20:23:42.649336+0000 mgr.gibba009.xiladd (mgr.34457) 739 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:44.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:44 gibba009 bash[26136]: audit 2021-03-10T20:23:42.870682+0000 mgr.gibba009.xiladd (mgr.34457) 740 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:45.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:45 gibba004 bash[30897]: cluster 2021-03-10T20:23:44.583151+0000 mgr.gibba009.xiladd (mgr.34457) 741 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:45.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:45 gibba004 bash[31878]: cluster 2021-03-10T20:23:44.583151+0000 mgr.gibba009.xiladd (mgr.34457) 741 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:45.585 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:45 gibba009 bash[26136]: cluster 2021-03-10T20:23:44.583151+0000 mgr.gibba009.xiladd (mgr.34457) 741 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: cluster 2021-03-10T20:23:46.583950+0000 mgr.gibba009.xiladd (mgr.34457) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:46.973881+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: cephadm 2021-03-10T20:23:46.979399+0000 mgr.gibba009.xiladd (mgr.34457) 743 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:23:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: cephadm 2021-03-10T20:23:46.981380+0000 mgr.gibba009.xiladd (mgr.34457) 744 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:23:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.197416+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:23:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.201461+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.203328+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.205176+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.206590+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.210322+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[30897]: audit 2021-03-10T20:23:47.212309+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: cluster 2021-03-10T20:23:46.583950+0000 mgr.gibba009.xiladd (mgr.34457) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:46.973881+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: cephadm 2021-03-10T20:23:46.979399+0000 mgr.gibba009.xiladd (mgr.34457) 743 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:23:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: cephadm 2021-03-10T20:23:46.981380+0000 mgr.gibba009.xiladd (mgr.34457) 744 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:23:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.197416+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:23:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.201461+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.203328+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.205176+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.206590+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.210322+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:47 gibba004 bash[31878]: audit 2021-03-10T20:23:47.212309+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: cluster 2021-03-10T20:23:46.583950+0000 mgr.gibba009.xiladd (mgr.34457) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:46.973881+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: cephadm 2021-03-10T20:23:46.979399+0000 mgr.gibba009.xiladd (mgr.34457) 743 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:23:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: cephadm 2021-03-10T20:23:46.981380+0000 mgr.gibba009.xiladd (mgr.34457) 744 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:23:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.197416+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:23:48.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.201461+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.203328+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.205176+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.206590+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.210322+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:48.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:47 gibba009 bash[26136]: audit 2021-03-10T20:23:47.212309+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.201234+0000 mgr.gibba009.xiladd (mgr.34457) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.203350+0000 mgr.gibba009.xiladd (mgr.34457) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.205159+0000 mgr.gibba009.xiladd (mgr.34457) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.205205+0000 mgr.gibba009.xiladd (mgr.34457) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:49.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.206687+0000 mgr.gibba009.xiladd (mgr.34457) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:49.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.206733+0000 mgr.gibba009.xiladd (mgr.34457) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:49.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.208148+0000 mgr.gibba009.xiladd (mgr.34457) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:49.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.210094+0000 mgr.gibba009.xiladd (mgr.34457) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:49.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.210143+0000 mgr.gibba009.xiladd (mgr.34457) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:49.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.212021+0000 mgr.gibba009.xiladd (mgr.34457) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:49.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.212416+0000 mgr.gibba009.xiladd (mgr.34457) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:49.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.213942+0000 mgr.gibba009.xiladd (mgr.34457) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:49.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.213990+0000 mgr.gibba009.xiladd (mgr.34457) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:49.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[30897]: cephadm 2021-03-10T20:23:47.214138+0000 mgr.gibba009.xiladd (mgr.34457) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.201234+0000 mgr.gibba009.xiladd (mgr.34457) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.203350+0000 mgr.gibba009.xiladd (mgr.34457) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:49.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.205159+0000 mgr.gibba009.xiladd (mgr.34457) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.205205+0000 mgr.gibba009.xiladd (mgr.34457) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.206687+0000 mgr.gibba009.xiladd (mgr.34457) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.206733+0000 mgr.gibba009.xiladd (mgr.34457) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:49.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.208148+0000 mgr.gibba009.xiladd (mgr.34457) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.210094+0000 mgr.gibba009.xiladd (mgr.34457) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.210143+0000 mgr.gibba009.xiladd (mgr.34457) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.212021+0000 mgr.gibba009.xiladd (mgr.34457) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:49.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.212416+0000 mgr.gibba009.xiladd (mgr.34457) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.213942+0000 mgr.gibba009.xiladd (mgr.34457) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.213990+0000 mgr.gibba009.xiladd (mgr.34457) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:49.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:48 gibba004 bash[31878]: cephadm 2021-03-10T20:23:47.214138+0000 mgr.gibba009.xiladd (mgr.34457) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.201234+0000 mgr.gibba009.xiladd (mgr.34457) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.203350+0000 mgr.gibba009.xiladd (mgr.34457) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.205159+0000 mgr.gibba009.xiladd (mgr.34457) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:49.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.205205+0000 mgr.gibba009.xiladd (mgr.34457) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:49.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.206687+0000 mgr.gibba009.xiladd (mgr.34457) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:49.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.206733+0000 mgr.gibba009.xiladd (mgr.34457) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:49.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.208148+0000 mgr.gibba009.xiladd (mgr.34457) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:49.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.210094+0000 mgr.gibba009.xiladd (mgr.34457) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.210143+0000 mgr.gibba009.xiladd (mgr.34457) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.212021+0000 mgr.gibba009.xiladd (mgr.34457) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.212416+0000 mgr.gibba009.xiladd (mgr.34457) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.213942+0000 mgr.gibba009.xiladd (mgr.34457) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:49.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.213990+0000 mgr.gibba009.xiladd (mgr.34457) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:49.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:48 gibba009 bash[26136]: cephadm 2021-03-10T20:23:47.214138+0000 mgr.gibba009.xiladd (mgr.34457) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:23:50.061 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:49 gibba004 bash[30897]: cluster 2021-03-10T20:23:48.585535+0000 mgr.gibba009.xiladd (mgr.34457) 759 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:50.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:49 gibba004 bash[31878]: cluster 2021-03-10T20:23:48.585535+0000 mgr.gibba009.xiladd (mgr.34457) 759 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:50.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:49 gibba009 bash[26136]: cluster 2021-03-10T20:23:48.585535+0000 mgr.gibba009.xiladd (mgr.34457) 759 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:51 gibba004 bash[30897]: cluster 2021-03-10T20:23:50.587155+0000 mgr.gibba009.xiladd (mgr.34457) 760 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:52.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:51 gibba004 bash[31878]: cluster 2021-03-10T20:23:50.587155+0000 mgr.gibba009.xiladd (mgr.34457) 760 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:52.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:51 gibba009 bash[26136]: cluster 2021-03-10T20:23:50.587155+0000 mgr.gibba009.xiladd (mgr.34457) 760 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:53 gibba004 bash[30897]: cluster 2021-03-10T20:23:52.588810+0000 mgr.gibba009.xiladd (mgr.34457) 761 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:54.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:53 gibba004 bash[31878]: cluster 2021-03-10T20:23:52.588810+0000 mgr.gibba009.xiladd (mgr.34457) 761 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:54.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:53 gibba009 bash[26136]: cluster 2021-03-10T20:23:52.588810+0000 mgr.gibba009.xiladd (mgr.34457) 761 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:56.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:55 gibba004 bash[30897]: cluster 2021-03-10T20:23:54.590021+0000 mgr.gibba009.xiladd (mgr.34457) 762 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:56.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:55 gibba004 bash[31878]: cluster 2021-03-10T20:23:54.590021+0000 mgr.gibba009.xiladd (mgr.34457) 762 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:56.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:55 gibba009 bash[26136]: cluster 2021-03-10T20:23:54.590021+0000 mgr.gibba009.xiladd (mgr.34457) 762 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:57 gibba004 bash[30897]: cluster 2021-03-10T20:23:56.591817+0000 mgr.gibba009.xiladd (mgr.34457) 763 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:58.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:57 gibba004 bash[31878]: cluster 2021-03-10T20:23:56.591817+0000 mgr.gibba009.xiladd (mgr.34457) 763 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:58.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:57 gibba009 bash[26136]: cluster 2021-03-10T20:23:56.591817+0000 mgr.gibba009.xiladd (mgr.34457) 763 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:00.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:23:59 gibba009 bash[26136]: cluster 2021-03-10T20:23:58.593420+0000 mgr.gibba009.xiladd (mgr.34457) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:23:59 gibba004 bash[30897]: cluster 2021-03-10T20:23:58.593420+0000 mgr.gibba009.xiladd (mgr.34457) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:00.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:23:59 gibba004 bash[31878]: cluster 2021-03-10T20:23:58.593420+0000 mgr.gibba009.xiladd (mgr.34457) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:02.085 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:01 gibba009 bash[26136]: cluster 2021-03-10T20:24:00.594808+0000 mgr.gibba009.xiladd (mgr.34457) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:01 gibba004 bash[30897]: cluster 2021-03-10T20:24:00.594808+0000 mgr.gibba009.xiladd (mgr.34457) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:02.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:01 gibba004 bash[31878]: cluster 2021-03-10T20:24:00.594808+0000 mgr.gibba009.xiladd (mgr.34457) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:04.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:03 gibba009 bash[26136]: cephadm 2021-03-10T20:24:02.225809+0000 mgr.gibba009.xiladd (mgr.34457) 766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:04.157 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:03 gibba009 bash[26136]: cluster 2021-03-10T20:24:02.596424+0000 mgr.gibba009.xiladd (mgr.34457) 767 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:03 gibba004 bash[30897]: cephadm 2021-03-10T20:24:02.225809+0000 mgr.gibba009.xiladd (mgr.34457) 766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:03 gibba004 bash[30897]: cluster 2021-03-10T20:24:02.596424+0000 mgr.gibba009.xiladd (mgr.34457) 767 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:03 gibba004 bash[31878]: cephadm 2021-03-10T20:24:02.225809+0000 mgr.gibba009.xiladd (mgr.34457) 766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:03 gibba004 bash[31878]: cluster 2021-03-10T20:24:02.596424+0000 mgr.gibba009.xiladd (mgr.34457) 767 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:05 gibba004 bash[30897]: cluster 2021-03-10T20:24:04.596964+0000 mgr.gibba009.xiladd (mgr.34457) 768 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:06.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:05 gibba004 bash[31878]: cluster 2021-03-10T20:24:04.596964+0000 mgr.gibba009.xiladd (mgr.34457) 768 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:06.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:05 gibba009 bash[26136]: cluster 2021-03-10T20:24:04.596964+0000 mgr.gibba009.xiladd (mgr.34457) 768 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:07 gibba004 bash[30897]: cluster 2021-03-10T20:24:06.598438+0000 mgr.gibba009.xiladd (mgr.34457) 769 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:08.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:07 gibba004 bash[31878]: cluster 2021-03-10T20:24:06.598438+0000 mgr.gibba009.xiladd (mgr.34457) 769 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:07 gibba009 bash[26136]: cluster 2021-03-10T20:24:06.598438+0000 mgr.gibba009.xiladd (mgr.34457) 769 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:09 gibba004 bash[30897]: cluster 2021-03-10T20:24:08.600064+0000 mgr.gibba009.xiladd (mgr.34457) 770 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:09 gibba004 bash[31878]: cluster 2021-03-10T20:24:08.600064+0000 mgr.gibba009.xiladd (mgr.34457) 770 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:10.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:09 gibba009 bash[26136]: cluster 2021-03-10T20:24:08.600064+0000 mgr.gibba009.xiladd (mgr.34457) 770 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:11 gibba004 bash[30897]: cluster 2021-03-10T20:24:10.600868+0000 mgr.gibba009.xiladd (mgr.34457) 771 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:11 gibba004 bash[31878]: cluster 2021-03-10T20:24:10.600868+0000 mgr.gibba009.xiladd (mgr.34457) 771 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:12.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:11 gibba009 bash[26136]: cluster 2021-03-10T20:24:10.600868+0000 mgr.gibba009.xiladd (mgr.34457) 771 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:13.412 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:24:13.639 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:24:13.639 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (13m) 10m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:24:13.639 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:24:13.640 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (13m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:24:13.640 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (13m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:24:13.640 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:24:13.640 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:24:13.640 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:24:13.641 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:24:13.641 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (18m) 10m ago 18m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:24:13.641 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (18m) 8m ago 18m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:24:13.641 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:24:13.642 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:24:13.642 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:24:13.642 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:24:13.642 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:24:13.643 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:24:13.643 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:24:13.643 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:24:13.643 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (18m) 8m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:24:13.643 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:13.644 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:13.891 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:24:13.891 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:24:13.892 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:13.892 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:13.893 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:24:13.893 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:13.893 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:13.894 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:24:13.894 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:24:13.895 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:13.895 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:24:13.896 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:24:13.896 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:24:13.897 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:24:13.897 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:24:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:13 gibba004 bash[30897]: cluster 2021-03-10T20:24:12.602367+0000 mgr.gibba009.xiladd (mgr.34457) 772 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:13 gibba004 bash[31878]: cluster 2021-03-10T20:24:12.602367+0000 mgr.gibba009.xiladd (mgr.34457) 772 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:14.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:13 gibba009 bash[26136]: cluster 2021-03-10T20:24:12.602367+0000 mgr.gibba009.xiladd (mgr.34457) 772 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:15.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[30897]: audit 2021-03-10T20:24:13.404006+0000 mgr.gibba009.xiladd (mgr.34457) 773 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[30897]: audit 2021-03-10T20:24:13.627189+0000 mgr.gibba009.xiladd (mgr.34457) 774 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[30897]: audit 2021-03-10T20:24:13.891190+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.2.104:0/2723270560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:15.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[31878]: audit 2021-03-10T20:24:13.404006+0000 mgr.gibba009.xiladd (mgr.34457) 773 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[31878]: audit 2021-03-10T20:24:13.627189+0000 mgr.gibba009.xiladd (mgr.34457) 774 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:14 gibba004 bash[31878]: audit 2021-03-10T20:24:13.891190+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.2.104:0/2723270560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:15.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:14 gibba009 bash[26136]: audit 2021-03-10T20:24:13.404006+0000 mgr.gibba009.xiladd (mgr.34457) 773 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:14 gibba009 bash[26136]: audit 2021-03-10T20:24:13.627189+0000 mgr.gibba009.xiladd (mgr.34457) 774 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:15.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:14 gibba009 bash[26136]: audit 2021-03-10T20:24:13.891190+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.2.104:0/2723270560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:15 gibba004 bash[30897]: cluster 2021-03-10T20:24:14.603692+0000 mgr.gibba009.xiladd (mgr.34457) 775 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:16.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:15 gibba004 bash[31878]: cluster 2021-03-10T20:24:14.603692+0000 mgr.gibba009.xiladd (mgr.34457) 775 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:15 gibba009 bash[26136]: cluster 2021-03-10T20:24:14.603692+0000 mgr.gibba009.xiladd (mgr.34457) 775 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:17 gibba004 bash[30897]: cluster 2021-03-10T20:24:16.605296+0000 mgr.gibba009.xiladd (mgr.34457) 776 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:17 gibba004 bash[31878]: cluster 2021-03-10T20:24:16.605296+0000 mgr.gibba009.xiladd (mgr.34457) 776 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:18.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:17 gibba009 bash[26136]: cluster 2021-03-10T20:24:16.605296+0000 mgr.gibba009.xiladd (mgr.34457) 776 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:19.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:18 gibba004 bash[30897]: cephadm 2021-03-10T20:24:17.241702+0000 mgr.gibba009.xiladd (mgr.34457) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:19.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:18 gibba004 bash[31878]: cephadm 2021-03-10T20:24:17.241702+0000 mgr.gibba009.xiladd (mgr.34457) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:19.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:18 gibba009 bash[26136]: cephadm 2021-03-10T20:24:17.241702+0000 mgr.gibba009.xiladd (mgr.34457) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:20.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:19 gibba004 bash[30897]: cluster 2021-03-10T20:24:18.607017+0000 mgr.gibba009.xiladd (mgr.34457) 778 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:20.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:19 gibba004 bash[31878]: cluster 2021-03-10T20:24:18.607017+0000 mgr.gibba009.xiladd (mgr.34457) 778 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:20.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:19 gibba009 bash[26136]: cluster 2021-03-10T20:24:18.607017+0000 mgr.gibba009.xiladd (mgr.34457) 778 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:21 gibba004 bash[30897]: cluster 2021-03-10T20:24:20.608636+0000 mgr.gibba009.xiladd (mgr.34457) 779 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:21 gibba004 bash[31878]: cluster 2021-03-10T20:24:20.608636+0000 mgr.gibba009.xiladd (mgr.34457) 779 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:21 gibba009 bash[26136]: cluster 2021-03-10T20:24:20.608636+0000 mgr.gibba009.xiladd (mgr.34457) 779 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:23 gibba004 bash[30897]: cluster 2021-03-10T20:24:22.609267+0000 mgr.gibba009.xiladd (mgr.34457) 780 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:24.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:23 gibba004 bash[31878]: cluster 2021-03-10T20:24:22.609267+0000 mgr.gibba009.xiladd (mgr.34457) 780 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:24.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:23 gibba009 bash[26136]: cluster 2021-03-10T20:24:22.609267+0000 mgr.gibba009.xiladd (mgr.34457) 780 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:25 gibba004 bash[30897]: cluster 2021-03-10T20:24:24.610217+0000 mgr.gibba009.xiladd (mgr.34457) 781 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:26.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:25 gibba004 bash[31878]: cluster 2021-03-10T20:24:24.610217+0000 mgr.gibba009.xiladd (mgr.34457) 781 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:26.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:25 gibba009 bash[26136]: cluster 2021-03-10T20:24:24.610217+0000 mgr.gibba009.xiladd (mgr.34457) 781 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:27 gibba004 bash[30897]: cluster 2021-03-10T20:24:26.611517+0000 mgr.gibba009.xiladd (mgr.34457) 782 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:27 gibba004 bash[31878]: cluster 2021-03-10T20:24:26.611517+0000 mgr.gibba009.xiladd (mgr.34457) 782 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:28.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:27 gibba009 bash[26136]: cluster 2021-03-10T20:24:26.611517+0000 mgr.gibba009.xiladd (mgr.34457) 782 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:29 gibba004 bash[30897]: cluster 2021-03-10T20:24:28.612455+0000 mgr.gibba009.xiladd (mgr.34457) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:30.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:29 gibba004 bash[31878]: cluster 2021-03-10T20:24:28.612455+0000 mgr.gibba009.xiladd (mgr.34457) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:30.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:29 gibba009 bash[26136]: cluster 2021-03-10T20:24:28.612455+0000 mgr.gibba009.xiladd (mgr.34457) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:32.257 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:31 gibba009 bash[26136]: cluster 2021-03-10T20:24:30.613848+0000 mgr.gibba009.xiladd (mgr.34457) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:31 gibba004 bash[30897]: cluster 2021-03-10T20:24:30.613848+0000 mgr.gibba009.xiladd (mgr.34457) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:32.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:31 gibba004 bash[31878]: cluster 2021-03-10T20:24:30.613848+0000 mgr.gibba009.xiladd (mgr.34457) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:33 gibba004 bash[30897]: cephadm 2021-03-10T20:24:32.257799+0000 mgr.gibba009.xiladd (mgr.34457) 785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:33 gibba004 bash[30897]: cluster 2021-03-10T20:24:32.615441+0000 mgr.gibba009.xiladd (mgr.34457) 786 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:33 gibba004 bash[31878]: cephadm 2021-03-10T20:24:32.257799+0000 mgr.gibba009.xiladd (mgr.34457) 785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:33 gibba004 bash[31878]: cluster 2021-03-10T20:24:32.615441+0000 mgr.gibba009.xiladd (mgr.34457) 786 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:34.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:33 gibba009 bash[26136]: cephadm 2021-03-10T20:24:32.257799+0000 mgr.gibba009.xiladd (mgr.34457) 785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:34.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:33 gibba009 bash[26136]: cluster 2021-03-10T20:24:32.615441+0000 mgr.gibba009.xiladd (mgr.34457) 786 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:35 gibba004 bash[30897]: cluster 2021-03-10T20:24:34.616240+0000 mgr.gibba009.xiladd (mgr.34457) 787 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:36.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:35 gibba004 bash[31878]: cluster 2021-03-10T20:24:34.616240+0000 mgr.gibba009.xiladd (mgr.34457) 787 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:36.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:35 gibba009 bash[26136]: cluster 2021-03-10T20:24:34.616240+0000 mgr.gibba009.xiladd (mgr.34457) 787 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:37 gibba004 bash[30897]: cluster 2021-03-10T20:24:36.617643+0000 mgr.gibba009.xiladd (mgr.34457) 788 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:38.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:37 gibba004 bash[31878]: cluster 2021-03-10T20:24:36.617643+0000 mgr.gibba009.xiladd (mgr.34457) 788 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:38.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:37 gibba009 bash[26136]: cluster 2021-03-10T20:24:36.617643+0000 mgr.gibba009.xiladd (mgr.34457) 788 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:40.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: cluster 2021-03-10T20:24:38.619281+0000 mgr.gibba009.xiladd (mgr.34457) 789 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.571836+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.572577+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.573033+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.573306+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.574127+0000 mon.c (mon.1) 292 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.574329+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.575495+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.576295+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.646084+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.646779+0000 mon.c (mon.1) 294 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.647247+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[30897]: audit 2021-03-10T20:24:39.648401+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: cluster 2021-03-10T20:24:38.619281+0000 mgr.gibba009.xiladd (mgr.34457) 789 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.571836+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.572577+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.573033+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.573306+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.574127+0000 mon.c (mon.1) 292 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.574329+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.575495+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.576295+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.646084+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.646779+0000 mon.c (mon.1) 294 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.647247+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:40 gibba004 bash[31878]: audit 2021-03-10T20:24:39.648401+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: cluster 2021-03-10T20:24:38.619281+0000 mgr.gibba009.xiladd (mgr.34457) 789 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.571836+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.572577+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.573033+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:24:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.573306+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.574127+0000 mon.c (mon.1) 292 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.574329+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:24:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.575495+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.576295+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.646084+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.646779+0000 mon.c (mon.1) 294 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.647247+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:40 gibba009 bash[26136]: audit 2021-03-10T20:24:39.648401+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:42 gibba004 bash[30897]: cluster 2021-03-10T20:24:40.620169+0000 mgr.gibba009.xiladd (mgr.34457) 790 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:42.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:42 gibba004 bash[31878]: cluster 2021-03-10T20:24:40.620169+0000 mgr.gibba009.xiladd (mgr.34457) 790 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:42.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:42 gibba009 bash[26136]: cluster 2021-03-10T20:24:40.620169+0000 mgr.gibba009.xiladd (mgr.34457) 790 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:44.137 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:24:44.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:44 gibba004 bash[30897]: cluster 2021-03-10T20:24:42.621702+0000 mgr.gibba009.xiladd (mgr.34457) 791 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:44.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:44 gibba004 bash[31878]: cluster 2021-03-10T20:24:42.621702+0000 mgr.gibba009.xiladd (mgr.34457) 791 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:44.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:44 gibba009 bash[26136]: cluster 2021-03-10T20:24:42.621702+0000 mgr.gibba009.xiladd (mgr.34457) 791 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:44.367 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:24:44.367 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (13m) 10m ago 19m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:24:44.367 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (18m) 9m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:24:44.368 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:24:44.368 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:24:44.368 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:24:44.368 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:24:44.369 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (12m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:24:44.369 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:24:44.369 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (19m) 10m ago 19m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:24:44.369 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:24:44.370 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:24:44.370 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:24:44.370 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:24:44.370 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:24:44.371 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:24:44.371 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:24:44.371 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:24:44.371 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:24:44.371 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (18m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:24:44.372 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:44.372 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:44.617 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:24:44.617 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:24:44.617 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:44.617 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:44.618 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:24:44.618 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:44.618 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:44.618 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:24:44.619 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:24:44.619 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:24:44.619 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:24:44.619 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:24:44.619 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:24:44.620 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:24:44.620 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:24:45.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:45 gibba004 bash[30897]: audit 2021-03-10T20:24:44.128935+0000 mgr.gibba009.xiladd (mgr.34457) 792 : audit [DBG] from='client.54577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:45.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:45 gibba004 bash[30897]: audit 2021-03-10T20:24:44.616644+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.2.104:0/207491005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:45.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:45 gibba004 bash[31878]: audit 2021-03-10T20:24:44.128935+0000 mgr.gibba009.xiladd (mgr.34457) 792 : audit [DBG] from='client.54577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:45.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:45 gibba004 bash[31878]: audit 2021-03-10T20:24:44.616644+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.2.104:0/207491005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:45.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:45 gibba009 bash[26136]: audit 2021-03-10T20:24:44.128935+0000 mgr.gibba009.xiladd (mgr.34457) 792 : audit [DBG] from='client.54577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:45.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:45 gibba009 bash[26136]: audit 2021-03-10T20:24:44.616644+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.2.104:0/207491005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:46 gibba004 bash[30897]: audit 2021-03-10T20:24:44.354904+0000 mgr.gibba009.xiladd (mgr.34457) 793 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:46 gibba004 bash[30897]: cluster 2021-03-10T20:24:44.623179+0000 mgr.gibba009.xiladd (mgr.34457) 794 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:46.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:46 gibba004 bash[31878]: audit 2021-03-10T20:24:44.354904+0000 mgr.gibba009.xiladd (mgr.34457) 793 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:46.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:46 gibba004 bash[31878]: cluster 2021-03-10T20:24:44.623179+0000 mgr.gibba009.xiladd (mgr.34457) 794 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:46 gibba009 bash[26136]: audit 2021-03-10T20:24:44.354904+0000 mgr.gibba009.xiladd (mgr.34457) 793 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:46.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:46 gibba009 bash[26136]: cluster 2021-03-10T20:24:44.623179+0000 mgr.gibba009.xiladd (mgr.34457) 794 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:48.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[30897]: cluster 2021-03-10T20:24:46.624121+0000 mgr.gibba009.xiladd (mgr.34457) 795 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:48.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[30897]: audit 2021-03-10T20:24:47.274368+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[30897]: audit 2021-03-10T20:24:47.281099+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:24:48.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[31878]: cluster 2021-03-10T20:24:46.624121+0000 mgr.gibba009.xiladd (mgr.34457) 795 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:48.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[31878]: audit 2021-03-10T20:24:47.274368+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:48.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:48 gibba004 bash[31878]: audit 2021-03-10T20:24:47.281099+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:24:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:48 gibba009 bash[26136]: cluster 2021-03-10T20:24:46.624121+0000 mgr.gibba009.xiladd (mgr.34457) 795 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:48 gibba009 bash[26136]: audit 2021-03-10T20:24:47.274368+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:48.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:48 gibba009 bash[26136]: audit 2021-03-10T20:24:47.281099+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:24:49.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:49 gibba004 bash[30897]: cephadm 2021-03-10T20:24:47.281067+0000 mgr.gibba009.xiladd (mgr.34457) 796 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:24:49.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:49 gibba004 bash[31878]: cephadm 2021-03-10T20:24:47.281067+0000 mgr.gibba009.xiladd (mgr.34457) 796 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:24:49.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:49 gibba009 bash[26136]: cephadm 2021-03-10T20:24:47.281067+0000 mgr.gibba009.xiladd (mgr.34457) 796 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:24:50.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:50 gibba009 bash[26136]: cluster 2021-03-10T20:24:48.625761+0000 mgr.gibba009.xiladd (mgr.34457) 797 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:50.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:50 gibba004 bash[30897]: cluster 2021-03-10T20:24:48.625761+0000 mgr.gibba009.xiladd (mgr.34457) 797 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:50.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:50 gibba004 bash[31878]: cluster 2021-03-10T20:24:48.625761+0000 mgr.gibba009.xiladd (mgr.34457) 797 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:52.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cluster 2021-03-10T20:24:50.627427+0000 mgr.gibba009.xiladd (mgr.34457) 798 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:52.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:50.866022+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:50.870018+0000 mgr.gibba009.xiladd (mgr.34457) 799 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:24:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.112915+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.117714+0000 mgr.gibba009.xiladd (mgr.34457) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.118411+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.120064+0000 mgr.gibba009.xiladd (mgr.34457) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.120328+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.121806+0000 mgr.gibba009.xiladd (mgr.34457) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.121871+0000 mgr.gibba009.xiladd (mgr.34457) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.122179+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.123693+0000 mgr.gibba009.xiladd (mgr.34457) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.123768+0000 mgr.gibba009.xiladd (mgr.34457) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.123855+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.125685+0000 mgr.gibba009.xiladd (mgr.34457) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.127809+0000 mgr.gibba009.xiladd (mgr.34457) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.127889+0000 mgr.gibba009.xiladd (mgr.34457) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:52.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.128436+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.129916+0000 mgr.gibba009.xiladd (mgr.34457) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:52.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.130792+0000 mgr.gibba009.xiladd (mgr.34457) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:52.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: audit 2021-03-10T20:24:51.131104+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cluster 2021-03-10T20:24:50.627427+0000 mgr.gibba009.xiladd (mgr.34457) 798 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:52.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:50.866022+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:50.870018+0000 mgr.gibba009.xiladd (mgr.34457) 799 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:24:52.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.112915+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.117714+0000 mgr.gibba009.xiladd (mgr.34457) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:52.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.118411+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:52.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.120064+0000 mgr.gibba009.xiladd (mgr.34457) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:52.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.120328+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.121806+0000 mgr.gibba009.xiladd (mgr.34457) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:52.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.121871+0000 mgr.gibba009.xiladd (mgr.34457) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:52.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.122179+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.123693+0000 mgr.gibba009.xiladd (mgr.34457) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:52.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.123768+0000 mgr.gibba009.xiladd (mgr.34457) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:52.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.123855+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.125685+0000 mgr.gibba009.xiladd (mgr.34457) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:52.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.127809+0000 mgr.gibba009.xiladd (mgr.34457) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:52.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.127889+0000 mgr.gibba009.xiladd (mgr.34457) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:52.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.128436+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.129916+0000 mgr.gibba009.xiladd (mgr.34457) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:52.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.130792+0000 mgr.gibba009.xiladd (mgr.34457) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:52.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: audit 2021-03-10T20:24:51.131104+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.132900+0000 mgr.gibba009.xiladd (mgr.34457) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:52.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.132998+0000 mgr.gibba009.xiladd (mgr.34457) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:52.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[30897]: cephadm 2021-03-10T20:24:51.133319+0000 mgr.gibba009.xiladd (mgr.34457) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:52.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.132900+0000 mgr.gibba009.xiladd (mgr.34457) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:52.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.132998+0000 mgr.gibba009.xiladd (mgr.34457) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:52.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:51 gibba004 bash[31878]: cephadm 2021-03-10T20:24:51.133319+0000 mgr.gibba009.xiladd (mgr.34457) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:52.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cluster 2021-03-10T20:24:50.627427+0000 mgr.gibba009.xiladd (mgr.34457) 798 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:52.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:50.866022+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:50.870018+0000 mgr.gibba009.xiladd (mgr.34457) 799 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:24:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.112915+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:24:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.117714+0000 mgr.gibba009.xiladd (mgr.34457) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.118411+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.120064+0000 mgr.gibba009.xiladd (mgr.34457) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.120328+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.121806+0000 mgr.gibba009.xiladd (mgr.34457) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.121871+0000 mgr.gibba009.xiladd (mgr.34457) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.122179+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.123693+0000 mgr.gibba009.xiladd (mgr.34457) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.123768+0000 mgr.gibba009.xiladd (mgr.34457) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.123855+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.125685+0000 mgr.gibba009.xiladd (mgr.34457) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:52.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.127809+0000 mgr.gibba009.xiladd (mgr.34457) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:52.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.127889+0000 mgr.gibba009.xiladd (mgr.34457) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:52.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.128436+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.129916+0000 mgr.gibba009.xiladd (mgr.34457) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:52.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.130792+0000 mgr.gibba009.xiladd (mgr.34457) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:52.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: audit 2021-03-10T20:24:51.131104+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:52.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.132900+0000 mgr.gibba009.xiladd (mgr.34457) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:52.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.132998+0000 mgr.gibba009.xiladd (mgr.34457) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:52.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:51 gibba009 bash[26136]: cephadm 2021-03-10T20:24:51.133319+0000 mgr.gibba009.xiladd (mgr.34457) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:24:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:53 gibba004 bash[30897]: cluster 2021-03-10T20:24:52.628295+0000 mgr.gibba009.xiladd (mgr.34457) 814 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:54.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:53 gibba004 bash[31878]: cluster 2021-03-10T20:24:52.628295+0000 mgr.gibba009.xiladd (mgr.34457) 814 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:54.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:53 gibba009 bash[26136]: cluster 2021-03-10T20:24:52.628295+0000 mgr.gibba009.xiladd (mgr.34457) 814 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:55 gibba004 bash[30897]: cluster 2021-03-10T20:24:54.629705+0000 mgr.gibba009.xiladd (mgr.34457) 815 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:56.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:55 gibba004 bash[31878]: cluster 2021-03-10T20:24:54.629705+0000 mgr.gibba009.xiladd (mgr.34457) 815 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:56.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:55 gibba009 bash[26136]: cluster 2021-03-10T20:24:54.629705+0000 mgr.gibba009.xiladd (mgr.34457) 815 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:57 gibba004 bash[30897]: cluster 2021-03-10T20:24:56.631234+0000 mgr.gibba009.xiladd (mgr.34457) 816 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:57 gibba004 bash[31878]: cluster 2021-03-10T20:24:56.631234+0000 mgr.gibba009.xiladd (mgr.34457) 816 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:58.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:57 gibba009 bash[26136]: cluster 2021-03-10T20:24:56.631234+0000 mgr.gibba009.xiladd (mgr.34457) 816 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:24:59 gibba004 bash[30897]: cluster 2021-03-10T20:24:58.632237+0000 mgr.gibba009.xiladd (mgr.34457) 817 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:24:59 gibba004 bash[31878]: cluster 2021-03-10T20:24:58.632237+0000 mgr.gibba009.xiladd (mgr.34457) 817 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:00.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:24:59 gibba009 bash[26136]: cluster 2021-03-10T20:24:58.632237+0000 mgr.gibba009.xiladd (mgr.34457) 817 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:02.086 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:01 gibba009 bash[26136]: cluster 2021-03-10T20:25:00.633520+0000 mgr.gibba009.xiladd (mgr.34457) 818 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:01 gibba004 bash[30897]: cluster 2021-03-10T20:25:00.633520+0000 mgr.gibba009.xiladd (mgr.34457) 818 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:02.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:01 gibba004 bash[31878]: cluster 2021-03-10T20:25:00.633520+0000 mgr.gibba009.xiladd (mgr.34457) 818 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:03 gibba004 bash[30897]: cluster 2021-03-10T20:25:02.635318+0000 mgr.gibba009.xiladd (mgr.34457) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:03 gibba004 bash[31878]: cluster 2021-03-10T20:25:02.635318+0000 mgr.gibba009.xiladd (mgr.34457) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:04.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:03 gibba009 bash[26136]: cluster 2021-03-10T20:25:02.635318+0000 mgr.gibba009.xiladd (mgr.34457) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:05 gibba004 bash[30897]: cluster 2021-03-10T20:25:04.636405+0000 mgr.gibba009.xiladd (mgr.34457) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:06.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:05 gibba004 bash[31878]: cluster 2021-03-10T20:25:04.636405+0000 mgr.gibba009.xiladd (mgr.34457) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:06.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:05 gibba009 bash[26136]: cluster 2021-03-10T20:25:04.636405+0000 mgr.gibba009.xiladd (mgr.34457) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:07.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:06 gibba004 bash[30897]: cephadm 2021-03-10T20:25:06.149387+0000 mgr.gibba009.xiladd (mgr.34457) 821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:07.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:06 gibba004 bash[31878]: cephadm 2021-03-10T20:25:06.149387+0000 mgr.gibba009.xiladd (mgr.34457) 821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:07.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:06 gibba009 bash[26136]: cephadm 2021-03-10T20:25:06.149387+0000 mgr.gibba009.xiladd (mgr.34457) 821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:07 gibba004 bash[30897]: cluster 2021-03-10T20:25:06.637546+0000 mgr.gibba009.xiladd (mgr.34457) 822 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:08.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:07 gibba004 bash[31878]: cluster 2021-03-10T20:25:06.637546+0000 mgr.gibba009.xiladd (mgr.34457) 822 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:08.335 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:07 gibba009 bash[26136]: cluster 2021-03-10T20:25:06.637546+0000 mgr.gibba009.xiladd (mgr.34457) 822 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:09 gibba004 bash[30897]: cluster 2021-03-10T20:25:08.639231+0000 mgr.gibba009.xiladd (mgr.34457) 823 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:09 gibba004 bash[31878]: cluster 2021-03-10T20:25:08.639231+0000 mgr.gibba009.xiladd (mgr.34457) 823 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:10.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:09 gibba009 bash[26136]: cluster 2021-03-10T20:25:08.639231+0000 mgr.gibba009.xiladd (mgr.34457) 823 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:11 gibba004 bash[30897]: cluster 2021-03-10T20:25:10.640115+0000 mgr.gibba009.xiladd (mgr.34457) 824 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:12.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:11 gibba004 bash[31878]: cluster 2021-03-10T20:25:10.640115+0000 mgr.gibba009.xiladd (mgr.34457) 824 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:12.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:11 gibba009 bash[26136]: cluster 2021-03-10T20:25:10.640115+0000 mgr.gibba009.xiladd (mgr.34457) 824 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:13 gibba004 bash[30897]: cluster 2021-03-10T20:25:12.641763+0000 mgr.gibba009.xiladd (mgr.34457) 825 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:13 gibba004 bash[31878]: cluster 2021-03-10T20:25:12.641763+0000 mgr.gibba009.xiladd (mgr.34457) 825 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:14.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:13 gibba009 bash[26136]: cluster 2021-03-10T20:25:12.641763+0000 mgr.gibba009.xiladd (mgr.34457) 825 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:14.863 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:25:15.124 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:25:15.125 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (14m) 24s ago 19m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:25:15.125 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:25:15.125 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:25:15.125 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:25:15.126 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (13m) 24s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:25:15.126 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (13m) 24s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:25:15.126 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:25:15.126 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (13m) 24s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:25:15.127 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (19m) 24s ago 19m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:25:15.127 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:25:15.127 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (12m) 24s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:25:15.127 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (12m) 24s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:25:15.127 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (11m) 24s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:25:15.128 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (11m) 24s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:25:15.128 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:25:15.128 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:25:15.128 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:25:15.129 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:25:15.129 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (19m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:25:15.129 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 24s ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:15.129 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:15.382 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:25:15.383 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:25:15.383 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:15.383 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:15.383 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:25:15.384 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:15.384 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:15.384 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:25:15.384 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:25:15.384 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:15.385 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:25:15.385 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:25:15.385 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:25:15.385 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:25:15.386 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:25:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[30897]: cluster 2021-03-10T20:25:14.643248+0000 mgr.gibba009.xiladd (mgr.34457) 826 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[30897]: audit 2021-03-10T20:25:14.853900+0000 mgr.gibba009.xiladd (mgr.34457) 827 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[30897]: audit 2021-03-10T20:25:15.083430+0000 mgr.gibba009.xiladd (mgr.34457) 828 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[30897]: audit 2021-03-10T20:25:15.382945+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.2.104:0/2274469317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[31878]: cluster 2021-03-10T20:25:14.643248+0000 mgr.gibba009.xiladd (mgr.34457) 826 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:16.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[31878]: audit 2021-03-10T20:25:14.853900+0000 mgr.gibba009.xiladd (mgr.34457) 827 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[31878]: audit 2021-03-10T20:25:15.083430+0000 mgr.gibba009.xiladd (mgr.34457) 828 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:15 gibba004 bash[31878]: audit 2021-03-10T20:25:15.382945+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.2.104:0/2274469317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:15 gibba009 bash[26136]: cluster 2021-03-10T20:25:14.643248+0000 mgr.gibba009.xiladd (mgr.34457) 826 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:15 gibba009 bash[26136]: audit 2021-03-10T20:25:14.853900+0000 mgr.gibba009.xiladd (mgr.34457) 827 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:15 gibba009 bash[26136]: audit 2021-03-10T20:25:15.083430+0000 mgr.gibba009.xiladd (mgr.34457) 828 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:16.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:15 gibba009 bash[26136]: audit 2021-03-10T20:25:15.382945+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.2.104:0/2274469317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:17 gibba004 bash[30897]: cluster 2021-03-10T20:25:16.644733+0000 mgr.gibba009.xiladd (mgr.34457) 829 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:18.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:17 gibba004 bash[31878]: cluster 2021-03-10T20:25:16.644733+0000 mgr.gibba009.xiladd (mgr.34457) 829 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:18.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:17 gibba009 bash[26136]: cluster 2021-03-10T20:25:16.644733+0000 mgr.gibba009.xiladd (mgr.34457) 829 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:19 gibba004 bash[30897]: cluster 2021-03-10T20:25:18.646093+0000 mgr.gibba009.xiladd (mgr.34457) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:20.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:19 gibba004 bash[31878]: cluster 2021-03-10T20:25:18.646093+0000 mgr.gibba009.xiladd (mgr.34457) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:20.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:19 gibba009 bash[26136]: cluster 2021-03-10T20:25:18.646093+0000 mgr.gibba009.xiladd (mgr.34457) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:21 gibba004 bash[30897]: cluster 2021-03-10T20:25:20.647501+0000 mgr.gibba009.xiladd (mgr.34457) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:21 gibba004 bash[30897]: cephadm 2021-03-10T20:25:21.165433+0000 mgr.gibba009.xiladd (mgr.34457) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:21 gibba004 bash[31878]: cluster 2021-03-10T20:25:20.647501+0000 mgr.gibba009.xiladd (mgr.34457) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:22.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:21 gibba004 bash[31878]: cephadm 2021-03-10T20:25:21.165433+0000 mgr.gibba009.xiladd (mgr.34457) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:21 gibba009 bash[26136]: cluster 2021-03-10T20:25:20.647501+0000 mgr.gibba009.xiladd (mgr.34457) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:22.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:21 gibba009 bash[26136]: cephadm 2021-03-10T20:25:21.165433+0000 mgr.gibba009.xiladd (mgr.34457) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:24 gibba004 bash[30897]: cluster 2021-03-10T20:25:22.648774+0000 mgr.gibba009.xiladd (mgr.34457) 833 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:24 gibba004 bash[31878]: cluster 2021-03-10T20:25:22.648774+0000 mgr.gibba009.xiladd (mgr.34457) 833 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:24.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:24 gibba009 bash[26136]: cluster 2021-03-10T20:25:22.648774+0000 mgr.gibba009.xiladd (mgr.34457) 833 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:26 gibba004 bash[30897]: cluster 2021-03-10T20:25:24.650299+0000 mgr.gibba009.xiladd (mgr.34457) 834 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:26 gibba004 bash[31878]: cluster 2021-03-10T20:25:24.650299+0000 mgr.gibba009.xiladd (mgr.34457) 834 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:26.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:26 gibba009 bash[26136]: cluster 2021-03-10T20:25:24.650299+0000 mgr.gibba009.xiladd (mgr.34457) 834 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:28 gibba004 bash[30897]: cluster 2021-03-10T20:25:26.651817+0000 mgr.gibba009.xiladd (mgr.34457) 835 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:28.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:28 gibba004 bash[31878]: cluster 2021-03-10T20:25:26.651817+0000 mgr.gibba009.xiladd (mgr.34457) 835 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:28.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:28 gibba009 bash[26136]: cluster 2021-03-10T20:25:26.651817+0000 mgr.gibba009.xiladd (mgr.34457) 835 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:30 gibba004 bash[30897]: cluster 2021-03-10T20:25:28.652912+0000 mgr.gibba009.xiladd (mgr.34457) 836 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:30.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:30 gibba004 bash[31878]: cluster 2021-03-10T20:25:28.652912+0000 mgr.gibba009.xiladd (mgr.34457) 836 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:30.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:30 gibba009 bash[26136]: cluster 2021-03-10T20:25:28.652912+0000 mgr.gibba009.xiladd (mgr.34457) 836 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:32 gibba004 bash[30897]: cluster 2021-03-10T20:25:30.654163+0000 mgr.gibba009.xiladd (mgr.34457) 837 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:32 gibba004 bash[31878]: cluster 2021-03-10T20:25:30.654163+0000 mgr.gibba009.xiladd (mgr.34457) 837 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:32.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:32 gibba009 bash[26136]: cluster 2021-03-10T20:25:30.654163+0000 mgr.gibba009.xiladd (mgr.34457) 837 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:34 gibba004 bash[30897]: cluster 2021-03-10T20:25:32.655744+0000 mgr.gibba009.xiladd (mgr.34457) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:34.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:34 gibba004 bash[31878]: cluster 2021-03-10T20:25:32.655744+0000 mgr.gibba009.xiladd (mgr.34457) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:34.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:34 gibba009 bash[26136]: cluster 2021-03-10T20:25:32.655744+0000 mgr.gibba009.xiladd (mgr.34457) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:36 gibba004 bash[30897]: cluster 2021-03-10T20:25:34.657343+0000 mgr.gibba009.xiladd (mgr.34457) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:36 gibba004 bash[31878]: cluster 2021-03-10T20:25:34.657343+0000 mgr.gibba009.xiladd (mgr.34457) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:36.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:36 gibba009 bash[26136]: cluster 2021-03-10T20:25:34.657343+0000 mgr.gibba009.xiladd (mgr.34457) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:37.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:37 gibba009 bash[26136]: cephadm 2021-03-10T20:25:36.181366+0000 mgr.gibba009.xiladd (mgr.34457) 840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:37.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:37 gibba004 bash[30897]: cephadm 2021-03-10T20:25:36.181366+0000 mgr.gibba009.xiladd (mgr.34457) 840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:37.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:37 gibba004 bash[31878]: cephadm 2021-03-10T20:25:36.181366+0000 mgr.gibba009.xiladd (mgr.34457) 840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:38.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:38 gibba009 bash[26136]: cluster 2021-03-10T20:25:36.658774+0000 mgr.gibba009.xiladd (mgr.34457) 841 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:38 gibba004 bash[30897]: cluster 2021-03-10T20:25:36.658774+0000 mgr.gibba009.xiladd (mgr.34457) 841 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:38.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:38 gibba004 bash[31878]: cluster 2021-03-10T20:25:36.658774+0000 mgr.gibba009.xiladd (mgr.34457) 841 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:40.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: cluster 2021-03-10T20:25:38.660381+0000 mgr.gibba009.xiladd (mgr.34457) 842 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.581394+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.582162+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.582797+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.582881+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.583517+0000 mon.c (mon.1) 306 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.584791+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.585666+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.586451+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.653040+0000 mon.c (mon.1) 307 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.653662+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.654147+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:40 gibba009 bash[26136]: audit 2021-03-10T20:25:39.655244+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:40.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: cluster 2021-03-10T20:25:38.660381+0000 mgr.gibba009.xiladd (mgr.34457) 842 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.581394+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.582162+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.582797+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.582881+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.583517+0000 mon.c (mon.1) 306 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.584791+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.585666+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.586451+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.653040+0000 mon.c (mon.1) 307 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.653662+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.654147+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[30897]: audit 2021-03-10T20:25:39.655244+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: cluster 2021-03-10T20:25:38.660381+0000 mgr.gibba009.xiladd (mgr.34457) 842 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.581394+0000 mon.c (mon.1) 303 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.582162+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.582797+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.582881+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.583517+0000 mon.c (mon.1) 306 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.584791+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.585666+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:25:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.586451+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:25:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.653040+0000 mon.c (mon.1) 307 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.653662+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.654147+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:40 gibba004 bash[31878]: audit 2021-03-10T20:25:39.655244+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:42 gibba004 bash[30897]: cluster 2021-03-10T20:25:40.661693+0000 mgr.gibba009.xiladd (mgr.34457) 843 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:42.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:42 gibba004 bash[31878]: cluster 2021-03-10T20:25:40.661693+0000 mgr.gibba009.xiladd (mgr.34457) 843 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:42.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:42 gibba009 bash[26136]: cluster 2021-03-10T20:25:40.661693+0000 mgr.gibba009.xiladd (mgr.34457) 843 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:44 gibba004 bash[30897]: cluster 2021-03-10T20:25:42.663363+0000 mgr.gibba009.xiladd (mgr.34457) 844 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:44.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:44 gibba004 bash[31878]: cluster 2021-03-10T20:25:42.663363+0000 mgr.gibba009.xiladd (mgr.34457) 844 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:44.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:44 gibba009 bash[26136]: cluster 2021-03-10T20:25:42.663363+0000 mgr.gibba009.xiladd (mgr.34457) 844 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:45.627 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:25:45.858 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:25:45.859 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (14m) 55s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:25:45.859 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (19m) 10m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:25:45.859 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (15m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:25:45.859 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (15m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:25:45.860 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (14m) 55s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:25:45.860 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (14m) 55s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:25:45.860 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (13m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:25:45.860 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (13m) 55s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:25:45.861 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (20m) 55s ago 20m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:25:45.861 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (20m) 10m ago 20m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:25:45.861 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (13m) 55s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:25:45.861 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (12m) 55s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:25:45.862 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (12m) 55s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:25:45.862 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (11m) 55s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:25:45.862 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:25:45.862 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:25:45.862 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:25:45.863 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:25:45.863 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (19m) 10m ago 20m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:25:45.863 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 55s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:45.863 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 10m ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:46.105 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:25:46.106 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:25:46.106 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:46.106 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:46.106 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:25:46.107 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:46.107 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:46.107 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:25:46.107 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:25:46.108 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:25:46.108 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:25:46.108 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:25:46.108 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:25:46.108 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:25:46.109 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:25:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:46 gibba004 bash[30897]: cluster 2021-03-10T20:25:44.664949+0000 mgr.gibba009.xiladd (mgr.34457) 845 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:46 gibba004 bash[31878]: cluster 2021-03-10T20:25:44.664949+0000 mgr.gibba009.xiladd (mgr.34457) 845 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:46.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:46 gibba009 bash[26136]: cluster 2021-03-10T20:25:44.664949+0000 mgr.gibba009.xiladd (mgr.34457) 845 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:47.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[30897]: audit 2021-03-10T20:25:45.618598+0000 mgr.gibba009.xiladd (mgr.34457) 846 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[30897]: audit 2021-03-10T20:25:45.846179+0000 mgr.gibba009.xiladd (mgr.34457) 847 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[30897]: audit 2021-03-10T20:25:46.105795+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.104:0/1045327741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:47.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[31878]: audit 2021-03-10T20:25:45.618598+0000 mgr.gibba009.xiladd (mgr.34457) 846 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[31878]: audit 2021-03-10T20:25:45.846179+0000 mgr.gibba009.xiladd (mgr.34457) 847 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:47 gibba004 bash[31878]: audit 2021-03-10T20:25:46.105795+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.104:0/1045327741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:47.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:47 gibba009 bash[26136]: audit 2021-03-10T20:25:45.618598+0000 mgr.gibba009.xiladd (mgr.34457) 846 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:47 gibba009 bash[26136]: audit 2021-03-10T20:25:45.846179+0000 mgr.gibba009.xiladd (mgr.34457) 847 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:47.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:47 gibba009 bash[26136]: audit 2021-03-10T20:25:46.105795+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.104:0/1045327741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:48 gibba004 bash[30897]: cluster 2021-03-10T20:25:46.666219+0000 mgr.gibba009.xiladd (mgr.34457) 848 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:48 gibba004 bash[31878]: cluster 2021-03-10T20:25:46.666219+0000 mgr.gibba009.xiladd (mgr.34457) 848 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:48.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:48 gibba009 bash[26136]: cluster 2021-03-10T20:25:46.666219+0000 mgr.gibba009.xiladd (mgr.34457) 848 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:50 gibba004 bash[30897]: cluster 2021-03-10T20:25:48.667751+0000 mgr.gibba009.xiladd (mgr.34457) 849 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:50.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:50 gibba004 bash[31878]: cluster 2021-03-10T20:25:48.667751+0000 mgr.gibba009.xiladd (mgr.34457) 849 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:50.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:50 gibba009 bash[26136]: cluster 2021-03-10T20:25:48.667751+0000 mgr.gibba009.xiladd (mgr.34457) 849 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[30897]: cluster 2021-03-10T20:25:50.669295+0000 mgr.gibba009.xiladd (mgr.34457) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[30897]: audit 2021-03-10T20:25:51.197808+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[30897]: cephadm 2021-03-10T20:25:51.199970+0000 mgr.gibba009.xiladd (mgr.34457) 851 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:25:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[30897]: audit 2021-03-10T20:25:51.200711+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:25:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[31878]: cluster 2021-03-10T20:25:50.669295+0000 mgr.gibba009.xiladd (mgr.34457) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[31878]: audit 2021-03-10T20:25:51.197808+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[31878]: cephadm 2021-03-10T20:25:51.199970+0000 mgr.gibba009.xiladd (mgr.34457) 851 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:25:52.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:52 gibba004 bash[31878]: audit 2021-03-10T20:25:51.200711+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:25:52.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:52 gibba009 bash[26136]: cluster 2021-03-10T20:25:50.669295+0000 mgr.gibba009.xiladd (mgr.34457) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:52.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:52 gibba009 bash[26136]: audit 2021-03-10T20:25:51.197808+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:52 gibba009 bash[26136]: cephadm 2021-03-10T20:25:51.199970+0000 mgr.gibba009.xiladd (mgr.34457) 851 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:25:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:52 gibba009 bash[26136]: audit 2021-03-10T20:25:51.200711+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:25:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:54 gibba004 bash[30897]: cluster 2021-03-10T20:25:52.671013+0000 mgr.gibba009.xiladd (mgr.34457) 852 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:54 gibba004 bash[31878]: cluster 2021-03-10T20:25:52.671013+0000 mgr.gibba009.xiladd (mgr.34457) 852 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:54.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:54 gibba009 bash[26136]: cluster 2021-03-10T20:25:52.671013+0000 mgr.gibba009.xiladd (mgr.34457) 852 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cluster 2021-03-10T20:25:54.671626+0000 mgr.gibba009.xiladd (mgr.34457) 853 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:54.940259+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:54.941009+0000 mgr.gibba009.xiladd (mgr.34457) 854 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:25:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.148038+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.151833+0000 mgr.gibba009.xiladd (mgr.34457) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.152780+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.153899+0000 mgr.gibba009.xiladd (mgr.34457) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.154395+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.155416+0000 mgr.gibba009.xiladd (mgr.34457) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.155452+0000 mgr.gibba009.xiladd (mgr.34457) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.155985+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.156761+0000 mgr.gibba009.xiladd (mgr.34457) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.156799+0000 mgr.gibba009.xiladd (mgr.34457) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.157286+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.158065+0000 mgr.gibba009.xiladd (mgr.34457) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:56.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.159466+0000 mgr.gibba009.xiladd (mgr.34457) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:56.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.159502+0000 mgr.gibba009.xiladd (mgr.34457) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:56.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.160069+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.160856+0000 mgr.gibba009.xiladd (mgr.34457) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:56.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.161168+0000 mgr.gibba009.xiladd (mgr.34457) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:56.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: audit 2021-03-10T20:25:55.161469+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cluster 2021-03-10T20:25:54.671626+0000 mgr.gibba009.xiladd (mgr.34457) 853 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:56.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:54.940259+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:54.941009+0000 mgr.gibba009.xiladd (mgr.34457) 854 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:25:56.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.148038+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.151833+0000 mgr.gibba009.xiladd (mgr.34457) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:56.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.152780+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:56.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.153899+0000 mgr.gibba009.xiladd (mgr.34457) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:56.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.154395+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.155416+0000 mgr.gibba009.xiladd (mgr.34457) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:56.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.155452+0000 mgr.gibba009.xiladd (mgr.34457) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:56.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.155985+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.156761+0000 mgr.gibba009.xiladd (mgr.34457) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:56.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.156799+0000 mgr.gibba009.xiladd (mgr.34457) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:56.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.157286+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.158065+0000 mgr.gibba009.xiladd (mgr.34457) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:56.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.159466+0000 mgr.gibba009.xiladd (mgr.34457) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:56.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.159502+0000 mgr.gibba009.xiladd (mgr.34457) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:56.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.160069+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.160856+0000 mgr.gibba009.xiladd (mgr.34457) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:56.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.161168+0000 mgr.gibba009.xiladd (mgr.34457) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:56.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: audit 2021-03-10T20:25:55.161469+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.162162+0000 mgr.gibba009.xiladd (mgr.34457) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:56.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.162200+0000 mgr.gibba009.xiladd (mgr.34457) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:56.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[31878]: cephadm 2021-03-10T20:25:55.162342+0000 mgr.gibba009.xiladd (mgr.34457) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:56.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.162162+0000 mgr.gibba009.xiladd (mgr.34457) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:56.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.162200+0000 mgr.gibba009.xiladd (mgr.34457) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:56.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:55 gibba004 bash[30897]: cephadm 2021-03-10T20:25:55.162342+0000 mgr.gibba009.xiladd (mgr.34457) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:56.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cluster 2021-03-10T20:25:54.671626+0000 mgr.gibba009.xiladd (mgr.34457) 853 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:56.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:54.940259+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:54.941009+0000 mgr.gibba009.xiladd (mgr.34457) 854 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:25:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.148038+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:25:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.151833+0000 mgr.gibba009.xiladd (mgr.34457) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.152780+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.153899+0000 mgr.gibba009.xiladd (mgr.34457) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.154395+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.155416+0000 mgr.gibba009.xiladd (mgr.34457) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.155452+0000 mgr.gibba009.xiladd (mgr.34457) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.155985+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.156761+0000 mgr.gibba009.xiladd (mgr.34457) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.156799+0000 mgr.gibba009.xiladd (mgr.34457) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.157286+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.158065+0000 mgr.gibba009.xiladd (mgr.34457) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.159466+0000 mgr.gibba009.xiladd (mgr.34457) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.159502+0000 mgr.gibba009.xiladd (mgr.34457) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.160069+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.160856+0000 mgr.gibba009.xiladd (mgr.34457) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.161168+0000 mgr.gibba009.xiladd (mgr.34457) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: audit 2021-03-10T20:25:55.161469+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.162162+0000 mgr.gibba009.xiladd (mgr.34457) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:56.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.162200+0000 mgr.gibba009.xiladd (mgr.34457) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:56.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:55 gibba009 bash[26136]: cephadm 2021-03-10T20:25:55.162342+0000 mgr.gibba009.xiladd (mgr.34457) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:25:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:57 gibba004 bash[30897]: cluster 2021-03-10T20:25:56.673043+0000 mgr.gibba009.xiladd (mgr.34457) 869 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:57 gibba004 bash[31878]: cluster 2021-03-10T20:25:56.673043+0000 mgr.gibba009.xiladd (mgr.34457) 869 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:58.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:57 gibba009 bash[26136]: cluster 2021-03-10T20:25:56.673043+0000 mgr.gibba009.xiladd (mgr.34457) 869 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:25:59 gibba004 bash[30897]: cluster 2021-03-10T20:25:58.674683+0000 mgr.gibba009.xiladd (mgr.34457) 870 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:25:59 gibba004 bash[31878]: cluster 2021-03-10T20:25:58.674683+0000 mgr.gibba009.xiladd (mgr.34457) 870 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:00.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:25:59 gibba009 bash[26136]: cluster 2021-03-10T20:25:58.674683+0000 mgr.gibba009.xiladd (mgr.34457) 870 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:01 gibba004 bash[30897]: cluster 2021-03-10T20:26:00.676319+0000 mgr.gibba009.xiladd (mgr.34457) 871 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:01 gibba004 bash[31878]: cluster 2021-03-10T20:26:00.676319+0000 mgr.gibba009.xiladd (mgr.34457) 871 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:02.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:01 gibba009 bash[26136]: cluster 2021-03-10T20:26:00.676319+0000 mgr.gibba009.xiladd (mgr.34457) 871 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:03 gibba004 bash[30897]: cluster 2021-03-10T20:26:02.677751+0000 mgr.gibba009.xiladd (mgr.34457) 872 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:03 gibba004 bash[31878]: cluster 2021-03-10T20:26:02.677751+0000 mgr.gibba009.xiladd (mgr.34457) 872 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:04.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:03 gibba009 bash[26136]: cluster 2021-03-10T20:26:02.677751+0000 mgr.gibba009.xiladd (mgr.34457) 872 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:05 gibba004 bash[30897]: cluster 2021-03-10T20:26:04.679395+0000 mgr.gibba009.xiladd (mgr.34457) 873 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:05 gibba004 bash[31878]: cluster 2021-03-10T20:26:04.679395+0000 mgr.gibba009.xiladd (mgr.34457) 873 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:06.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:05 gibba009 bash[26136]: cluster 2021-03-10T20:26:04.679395+0000 mgr.gibba009.xiladd (mgr.34457) 873 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:07 gibba004 bash[30897]: cluster 2021-03-10T20:26:06.680916+0000 mgr.gibba009.xiladd (mgr.34457) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:07 gibba004 bash[31878]: cluster 2021-03-10T20:26:06.680916+0000 mgr.gibba009.xiladd (mgr.34457) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:07 gibba009 bash[26136]: cluster 2021-03-10T20:26:06.680916+0000 mgr.gibba009.xiladd (mgr.34457) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:10 gibba004 bash[30897]: cluster 2021-03-10T20:26:08.682632+0000 mgr.gibba009.xiladd (mgr.34457) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:10 gibba004 bash[31878]: cluster 2021-03-10T20:26:08.682632+0000 mgr.gibba009.xiladd (mgr.34457) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:10.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:10 gibba009 bash[26136]: cluster 2021-03-10T20:26:08.682632+0000 mgr.gibba009.xiladd (mgr.34457) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:11.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:11 gibba004 bash[30897]: cephadm 2021-03-10T20:26:10.178163+0000 mgr.gibba009.xiladd (mgr.34457) 876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:11.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:11 gibba004 bash[31878]: cephadm 2021-03-10T20:26:10.178163+0000 mgr.gibba009.xiladd (mgr.34457) 876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:11.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:11 gibba009 bash[26136]: cephadm 2021-03-10T20:26:10.178163+0000 mgr.gibba009.xiladd (mgr.34457) 876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:12 gibba004 bash[30897]: cluster 2021-03-10T20:26:10.684260+0000 mgr.gibba009.xiladd (mgr.34457) 877 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:12 gibba004 bash[31878]: cluster 2021-03-10T20:26:10.684260+0000 mgr.gibba009.xiladd (mgr.34457) 877 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:12.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:12 gibba009 bash[26136]: cluster 2021-03-10T20:26:10.684260+0000 mgr.gibba009.xiladd (mgr.34457) 877 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:14 gibba004 bash[30897]: cluster 2021-03-10T20:26:12.685879+0000 mgr.gibba009.xiladd (mgr.34457) 878 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:14.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:14 gibba004 bash[31878]: cluster 2021-03-10T20:26:12.685879+0000 mgr.gibba009.xiladd (mgr.34457) 878 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:14.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:14 gibba009 bash[26136]: cluster 2021-03-10T20:26:12.685879+0000 mgr.gibba009.xiladd (mgr.34457) 878 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:16.311 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:16 gibba004 bash[30897]: cluster 2021-03-10T20:26:14.687326+0000 mgr.gibba009.xiladd (mgr.34457) 879 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:16.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:16 gibba004 bash[31878]: cluster 2021-03-10T20:26:14.687326+0000 mgr.gibba009.xiladd (mgr.34457) 879 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:16 gibba009 bash[26136]: cluster 2021-03-10T20:26:14.687326+0000 mgr.gibba009.xiladd (mgr.34457) 879 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:16.347 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:26:16.575 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:26:16.575 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (15m) 85s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:26:16.576 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (20m) 21s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:26:16.576 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (15m) 21s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:26:16.576 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (15m) 21s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:26:16.576 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (14m) 85s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:26:16.576 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (14m) 85s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:26:16.577 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (14m) 21s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:26:16.577 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (14m) 85s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:26:16.577 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (20m) 85s ago 20m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:26:16.577 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (20m) 21s ago 20m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:26:16.578 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (13m) 85s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:26:16.578 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (13m) 85s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:26:16.578 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (12m) 85s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:26:16.578 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (12m) 85s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:26:16.579 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (11m) 21s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:26:16.579 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (11m) 21s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:26:16.579 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (11m) 21s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:26:16.579 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (10m) 21s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:26:16.579 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (20m) 21s ago 20m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:26:16.580 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 85s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:16.580 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 21s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:16.835 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:26:16.836 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:26:16.836 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:16.836 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:16.836 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:26:16.837 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:16.837 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:16.837 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:26:16.837 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:26:16.837 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:16.838 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:26:16.838 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:26:16.838 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:26:16.838 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:26:16.839 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:26:17.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:17 gibba004 bash[30897]: audit 2021-03-10T20:26:16.835727+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.104:0/1107607735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:17.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:17 gibba004 bash[31878]: audit 2021-03-10T20:26:16.835727+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.104:0/1107607735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:17.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:17 gibba009 bash[26136]: audit 2021-03-10T20:26:16.835727+0000 mon.c (mon.1) 317 : audit [DBG] from='client.? 172.21.2.104:0/1107607735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[30897]: audit 2021-03-10T20:26:16.339078+0000 mgr.gibba009.xiladd (mgr.34457) 880 : audit [DBG] from='client.54631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[30897]: audit 2021-03-10T20:26:16.562480+0000 mgr.gibba009.xiladd (mgr.34457) 881 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[30897]: cluster 2021-03-10T20:26:16.688544+0000 mgr.gibba009.xiladd (mgr.34457) 882 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[31878]: audit 2021-03-10T20:26:16.339078+0000 mgr.gibba009.xiladd (mgr.34457) 880 : audit [DBG] from='client.54631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[31878]: audit 2021-03-10T20:26:16.562480+0000 mgr.gibba009.xiladd (mgr.34457) 881 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:18 gibba004 bash[31878]: cluster 2021-03-10T20:26:16.688544+0000 mgr.gibba009.xiladd (mgr.34457) 882 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:18.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:18 gibba009 bash[26136]: audit 2021-03-10T20:26:16.339078+0000 mgr.gibba009.xiladd (mgr.34457) 880 : audit [DBG] from='client.54631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:18 gibba009 bash[26136]: audit 2021-03-10T20:26:16.562480+0000 mgr.gibba009.xiladd (mgr.34457) 881 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:18.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:18 gibba009 bash[26136]: cluster 2021-03-10T20:26:16.688544+0000 mgr.gibba009.xiladd (mgr.34457) 882 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:20 gibba004 bash[30897]: cluster 2021-03-10T20:26:18.690300+0000 mgr.gibba009.xiladd (mgr.34457) 883 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:20 gibba004 bash[31878]: cluster 2021-03-10T20:26:18.690300+0000 mgr.gibba009.xiladd (mgr.34457) 883 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:20.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:20 gibba009 bash[26136]: cluster 2021-03-10T20:26:18.690300+0000 mgr.gibba009.xiladd (mgr.34457) 883 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:22 gibba009 bash[26136]: cluster 2021-03-10T20:26:20.691791+0000 mgr.gibba009.xiladd (mgr.34457) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:22 gibba004 bash[30897]: cluster 2021-03-10T20:26:20.691791+0000 mgr.gibba009.xiladd (mgr.34457) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:22.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:22 gibba004 bash[31878]: cluster 2021-03-10T20:26:20.691791+0000 mgr.gibba009.xiladd (mgr.34457) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:24.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:24 gibba009 bash[26136]: cluster 2021-03-10T20:26:22.693431+0000 mgr.gibba009.xiladd (mgr.34457) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:24 gibba004 bash[30897]: cluster 2021-03-10T20:26:22.693431+0000 mgr.gibba009.xiladd (mgr.34457) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:24.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:24 gibba004 bash[31878]: cluster 2021-03-10T20:26:22.693431+0000 mgr.gibba009.xiladd (mgr.34457) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:26 gibba004 bash[30897]: cluster 2021-03-10T20:26:24.694950+0000 mgr.gibba009.xiladd (mgr.34457) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:26 gibba004 bash[30897]: cephadm 2021-03-10T20:26:25.181421+0000 mgr.gibba009.xiladd (mgr.34457) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:26 gibba004 bash[31878]: cluster 2021-03-10T20:26:24.694950+0000 mgr.gibba009.xiladd (mgr.34457) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:26 gibba004 bash[31878]: cephadm 2021-03-10T20:26:25.181421+0000 mgr.gibba009.xiladd (mgr.34457) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:26.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:26 gibba009 bash[26136]: cluster 2021-03-10T20:26:24.694950+0000 mgr.gibba009.xiladd (mgr.34457) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:26.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:26 gibba009 bash[26136]: cephadm 2021-03-10T20:26:25.181421+0000 mgr.gibba009.xiladd (mgr.34457) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:28 gibba004 bash[30897]: cluster 2021-03-10T20:26:26.696410+0000 mgr.gibba009.xiladd (mgr.34457) 888 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:28 gibba004 bash[31878]: cluster 2021-03-10T20:26:26.696410+0000 mgr.gibba009.xiladd (mgr.34457) 888 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:28.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:28 gibba009 bash[26136]: cluster 2021-03-10T20:26:26.696410+0000 mgr.gibba009.xiladd (mgr.34457) 888 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:30 gibba004 bash[30897]: cluster 2021-03-10T20:26:28.698097+0000 mgr.gibba009.xiladd (mgr.34457) 889 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:30.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:30 gibba004 bash[31878]: cluster 2021-03-10T20:26:28.698097+0000 mgr.gibba009.xiladd (mgr.34457) 889 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:30.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:30 gibba009 bash[26136]: cluster 2021-03-10T20:26:28.698097+0000 mgr.gibba009.xiladd (mgr.34457) 889 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:32 gibba004 bash[30897]: cluster 2021-03-10T20:26:30.699722+0000 mgr.gibba009.xiladd (mgr.34457) 890 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:32.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:32 gibba004 bash[31878]: cluster 2021-03-10T20:26:30.699722+0000 mgr.gibba009.xiladd (mgr.34457) 890 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:32.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:32 gibba009 bash[26136]: cluster 2021-03-10T20:26:30.699722+0000 mgr.gibba009.xiladd (mgr.34457) 890 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:34 gibba004 bash[30897]: cluster 2021-03-10T20:26:32.701390+0000 mgr.gibba009.xiladd (mgr.34457) 891 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:34.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:34 gibba004 bash[31878]: cluster 2021-03-10T20:26:32.701390+0000 mgr.gibba009.xiladd (mgr.34457) 891 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:34.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:34 gibba009 bash[26136]: cluster 2021-03-10T20:26:32.701390+0000 mgr.gibba009.xiladd (mgr.34457) 891 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:36 gibba004 bash[30897]: cluster 2021-03-10T20:26:34.703130+0000 mgr.gibba009.xiladd (mgr.34457) 892 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:36 gibba004 bash[31878]: cluster 2021-03-10T20:26:34.703130+0000 mgr.gibba009.xiladd (mgr.34457) 892 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:36.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:36 gibba009 bash[26136]: cluster 2021-03-10T20:26:34.703130+0000 mgr.gibba009.xiladd (mgr.34457) 892 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:38 gibba004 bash[30897]: cluster 2021-03-10T20:26:36.704680+0000 mgr.gibba009.xiladd (mgr.34457) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:38.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:38 gibba004 bash[31878]: cluster 2021-03-10T20:26:36.704680+0000 mgr.gibba009.xiladd (mgr.34457) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:38.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:38 gibba009 bash[26136]: cluster 2021-03-10T20:26:36.704680+0000 mgr.gibba009.xiladd (mgr.34457) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:40.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: cluster 2021-03-10T20:26:38.706095+0000 mgr.gibba009.xiladd (mgr.34457) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.592492+0000 mon.c (mon.1) 318 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.593827+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.594317+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.594938+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.595171+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.595202+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.595453+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.595707+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.661191+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.661769+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.662194+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[30897]: audit 2021-03-10T20:26:39.663170+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: cluster 2021-03-10T20:26:38.706095+0000 mgr.gibba009.xiladd (mgr.34457) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.592492+0000 mon.c (mon.1) 318 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.593827+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.594317+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.594938+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.595171+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.595202+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.595453+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.595707+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.661191+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.661769+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.662194+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:40 gibba004 bash[31878]: audit 2021-03-10T20:26:39.663170+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:40.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: cluster 2021-03-10T20:26:38.706095+0000 mgr.gibba009.xiladd (mgr.34457) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:40.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.592492+0000 mon.c (mon.1) 318 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.593827+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.594317+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:26:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.594938+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.595171+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.595202+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.595453+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.595707+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:26:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.661191+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.661769+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.662194+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:40 gibba009 bash[26136]: audit 2021-03-10T20:26:39.663170+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:41.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:41 gibba004 bash[30897]: cephadm 2021-03-10T20:26:40.195843+0000 mgr.gibba009.xiladd (mgr.34457) 895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:41.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:41 gibba004 bash[31878]: cephadm 2021-03-10T20:26:40.195843+0000 mgr.gibba009.xiladd (mgr.34457) 895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:41.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:41 gibba009 bash[26136]: cephadm 2021-03-10T20:26:40.195843+0000 mgr.gibba009.xiladd (mgr.34457) 895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:42 gibba004 bash[30897]: cluster 2021-03-10T20:26:40.707597+0000 mgr.gibba009.xiladd (mgr.34457) 896 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:42.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:42 gibba004 bash[31878]: cluster 2021-03-10T20:26:40.707597+0000 mgr.gibba009.xiladd (mgr.34457) 896 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:42.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:42 gibba009 bash[26136]: cluster 2021-03-10T20:26:40.707597+0000 mgr.gibba009.xiladd (mgr.34457) 896 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:44 gibba004 bash[30897]: cluster 2021-03-10T20:26:42.709229+0000 mgr.gibba009.xiladd (mgr.34457) 897 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:44 gibba004 bash[31878]: cluster 2021-03-10T20:26:42.709229+0000 mgr.gibba009.xiladd (mgr.34457) 897 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:44.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:44 gibba009 bash[26136]: cluster 2021-03-10T20:26:42.709229+0000 mgr.gibba009.xiladd (mgr.34457) 897 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:46 gibba004 bash[30897]: cluster 2021-03-10T20:26:44.710701+0000 mgr.gibba009.xiladd (mgr.34457) 898 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:46.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:46 gibba004 bash[31878]: cluster 2021-03-10T20:26:44.710701+0000 mgr.gibba009.xiladd (mgr.34457) 898 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:46.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:46 gibba009 bash[26136]: cluster 2021-03-10T20:26:44.710701+0000 mgr.gibba009.xiladd (mgr.34457) 898 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:47.086 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:26:47.318 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:26:47.319 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (15m) 116s ago 21m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:26:47.319 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (20m) 52s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:26:47.319 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (16m) 52s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:26:47.319 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (16m) 52s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:26:47.319 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (15m) 116s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:26:47.320 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (15m) 116s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:26:47.320 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (14m) 52s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:26:47.320 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (14m) 116s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:26:47.320 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (21m) 116s ago 21m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:26:47.321 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (21m) 52s ago 21m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:26:47.321 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (14m) 116s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:26:47.321 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (13m) 116s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:26:47.321 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (13m) 116s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:26:47.321 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (12m) 116s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:26:47.322 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (12m) 52s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:26:47.322 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (11m) 52s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:26:47.322 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (11m) 52s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:26:47.322 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (11m) 52s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:26:47.323 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (20m) 52s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:26:47.323 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 116s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:47.323 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 52s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:47.567 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:26:47.567 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:26:47.568 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:47.568 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:47.568 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:26:47.568 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:47.568 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:47.569 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:26:47.569 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:26:47.569 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:26:47.569 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:26:47.570 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:26:47.570 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:26:47.570 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:26:47.570 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:26:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[30897]: cluster 2021-03-10T20:26:46.711993+0000 mgr.gibba009.xiladd (mgr.34457) 899 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[30897]: audit 2021-03-10T20:26:47.076377+0000 mgr.gibba009.xiladd (mgr.34457) 900 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[30897]: audit 2021-03-10T20:26:47.567586+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.2.104:0/487610155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[31878]: cluster 2021-03-10T20:26:46.711993+0000 mgr.gibba009.xiladd (mgr.34457) 899 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:48.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[31878]: audit 2021-03-10T20:26:47.076377+0000 mgr.gibba009.xiladd (mgr.34457) 900 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:48.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:48 gibba004 bash[31878]: audit 2021-03-10T20:26:47.567586+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.2.104:0/487610155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:48.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:48 gibba009 bash[26136]: cluster 2021-03-10T20:26:46.711993+0000 mgr.gibba009.xiladd (mgr.34457) 899 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:48.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:48 gibba009 bash[26136]: audit 2021-03-10T20:26:47.076377+0000 mgr.gibba009.xiladd (mgr.34457) 900 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:48.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:48 gibba009 bash[26136]: audit 2021-03-10T20:26:47.567586+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.2.104:0/487610155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:49.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:49 gibba004 bash[30897]: audit 2021-03-10T20:26:47.305871+0000 mgr.gibba009.xiladd (mgr.34457) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:49.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:49 gibba004 bash[31878]: audit 2021-03-10T20:26:47.305871+0000 mgr.gibba009.xiladd (mgr.34457) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:49.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:49 gibba009 bash[26136]: audit 2021-03-10T20:26:47.305871+0000 mgr.gibba009.xiladd (mgr.34457) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:50 gibba004 bash[30897]: cluster 2021-03-10T20:26:48.713707+0000 mgr.gibba009.xiladd (mgr.34457) 902 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:50.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:50 gibba004 bash[31878]: cluster 2021-03-10T20:26:48.713707+0000 mgr.gibba009.xiladd (mgr.34457) 902 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:50.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:50 gibba009 bash[26136]: cluster 2021-03-10T20:26:48.713707+0000 mgr.gibba009.xiladd (mgr.34457) 902 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:52 gibba004 bash[30897]: cluster 2021-03-10T20:26:50.715469+0000 mgr.gibba009.xiladd (mgr.34457) 903 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:52.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:52 gibba004 bash[31878]: cluster 2021-03-10T20:26:50.715469+0000 mgr.gibba009.xiladd (mgr.34457) 903 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:52.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:52 gibba009 bash[26136]: cluster 2021-03-10T20:26:50.715469+0000 mgr.gibba009.xiladd (mgr.34457) 903 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:54 gibba004 bash[30897]: cluster 2021-03-10T20:26:52.716892+0000 mgr.gibba009.xiladd (mgr.34457) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:54.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:54 gibba004 bash[31878]: cluster 2021-03-10T20:26:52.716892+0000 mgr.gibba009.xiladd (mgr.34457) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:54.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:54 gibba009 bash[26136]: cluster 2021-03-10T20:26:52.716892+0000 mgr.gibba009.xiladd (mgr.34457) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:55.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:55 gibba004 bash[30897]: audit 2021-03-10T20:26:55.202745+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:55.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:55 gibba004 bash[31878]: audit 2021-03-10T20:26:55.202745+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:55.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:55 gibba009 bash[26136]: audit 2021-03-10T20:26:55.202745+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: cluster 2021-03-10T20:26:54.718409+0000 mgr.gibba009.xiladd (mgr.34457) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.207535+0000 mgr.gibba009.xiladd (mgr.34457) 906 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:26:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.209350+0000 mgr.gibba009.xiladd (mgr.34457) 907 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:26:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.437299+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:26:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.440934+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.442242+0000 mon.c (mon.1) 326 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.444163+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.445464+0000 mon.c (mon.1) 328 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.448750+0000 mon.c (mon.1) 329 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[30897]: audit 2021-03-10T20:26:55.450326+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: cluster 2021-03-10T20:26:54.718409+0000 mgr.gibba009.xiladd (mgr.34457) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.207535+0000 mgr.gibba009.xiladd (mgr.34457) 906 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:26:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.209350+0000 mgr.gibba009.xiladd (mgr.34457) 907 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:26:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.437299+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:26:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.440934+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.442242+0000 mon.c (mon.1) 326 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.444163+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.445464+0000 mon.c (mon.1) 328 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.448750+0000 mon.c (mon.1) 329 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:56 gibba004 bash[31878]: audit 2021-03-10T20:26:55.450326+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: cluster 2021-03-10T20:26:54.718409+0000 mgr.gibba009.xiladd (mgr.34457) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:56.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.207535+0000 mgr.gibba009.xiladd (mgr.34457) 906 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:26:56.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.209350+0000 mgr.gibba009.xiladd (mgr.34457) 907 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:26:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.437299+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:26:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.440934+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.442242+0000 mon.c (mon.1) 326 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.444163+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.445464+0000 mon.c (mon.1) 328 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.448750+0000 mon.c (mon.1) 329 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:56.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:56 gibba009 bash[26136]: audit 2021-03-10T20:26:55.450326+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.439923+0000 mgr.gibba009.xiladd (mgr.34457) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.441503+0000 mgr.gibba009.xiladd (mgr.34457) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.443293+0000 mgr.gibba009.xiladd (mgr.34457) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.443331+0000 mgr.gibba009.xiladd (mgr.34457) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.444637+0000 mgr.gibba009.xiladd (mgr.34457) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.444733+0000 mgr.gibba009.xiladd (mgr.34457) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.445915+0000 mgr.gibba009.xiladd (mgr.34457) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.447810+0000 mgr.gibba009.xiladd (mgr.34457) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.447848+0000 mgr.gibba009.xiladd (mgr.34457) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.449267+0000 mgr.gibba009.xiladd (mgr.34457) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.449589+0000 mgr.gibba009.xiladd (mgr.34457) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.450971+0000 mgr.gibba009.xiladd (mgr.34457) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.451010+0000 mgr.gibba009.xiladd (mgr.34457) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[30897]: cephadm 2021-03-10T20:26:55.451140+0000 mgr.gibba009.xiladd (mgr.34457) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.439923+0000 mgr.gibba009.xiladd (mgr.34457) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.441503+0000 mgr.gibba009.xiladd (mgr.34457) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.443293+0000 mgr.gibba009.xiladd (mgr.34457) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.443331+0000 mgr.gibba009.xiladd (mgr.34457) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.444637+0000 mgr.gibba009.xiladd (mgr.34457) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.444733+0000 mgr.gibba009.xiladd (mgr.34457) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.445915+0000 mgr.gibba009.xiladd (mgr.34457) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.447810+0000 mgr.gibba009.xiladd (mgr.34457) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.447848+0000 mgr.gibba009.xiladd (mgr.34457) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.449267+0000 mgr.gibba009.xiladd (mgr.34457) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.449589+0000 mgr.gibba009.xiladd (mgr.34457) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.450971+0000 mgr.gibba009.xiladd (mgr.34457) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.451010+0000 mgr.gibba009.xiladd (mgr.34457) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:57 gibba004 bash[31878]: cephadm 2021-03-10T20:26:55.451140+0000 mgr.gibba009.xiladd (mgr.34457) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:57.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.439923+0000 mgr.gibba009.xiladd (mgr.34457) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:57.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.441503+0000 mgr.gibba009.xiladd (mgr.34457) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:57.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.443293+0000 mgr.gibba009.xiladd (mgr.34457) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.443331+0000 mgr.gibba009.xiladd (mgr.34457) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.444637+0000 mgr.gibba009.xiladd (mgr.34457) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.444733+0000 mgr.gibba009.xiladd (mgr.34457) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.445915+0000 mgr.gibba009.xiladd (mgr.34457) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.447810+0000 mgr.gibba009.xiladd (mgr.34457) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.447848+0000 mgr.gibba009.xiladd (mgr.34457) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.449267+0000 mgr.gibba009.xiladd (mgr.34457) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.449589+0000 mgr.gibba009.xiladd (mgr.34457) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.450971+0000 mgr.gibba009.xiladd (mgr.34457) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.451010+0000 mgr.gibba009.xiladd (mgr.34457) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:57 gibba009 bash[26136]: cephadm 2021-03-10T20:26:55.451140+0000 mgr.gibba009.xiladd (mgr.34457) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:26:58.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:58 gibba004 bash[30897]: cluster 2021-03-10T20:26:56.719642+0000 mgr.gibba009.xiladd (mgr.34457) 922 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:58.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:58 gibba004 bash[31878]: cluster 2021-03-10T20:26:56.719642+0000 mgr.gibba009.xiladd (mgr.34457) 922 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:58.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:58 gibba009 bash[26136]: cluster 2021-03-10T20:26:56.719642+0000 mgr.gibba009.xiladd (mgr.34457) 922 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:26:59 gibba004 bash[30897]: cluster 2021-03-10T20:26:58.721366+0000 mgr.gibba009.xiladd (mgr.34457) 923 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:26:59 gibba004 bash[31878]: cluster 2021-03-10T20:26:58.721366+0000 mgr.gibba009.xiladd (mgr.34457) 923 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:26:59 gibba009 bash[26136]: cluster 2021-03-10T20:26:58.721366+0000 mgr.gibba009.xiladd (mgr.34457) 923 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:01 gibba004 bash[30897]: cluster 2021-03-10T20:27:00.722893+0000 mgr.gibba009.xiladd (mgr.34457) 924 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:01 gibba004 bash[31878]: cluster 2021-03-10T20:27:00.722893+0000 mgr.gibba009.xiladd (mgr.34457) 924 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:01 gibba009 bash[26136]: cluster 2021-03-10T20:27:00.722893+0000 mgr.gibba009.xiladd (mgr.34457) 924 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:03 gibba004 bash[30897]: cluster 2021-03-10T20:27:02.724344+0000 mgr.gibba009.xiladd (mgr.34457) 925 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:03 gibba004 bash[31878]: cluster 2021-03-10T20:27:02.724344+0000 mgr.gibba009.xiladd (mgr.34457) 925 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:03 gibba009 bash[26136]: cluster 2021-03-10T20:27:02.724344+0000 mgr.gibba009.xiladd (mgr.34457) 925 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:05 gibba004 bash[30897]: cluster 2021-03-10T20:27:04.725876+0000 mgr.gibba009.xiladd (mgr.34457) 926 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:05 gibba004 bash[31878]: cluster 2021-03-10T20:27:04.725876+0000 mgr.gibba009.xiladd (mgr.34457) 926 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:06.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:05 gibba009 bash[26136]: cluster 2021-03-10T20:27:04.725876+0000 mgr.gibba009.xiladd (mgr.34457) 926 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:07 gibba004 bash[30897]: cluster 2021-03-10T20:27:06.727243+0000 mgr.gibba009.xiladd (mgr.34457) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:07 gibba004 bash[31878]: cluster 2021-03-10T20:27:06.727243+0000 mgr.gibba009.xiladd (mgr.34457) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:08.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:07 gibba009 bash[26136]: cluster 2021-03-10T20:27:06.727243+0000 mgr.gibba009.xiladd (mgr.34457) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:09 gibba004 bash[30897]: cluster 2021-03-10T20:27:08.728721+0000 mgr.gibba009.xiladd (mgr.34457) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:09 gibba004 bash[31878]: cluster 2021-03-10T20:27:08.728721+0000 mgr.gibba009.xiladd (mgr.34457) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:10.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:09 gibba009 bash[26136]: cluster 2021-03-10T20:27:08.728721+0000 mgr.gibba009.xiladd (mgr.34457) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:11 gibba004 bash[30897]: cephadm 2021-03-10T20:27:10.466899+0000 mgr.gibba009.xiladd (mgr.34457) 929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:11 gibba004 bash[30897]: cluster 2021-03-10T20:27:10.730152+0000 mgr.gibba009.xiladd (mgr.34457) 930 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:11 gibba004 bash[31878]: cephadm 2021-03-10T20:27:10.466899+0000 mgr.gibba009.xiladd (mgr.34457) 929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:11 gibba004 bash[31878]: cluster 2021-03-10T20:27:10.730152+0000 mgr.gibba009.xiladd (mgr.34457) 930 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:12.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:11 gibba009 bash[26136]: cephadm 2021-03-10T20:27:10.466899+0000 mgr.gibba009.xiladd (mgr.34457) 929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:12.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:11 gibba009 bash[26136]: cluster 2021-03-10T20:27:10.730152+0000 mgr.gibba009.xiladd (mgr.34457) 930 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:13 gibba004 bash[30897]: cluster 2021-03-10T20:27:12.731840+0000 mgr.gibba009.xiladd (mgr.34457) 931 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:14.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:13 gibba004 bash[31878]: cluster 2021-03-10T20:27:12.731840+0000 mgr.gibba009.xiladd (mgr.34457) 931 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:14.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:13 gibba009 bash[26136]: cluster 2021-03-10T20:27:12.731840+0000 mgr.gibba009.xiladd (mgr.34457) 931 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:15 gibba004 bash[30897]: cluster 2021-03-10T20:27:14.733416+0000 mgr.gibba009.xiladd (mgr.34457) 932 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:15 gibba004 bash[31878]: cluster 2021-03-10T20:27:14.733416+0000 mgr.gibba009.xiladd (mgr.34457) 932 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:16.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:15 gibba009 bash[26136]: cluster 2021-03-10T20:27:14.733416+0000 mgr.gibba009.xiladd (mgr.34457) 932 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:17.813 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:27:18.042 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:27:18.042 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (16m) 2m ago 21m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:27:18.042 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (21m) 83s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:27:18.043 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (16m) 83s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:27:18.043 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (16m) 83s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:27:18.043 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:27:18.043 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:27:18.043 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (15m) 83s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:27:18.044 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:27:18.044 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (21m) 2m ago 21m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:27:18.044 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (21m) 83s ago 21m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:27:18.044 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:27:18.045 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:27:18.045 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:27:18.045 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:27:18.045 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (12m) 83s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:27:18.045 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (12m) 83s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:27:18.046 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (12m) 83s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:27:18.046 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (11m) 83s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:27:18.046 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (21m) 83s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:27:18.046 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:18.047 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 83s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:18.293 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:27:18.293 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:27:18.293 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:18.293 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:18.294 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:27:18.294 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:18.294 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:18.294 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:27:18.295 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:27:18.295 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:18.295 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:27:18.295 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:27:18.296 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:27:18.296 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:27:18.296 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:27:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:17 gibba004 bash[30897]: cluster 2021-03-10T20:27:16.734096+0000 mgr.gibba009.xiladd (mgr.34457) 933 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:18.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:17 gibba004 bash[31878]: cluster 2021-03-10T20:27:16.734096+0000 mgr.gibba009.xiladd (mgr.34457) 933 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:18.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:17 gibba009 bash[26136]: cluster 2021-03-10T20:27:16.734096+0000 mgr.gibba009.xiladd (mgr.34457) 933 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:19.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[30897]: audit 2021-03-10T20:27:17.804411+0000 mgr.gibba009.xiladd (mgr.34457) 934 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[30897]: audit 2021-03-10T20:27:18.030503+0000 mgr.gibba009.xiladd (mgr.34457) 935 : audit [DBG] from='client.44694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[30897]: audit 2021-03-10T20:27:18.293199+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.104:0/3941887116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:19.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[31878]: audit 2021-03-10T20:27:17.804411+0000 mgr.gibba009.xiladd (mgr.34457) 934 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[31878]: audit 2021-03-10T20:27:18.030503+0000 mgr.gibba009.xiladd (mgr.34457) 935 : audit [DBG] from='client.44694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:18 gibba004 bash[31878]: audit 2021-03-10T20:27:18.293199+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.104:0/3941887116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:19.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:18 gibba009 bash[26136]: audit 2021-03-10T20:27:17.804411+0000 mgr.gibba009.xiladd (mgr.34457) 934 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:18 gibba009 bash[26136]: audit 2021-03-10T20:27:18.030503+0000 mgr.gibba009.xiladd (mgr.34457) 935 : audit [DBG] from='client.44694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:19.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:18 gibba009 bash[26136]: audit 2021-03-10T20:27:18.293199+0000 mon.c (mon.1) 331 : audit [DBG] from='client.? 172.21.2.104:0/3941887116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:19 gibba004 bash[30897]: cluster 2021-03-10T20:27:18.735554+0000 mgr.gibba009.xiladd (mgr.34457) 936 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:20.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:19 gibba004 bash[31878]: cluster 2021-03-10T20:27:18.735554+0000 mgr.gibba009.xiladd (mgr.34457) 936 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:20.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:19 gibba009 bash[26136]: cluster 2021-03-10T20:27:18.735554+0000 mgr.gibba009.xiladd (mgr.34457) 936 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:21 gibba004 bash[30897]: cluster 2021-03-10T20:27:20.737226+0000 mgr.gibba009.xiladd (mgr.34457) 937 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:21 gibba004 bash[31878]: cluster 2021-03-10T20:27:20.737226+0000 mgr.gibba009.xiladd (mgr.34457) 937 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:22.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:21 gibba009 bash[26136]: cluster 2021-03-10T20:27:20.737226+0000 mgr.gibba009.xiladd (mgr.34457) 937 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:23 gibba004 bash[30897]: cluster 2021-03-10T20:27:22.738552+0000 mgr.gibba009.xiladd (mgr.34457) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:23 gibba004 bash[31878]: cluster 2021-03-10T20:27:22.738552+0000 mgr.gibba009.xiladd (mgr.34457) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:24.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:23 gibba009 bash[26136]: cluster 2021-03-10T20:27:22.738552+0000 mgr.gibba009.xiladd (mgr.34457) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:25 gibba004 bash[30897]: cluster 2021-03-10T20:27:24.740108+0000 mgr.gibba009.xiladd (mgr.34457) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:25 gibba004 bash[31878]: cluster 2021-03-10T20:27:24.740108+0000 mgr.gibba009.xiladd (mgr.34457) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:26.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:25 gibba009 bash[26136]: cluster 2021-03-10T20:27:24.740108+0000 mgr.gibba009.xiladd (mgr.34457) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:27.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:26 gibba004 bash[30897]: cephadm 2021-03-10T20:27:25.476030+0000 mgr.gibba009.xiladd (mgr.34457) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:27.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:26 gibba004 bash[31878]: cephadm 2021-03-10T20:27:25.476030+0000 mgr.gibba009.xiladd (mgr.34457) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:27.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:26 gibba009 bash[26136]: cephadm 2021-03-10T20:27:25.476030+0000 mgr.gibba009.xiladd (mgr.34457) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:27 gibba004 bash[30897]: cluster 2021-03-10T20:27:26.741017+0000 mgr.gibba009.xiladd (mgr.34457) 941 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:28 gibba004 bash[31878]: cluster 2021-03-10T20:27:26.741017+0000 mgr.gibba009.xiladd (mgr.34457) 941 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:28.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:28 gibba009 bash[26136]: cluster 2021-03-10T20:27:26.741017+0000 mgr.gibba009.xiladd (mgr.34457) 941 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:30 gibba004 bash[30897]: cluster 2021-03-10T20:27:28.742335+0000 mgr.gibba009.xiladd (mgr.34457) 942 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:30.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:30 gibba004 bash[31878]: cluster 2021-03-10T20:27:28.742335+0000 mgr.gibba009.xiladd (mgr.34457) 942 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:30.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:30 gibba009 bash[26136]: cluster 2021-03-10T20:27:28.742335+0000 mgr.gibba009.xiladd (mgr.34457) 942 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:32 gibba004 bash[30897]: cluster 2021-03-10T20:27:30.743978+0000 mgr.gibba009.xiladd (mgr.34457) 943 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:32 gibba004 bash[31878]: cluster 2021-03-10T20:27:30.743978+0000 mgr.gibba009.xiladd (mgr.34457) 943 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:32.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:32 gibba009 bash[26136]: cluster 2021-03-10T20:27:30.743978+0000 mgr.gibba009.xiladd (mgr.34457) 943 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:34 gibba004 bash[30897]: cluster 2021-03-10T20:27:32.745590+0000 mgr.gibba009.xiladd (mgr.34457) 944 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:34 gibba004 bash[31878]: cluster 2021-03-10T20:27:32.745590+0000 mgr.gibba009.xiladd (mgr.34457) 944 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:34.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:34 gibba009 bash[26136]: cluster 2021-03-10T20:27:32.745590+0000 mgr.gibba009.xiladd (mgr.34457) 944 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:36 gibba004 bash[30897]: cluster 2021-03-10T20:27:34.747126+0000 mgr.gibba009.xiladd (mgr.34457) 945 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:36 gibba004 bash[31878]: cluster 2021-03-10T20:27:34.747126+0000 mgr.gibba009.xiladd (mgr.34457) 945 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:36.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:36 gibba009 bash[26136]: cluster 2021-03-10T20:27:34.747126+0000 mgr.gibba009.xiladd (mgr.34457) 945 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:38 gibba004 bash[30897]: cluster 2021-03-10T20:27:36.747937+0000 mgr.gibba009.xiladd (mgr.34457) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:38 gibba004 bash[31878]: cluster 2021-03-10T20:27:36.747937+0000 mgr.gibba009.xiladd (mgr.34457) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:38.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:38 gibba009 bash[26136]: cluster 2021-03-10T20:27:36.747937+0000 mgr.gibba009.xiladd (mgr.34457) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: cluster 2021-03-10T20:27:38.749426+0000 mgr.gibba009.xiladd (mgr.34457) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.602497+0000 mon.c (mon.1) 332 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.603249+0000 mon.c (mon.1) 333 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.603770+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.603930+0000 mon.c (mon.1) 334 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.604640+0000 mon.c (mon.1) 335 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.605809+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.606950+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.607905+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.668342+0000 mon.c (mon.1) 336 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.668718+0000 mon.c (mon.1) 337 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.669090+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[30897]: audit 2021-03-10T20:27:39.669896+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: cluster 2021-03-10T20:27:38.749426+0000 mgr.gibba009.xiladd (mgr.34457) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.602497+0000 mon.c (mon.1) 332 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.603249+0000 mon.c (mon.1) 333 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.603770+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.603930+0000 mon.c (mon.1) 334 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.604640+0000 mon.c (mon.1) 335 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.605809+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.606950+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.607905+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.668342+0000 mon.c (mon.1) 336 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.668718+0000 mon.c (mon.1) 337 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.669090+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:40 gibba004 bash[31878]: audit 2021-03-10T20:27:39.669896+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:40.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: cluster 2021-03-10T20:27:38.749426+0000 mgr.gibba009.xiladd (mgr.34457) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.602497+0000 mon.c (mon.1) 332 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.603249+0000 mon.c (mon.1) 333 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.603770+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:27:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.603930+0000 mon.c (mon.1) 334 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.604640+0000 mon.c (mon.1) 335 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.605809+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.606950+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:27:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.607905+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:27:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.668342+0000 mon.c (mon.1) 336 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.668718+0000 mon.c (mon.1) 337 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.669090+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:40 gibba009 bash[26136]: audit 2021-03-10T20:27:39.669896+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:42 gibba004 bash[30897]: cephadm 2021-03-10T20:27:40.489628+0000 mgr.gibba009.xiladd (mgr.34457) 948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:42 gibba004 bash[30897]: cluster 2021-03-10T20:27:40.751293+0000 mgr.gibba009.xiladd (mgr.34457) 949 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:42 gibba004 bash[31878]: cephadm 2021-03-10T20:27:40.489628+0000 mgr.gibba009.xiladd (mgr.34457) 948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:42 gibba004 bash[31878]: cluster 2021-03-10T20:27:40.751293+0000 mgr.gibba009.xiladd (mgr.34457) 949 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:42.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:42 gibba009 bash[26136]: cephadm 2021-03-10T20:27:40.489628+0000 mgr.gibba009.xiladd (mgr.34457) 948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:42.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:42 gibba009 bash[26136]: cluster 2021-03-10T20:27:40.751293+0000 mgr.gibba009.xiladd (mgr.34457) 949 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:44.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:44 gibba009 bash[26136]: cluster 2021-03-10T20:27:42.752952+0000 mgr.gibba009.xiladd (mgr.34457) 950 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:44 gibba004 bash[30897]: cluster 2021-03-10T20:27:42.752952+0000 mgr.gibba009.xiladd (mgr.34457) 950 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:44.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:44 gibba004 bash[31878]: cluster 2021-03-10T20:27:42.752952+0000 mgr.gibba009.xiladd (mgr.34457) 950 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:46.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:46 gibba009 bash[26136]: cluster 2021-03-10T20:27:44.754433+0000 mgr.gibba009.xiladd (mgr.34457) 951 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:46 gibba004 bash[30897]: cluster 2021-03-10T20:27:44.754433+0000 mgr.gibba009.xiladd (mgr.34457) 951 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:46.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:46 gibba004 bash[31878]: cluster 2021-03-10T20:27:44.754433+0000 mgr.gibba009.xiladd (mgr.34457) 951 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:48 gibba009 bash[26136]: cluster 2021-03-10T20:27:46.755192+0000 mgr.gibba009.xiladd (mgr.34457) 952 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:48.539 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:27:48.561 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:48 gibba004 bash[30897]: cluster 2021-03-10T20:27:46.755192+0000 mgr.gibba009.xiladd (mgr.34457) 952 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:48.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:48 gibba004 bash[31878]: cluster 2021-03-10T20:27:46.755192+0000 mgr.gibba009.xiladd (mgr.34457) 952 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:48.767 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:27:48.767 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (16m) 2m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:27:48.767 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (21m) 113s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:27:48.767 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (17m) 113s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:27:48.768 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (17m) 113s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:27:48.768 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:27:48.768 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:27:48.768 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (15m) 113s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:27:48.768 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:27:48.769 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:27:48.769 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (22m) 113s ago 22m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:27:48.769 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:27:48.769 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:27:48.770 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:27:48.770 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:27:48.770 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (13m) 113s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:27:48.770 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (12m) 113s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:27:48.771 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (12m) 113s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:27:48.771 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (12m) 113s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:27:48.771 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (21m) 113s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:27:48.771 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:48.771 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 113s ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:49.021 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:27:49.021 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:27:49.021 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:49.021 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:49.022 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:27:49.022 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:49.022 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:49.022 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:27:49.023 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:27:49.023 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:27:49.023 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:27:49.023 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:27:49.024 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:27:49.024 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:27:49.024 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:27:50.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[30897]: audit 2021-03-10T20:27:48.529841+0000 mgr.gibba009.xiladd (mgr.34457) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[30897]: audit 2021-03-10T20:27:48.754207+0000 mgr.gibba009.xiladd (mgr.34457) 954 : audit [DBG] from='client.44712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[30897]: cluster 2021-03-10T20:27:48.756434+0000 mgr.gibba009.xiladd (mgr.34457) 955 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:50.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[30897]: audit 2021-03-10T20:27:49.021182+0000 mon.a (mon.0) 682 : audit [DBG] from='client.? 172.21.2.104:0/2757619340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:50.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[31878]: audit 2021-03-10T20:27:48.529841+0000 mgr.gibba009.xiladd (mgr.34457) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[31878]: audit 2021-03-10T20:27:48.754207+0000 mgr.gibba009.xiladd (mgr.34457) 954 : audit [DBG] from='client.44712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[31878]: cluster 2021-03-10T20:27:48.756434+0000 mgr.gibba009.xiladd (mgr.34457) 955 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:50.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:49 gibba004 bash[31878]: audit 2021-03-10T20:27:49.021182+0000 mon.a (mon.0) 682 : audit [DBG] from='client.? 172.21.2.104:0/2757619340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:49 gibba009 bash[26136]: audit 2021-03-10T20:27:48.529841+0000 mgr.gibba009.xiladd (mgr.34457) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:49 gibba009 bash[26136]: audit 2021-03-10T20:27:48.754207+0000 mgr.gibba009.xiladd (mgr.34457) 954 : audit [DBG] from='client.44712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:49 gibba009 bash[26136]: cluster 2021-03-10T20:27:48.756434+0000 mgr.gibba009.xiladd (mgr.34457) 955 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:50.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:49 gibba009 bash[26136]: audit 2021-03-10T20:27:49.021182+0000 mon.a (mon.0) 682 : audit [DBG] from='client.? 172.21.2.104:0/2757619340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:52.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:51 gibba004 bash[30897]: cluster 2021-03-10T20:27:50.757981+0000 mgr.gibba009.xiladd (mgr.34457) 956 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:52.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:51 gibba004 bash[31878]: cluster 2021-03-10T20:27:50.757981+0000 mgr.gibba009.xiladd (mgr.34457) 956 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:52.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:51 gibba009 bash[26136]: cluster 2021-03-10T20:27:50.757981+0000 mgr.gibba009.xiladd (mgr.34457) 956 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:53 gibba004 bash[30897]: cluster 2021-03-10T20:27:52.759633+0000 mgr.gibba009.xiladd (mgr.34457) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:53 gibba004 bash[31878]: cluster 2021-03-10T20:27:52.759633+0000 mgr.gibba009.xiladd (mgr.34457) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:53 gibba009 bash[26136]: cluster 2021-03-10T20:27:52.759633+0000 mgr.gibba009.xiladd (mgr.34457) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: cluster 2021-03-10T20:27:54.761300+0000 mgr.gibba009.xiladd (mgr.34457) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.506874+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.727367+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:27:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.731366+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.733018+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.734631+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.736169+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.739630+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:55 gibba009 bash[26136]: audit 2021-03-10T20:27:55.741467+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: cluster 2021-03-10T20:27:54.761300+0000 mgr.gibba009.xiladd (mgr.34457) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.506874+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.727367+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:27:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.731366+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.733018+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.734631+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.736169+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.739630+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[30897]: audit 2021-03-10T20:27:55.741467+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: cluster 2021-03-10T20:27:54.761300+0000 mgr.gibba009.xiladd (mgr.34457) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.506874+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.727367+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:27:56.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.731366+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.733018+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.734631+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.736169+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.739630+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:56.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:55 gibba004 bash[31878]: audit 2021-03-10T20:27:55.741467+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.511014+0000 mgr.gibba009.xiladd (mgr.34457) 959 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:27:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.513181+0000 mgr.gibba009.xiladd (mgr.34457) 960 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:27:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.730015+0000 mgr.gibba009.xiladd (mgr.34457) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.731991+0000 mgr.gibba009.xiladd (mgr.34457) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:57.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.733652+0000 mgr.gibba009.xiladd (mgr.34457) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:57.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.733698+0000 mgr.gibba009.xiladd (mgr.34457) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:57.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.735171+0000 mgr.gibba009.xiladd (mgr.34457) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:57.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.735218+0000 mgr.gibba009.xiladd (mgr.34457) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.736588+0000 mgr.gibba009.xiladd (mgr.34457) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.738519+0000 mgr.gibba009.xiladd (mgr.34457) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.738565+0000 mgr.gibba009.xiladd (mgr.34457) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.740181+0000 mgr.gibba009.xiladd (mgr.34457) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.740502+0000 mgr.gibba009.xiladd (mgr.34457) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:57.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.742082+0000 mgr.gibba009.xiladd (mgr.34457) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:57.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.742126+0000 mgr.gibba009.xiladd (mgr.34457) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:57.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[30897]: cephadm 2021-03-10T20:27:55.742266+0000 mgr.gibba009.xiladd (mgr.34457) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:57.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.511014+0000 mgr.gibba009.xiladd (mgr.34457) 959 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:27:57.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.513181+0000 mgr.gibba009.xiladd (mgr.34457) 960 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:27:57.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.730015+0000 mgr.gibba009.xiladd (mgr.34457) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:57.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.731991+0000 mgr.gibba009.xiladd (mgr.34457) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:57.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.733652+0000 mgr.gibba009.xiladd (mgr.34457) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:57.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.733698+0000 mgr.gibba009.xiladd (mgr.34457) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:57.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.735171+0000 mgr.gibba009.xiladd (mgr.34457) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:57.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.735218+0000 mgr.gibba009.xiladd (mgr.34457) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:57.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.736588+0000 mgr.gibba009.xiladd (mgr.34457) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.738519+0000 mgr.gibba009.xiladd (mgr.34457) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.738565+0000 mgr.gibba009.xiladd (mgr.34457) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.740181+0000 mgr.gibba009.xiladd (mgr.34457) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.740502+0000 mgr.gibba009.xiladd (mgr.34457) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.742082+0000 mgr.gibba009.xiladd (mgr.34457) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.742126+0000 mgr.gibba009.xiladd (mgr.34457) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:56 gibba004 bash[31878]: cephadm 2021-03-10T20:27:55.742266+0000 mgr.gibba009.xiladd (mgr.34457) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:57.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.511014+0000 mgr.gibba009.xiladd (mgr.34457) 959 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:27:57.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.513181+0000 mgr.gibba009.xiladd (mgr.34457) 960 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:27:57.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.730015+0000 mgr.gibba009.xiladd (mgr.34457) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:57.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.731991+0000 mgr.gibba009.xiladd (mgr.34457) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:57.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.733652+0000 mgr.gibba009.xiladd (mgr.34457) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.733698+0000 mgr.gibba009.xiladd (mgr.34457) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.735171+0000 mgr.gibba009.xiladd (mgr.34457) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.735218+0000 mgr.gibba009.xiladd (mgr.34457) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.736588+0000 mgr.gibba009.xiladd (mgr.34457) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.738519+0000 mgr.gibba009.xiladd (mgr.34457) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.738565+0000 mgr.gibba009.xiladd (mgr.34457) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.740181+0000 mgr.gibba009.xiladd (mgr.34457) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.740502+0000 mgr.gibba009.xiladd (mgr.34457) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.742082+0000 mgr.gibba009.xiladd (mgr.34457) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.742126+0000 mgr.gibba009.xiladd (mgr.34457) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:56 gibba009 bash[26136]: cephadm 2021-03-10T20:27:55.742266+0000 mgr.gibba009.xiladd (mgr.34457) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:27:58.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:57 gibba004 bash[30897]: cluster 2021-03-10T20:27:56.762142+0000 mgr.gibba009.xiladd (mgr.34457) 975 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:57 gibba004 bash[31878]: cluster 2021-03-10T20:27:56.762142+0000 mgr.gibba009.xiladd (mgr.34457) 975 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:58.336 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:57 gibba009 bash[26136]: cluster 2021-03-10T20:27:56.762142+0000 mgr.gibba009.xiladd (mgr.34457) 975 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:27:59 gibba004 bash[30897]: cluster 2021-03-10T20:27:58.763690+0000 mgr.gibba009.xiladd (mgr.34457) 976 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:27:59 gibba004 bash[31878]: cluster 2021-03-10T20:27:58.763690+0000 mgr.gibba009.xiladd (mgr.34457) 976 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:00.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:27:59 gibba009 bash[26136]: cluster 2021-03-10T20:27:58.763690+0000 mgr.gibba009.xiladd (mgr.34457) 976 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:01 gibba004 bash[30897]: cluster 2021-03-10T20:28:00.765556+0000 mgr.gibba009.xiladd (mgr.34457) 977 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:01 gibba004 bash[31878]: cluster 2021-03-10T20:28:00.765556+0000 mgr.gibba009.xiladd (mgr.34457) 977 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:02.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:01 gibba009 bash[26136]: cluster 2021-03-10T20:28:00.765556+0000 mgr.gibba009.xiladd (mgr.34457) 977 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:03 gibba004 bash[30897]: cluster 2021-03-10T20:28:02.766926+0000 mgr.gibba009.xiladd (mgr.34457) 978 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:03 gibba004 bash[31878]: cluster 2021-03-10T20:28:02.766926+0000 mgr.gibba009.xiladd (mgr.34457) 978 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:04.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:03 gibba009 bash[26136]: cluster 2021-03-10T20:28:02.766926+0000 mgr.gibba009.xiladd (mgr.34457) 978 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:05 gibba004 bash[30897]: cluster 2021-03-10T20:28:04.768424+0000 mgr.gibba009.xiladd (mgr.34457) 979 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:05 gibba004 bash[31878]: cluster 2021-03-10T20:28:04.768424+0000 mgr.gibba009.xiladd (mgr.34457) 979 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:06.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:05 gibba009 bash[26136]: cluster 2021-03-10T20:28:04.768424+0000 mgr.gibba009.xiladd (mgr.34457) 979 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:07 gibba004 bash[30897]: cluster 2021-03-10T20:28:06.769394+0000 mgr.gibba009.xiladd (mgr.34457) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:07 gibba004 bash[31878]: cluster 2021-03-10T20:28:06.769394+0000 mgr.gibba009.xiladd (mgr.34457) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:07 gibba009 bash[26136]: cluster 2021-03-10T20:28:06.769394+0000 mgr.gibba009.xiladd (mgr.34457) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:09 gibba004 bash[30897]: cluster 2021-03-10T20:28:08.770844+0000 mgr.gibba009.xiladd (mgr.34457) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:09 gibba004 bash[31878]: cluster 2021-03-10T20:28:08.770844+0000 mgr.gibba009.xiladd (mgr.34457) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:09 gibba009 bash[26136]: cluster 2021-03-10T20:28:08.770844+0000 mgr.gibba009.xiladd (mgr.34457) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:12 gibba004 bash[30897]: cephadm 2021-03-10T20:28:10.745618+0000 mgr.gibba009.xiladd (mgr.34457) 982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:12 gibba004 bash[30897]: cluster 2021-03-10T20:28:10.772577+0000 mgr.gibba009.xiladd (mgr.34457) 983 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:12 gibba004 bash[31878]: cephadm 2021-03-10T20:28:10.745618+0000 mgr.gibba009.xiladd (mgr.34457) 982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:12 gibba004 bash[31878]: cluster 2021-03-10T20:28:10.772577+0000 mgr.gibba009.xiladd (mgr.34457) 983 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:12 gibba009 bash[26136]: cephadm 2021-03-10T20:28:10.745618+0000 mgr.gibba009.xiladd (mgr.34457) 982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:12.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:12 gibba009 bash[26136]: cluster 2021-03-10T20:28:10.772577+0000 mgr.gibba009.xiladd (mgr.34457) 983 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:14 gibba004 bash[30897]: cluster 2021-03-10T20:28:12.774242+0000 mgr.gibba009.xiladd (mgr.34457) 984 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:14 gibba004 bash[31878]: cluster 2021-03-10T20:28:12.774242+0000 mgr.gibba009.xiladd (mgr.34457) 984 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:14 gibba009 bash[26136]: cluster 2021-03-10T20:28:12.774242+0000 mgr.gibba009.xiladd (mgr.34457) 984 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:16 gibba004 bash[30897]: cluster 2021-03-10T20:28:14.775713+0000 mgr.gibba009.xiladd (mgr.34457) 985 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:16 gibba004 bash[31878]: cluster 2021-03-10T20:28:14.775713+0000 mgr.gibba009.xiladd (mgr.34457) 985 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:16.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:16 gibba009 bash[26136]: cluster 2021-03-10T20:28:14.775713+0000 mgr.gibba009.xiladd (mgr.34457) 985 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:18 gibba004 bash[30897]: cluster 2021-03-10T20:28:16.776669+0000 mgr.gibba009.xiladd (mgr.34457) 986 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:18 gibba004 bash[31878]: cluster 2021-03-10T20:28:16.776669+0000 mgr.gibba009.xiladd (mgr.34457) 986 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:18 gibba009 bash[26136]: cluster 2021-03-10T20:28:16.776669+0000 mgr.gibba009.xiladd (mgr.34457) 986 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:19.268 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:28:19.497 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:28:19.498 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (17m) 3m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:28:19.498 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:28:19.498 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:28:19.499 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:28:19.499 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:28:19.499 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:28:19.499 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:28:19.499 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:28:19.500 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (22m) 3m ago 22m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:28:19.500 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:28:19.500 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:28:19.500 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:28:19.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:28:19.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:28:19.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:28:19.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:28:19.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:28:19.502 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:28:19.502 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (22m) 2m ago 22m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:28:19.502 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:19.502 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:19.746 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:28:19.746 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:28:19.746 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:19.747 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:19.747 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:28:19.747 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:19.747 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:19.748 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:28:19.748 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:28:19.748 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:19.748 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:28:19.748 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:28:19.749 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:28:19.749 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:28:19.749 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:28:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[30897]: cluster 2021-03-10T20:28:18.777987+0000 mgr.gibba009.xiladd (mgr.34457) 987 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[30897]: audit 2021-03-10T20:28:19.258205+0000 mgr.gibba009.xiladd (mgr.34457) 988 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:20.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[30897]: audit 2021-03-10T20:28:19.746262+0000 mon.c (mon.1) 345 : audit [DBG] from='client.? 172.21.2.104:0/3958604710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[31878]: cluster 2021-03-10T20:28:18.777987+0000 mgr.gibba009.xiladd (mgr.34457) 987 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[31878]: audit 2021-03-10T20:28:19.258205+0000 mgr.gibba009.xiladd (mgr.34457) 988 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:20.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:20 gibba004 bash[31878]: audit 2021-03-10T20:28:19.746262+0000 mon.c (mon.1) 345 : audit [DBG] from='client.? 172.21.2.104:0/3958604710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:20.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:20 gibba009 bash[26136]: cluster 2021-03-10T20:28:18.777987+0000 mgr.gibba009.xiladd (mgr.34457) 987 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:20 gibba009 bash[26136]: audit 2021-03-10T20:28:19.258205+0000 mgr.gibba009.xiladd (mgr.34457) 988 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:20.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:20 gibba009 bash[26136]: audit 2021-03-10T20:28:19.746262+0000 mon.c (mon.1) 345 : audit [DBG] from='client.? 172.21.2.104:0/3958604710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:21.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:21 gibba004 bash[30897]: audit 2021-03-10T20:28:19.484519+0000 mgr.gibba009.xiladd (mgr.34457) 989 : audit [DBG] from='client.54709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:21.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:21 gibba004 bash[31878]: audit 2021-03-10T20:28:19.484519+0000 mgr.gibba009.xiladd (mgr.34457) 989 : audit [DBG] from='client.54709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:21.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:21 gibba009 bash[26136]: audit 2021-03-10T20:28:19.484519+0000 mgr.gibba009.xiladd (mgr.34457) 989 : audit [DBG] from='client.54709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:22 gibba004 bash[30897]: cluster 2021-03-10T20:28:20.779849+0000 mgr.gibba009.xiladd (mgr.34457) 990 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:22 gibba004 bash[31878]: cluster 2021-03-10T20:28:20.779849+0000 mgr.gibba009.xiladd (mgr.34457) 990 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:22.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:22 gibba009 bash[26136]: cluster 2021-03-10T20:28:20.779849+0000 mgr.gibba009.xiladd (mgr.34457) 990 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:24 gibba004 bash[30897]: cluster 2021-03-10T20:28:22.781393+0000 mgr.gibba009.xiladd (mgr.34457) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:24 gibba004 bash[31878]: cluster 2021-03-10T20:28:22.781393+0000 mgr.gibba009.xiladd (mgr.34457) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:24.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:24 gibba009 bash[26136]: cluster 2021-03-10T20:28:22.781393+0000 mgr.gibba009.xiladd (mgr.34457) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:26.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:26 gibba009 bash[26136]: cluster 2021-03-10T20:28:24.782954+0000 mgr.gibba009.xiladd (mgr.34457) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:26 gibba004 bash[30897]: cluster 2021-03-10T20:28:24.782954+0000 mgr.gibba009.xiladd (mgr.34457) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:26 gibba004 bash[31878]: cluster 2021-03-10T20:28:24.782954+0000 mgr.gibba009.xiladd (mgr.34457) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:27.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:27 gibba009 bash[26136]: cephadm 2021-03-10T20:28:25.752991+0000 mgr.gibba009.xiladd (mgr.34457) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:27.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:27 gibba004 bash[30897]: cephadm 2021-03-10T20:28:25.752991+0000 mgr.gibba009.xiladd (mgr.34457) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:27.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:27 gibba004 bash[31878]: cephadm 2021-03-10T20:28:25.752991+0000 mgr.gibba009.xiladd (mgr.34457) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:28 gibba004 bash[30897]: cluster 2021-03-10T20:28:26.784449+0000 mgr.gibba009.xiladd (mgr.34457) 994 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:28 gibba004 bash[31878]: cluster 2021-03-10T20:28:26.784449+0000 mgr.gibba009.xiladd (mgr.34457) 994 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:28.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:28 gibba009 bash[26136]: cluster 2021-03-10T20:28:26.784449+0000 mgr.gibba009.xiladd (mgr.34457) 994 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:30 gibba004 bash[30897]: cluster 2021-03-10T20:28:28.786134+0000 mgr.gibba009.xiladd (mgr.34457) 995 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:30 gibba004 bash[31878]: cluster 2021-03-10T20:28:28.786134+0000 mgr.gibba009.xiladd (mgr.34457) 995 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:30.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:30 gibba009 bash[26136]: cluster 2021-03-10T20:28:28.786134+0000 mgr.gibba009.xiladd (mgr.34457) 995 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:32 gibba004 bash[30897]: cluster 2021-03-10T20:28:30.787795+0000 mgr.gibba009.xiladd (mgr.34457) 996 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:32 gibba004 bash[31878]: cluster 2021-03-10T20:28:30.787795+0000 mgr.gibba009.xiladd (mgr.34457) 996 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:32.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:32 gibba009 bash[26136]: cluster 2021-03-10T20:28:30.787795+0000 mgr.gibba009.xiladd (mgr.34457) 996 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:34 gibba004 bash[30897]: cluster 2021-03-10T20:28:32.789420+0000 mgr.gibba009.xiladd (mgr.34457) 997 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:34 gibba004 bash[31878]: cluster 2021-03-10T20:28:32.789420+0000 mgr.gibba009.xiladd (mgr.34457) 997 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:34.586 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:34 gibba009 bash[26136]: cluster 2021-03-10T20:28:32.789420+0000 mgr.gibba009.xiladd (mgr.34457) 997 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:36 gibba004 bash[30897]: cluster 2021-03-10T20:28:34.791214+0000 mgr.gibba009.xiladd (mgr.34457) 998 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:36 gibba004 bash[31878]: cluster 2021-03-10T20:28:34.791214+0000 mgr.gibba009.xiladd (mgr.34457) 998 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:36.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:36 gibba009 bash[26136]: cluster 2021-03-10T20:28:34.791214+0000 mgr.gibba009.xiladd (mgr.34457) 998 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:38 gibba004 bash[30897]: cluster 2021-03-10T20:28:36.792185+0000 mgr.gibba009.xiladd (mgr.34457) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:38 gibba004 bash[31878]: cluster 2021-03-10T20:28:36.792185+0000 mgr.gibba009.xiladd (mgr.34457) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:38.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:38 gibba009 bash[26136]: cluster 2021-03-10T20:28:36.792185+0000 mgr.gibba009.xiladd (mgr.34457) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: cluster 2021-03-10T20:28:38.793774+0000 mgr.gibba009.xiladd (mgr.34457) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.612521+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.613223+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.613783+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.613882+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.614583+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.616388+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.617614+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.618603+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.675483+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.675746+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.676245+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[30897]: audit 2021-03-10T20:28:39.676814+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: cluster 2021-03-10T20:28:38.793774+0000 mgr.gibba009.xiladd (mgr.34457) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.612521+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.613223+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.613783+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.613882+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.614583+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.616388+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.617614+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.618603+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.675483+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.675746+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.676245+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:40 gibba004 bash[31878]: audit 2021-03-10T20:28:39.676814+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: cluster 2021-03-10T20:28:38.793774+0000 mgr.gibba009.xiladd (mgr.34457) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.612521+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.613223+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.613783+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.613882+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.614583+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.616388+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:28:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.617614+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.618603+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:28:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.675483+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.675746+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.676245+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:40 gibba009 bash[26136]: audit 2021-03-10T20:28:39.676814+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:42 gibba004 bash[30897]: cephadm 2021-03-10T20:28:40.754281+0000 mgr.gibba009.xiladd (mgr.34457) 1001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:42 gibba004 bash[30897]: cluster 2021-03-10T20:28:40.795631+0000 mgr.gibba009.xiladd (mgr.34457) 1002 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:42 gibba004 bash[31878]: cephadm 2021-03-10T20:28:40.754281+0000 mgr.gibba009.xiladd (mgr.34457) 1001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:42 gibba004 bash[31878]: cluster 2021-03-10T20:28:40.795631+0000 mgr.gibba009.xiladd (mgr.34457) 1002 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:42.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:42 gibba009 bash[26136]: cephadm 2021-03-10T20:28:40.754281+0000 mgr.gibba009.xiladd (mgr.34457) 1001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:42 gibba009 bash[26136]: cluster 2021-03-10T20:28:40.795631+0000 mgr.gibba009.xiladd (mgr.34457) 1002 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:44 gibba004 bash[30897]: cluster 2021-03-10T20:28:42.797296+0000 mgr.gibba009.xiladd (mgr.34457) 1003 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:44 gibba004 bash[31878]: cluster 2021-03-10T20:28:42.797296+0000 mgr.gibba009.xiladd (mgr.34457) 1003 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:44.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:44 gibba009 bash[26136]: cluster 2021-03-10T20:28:42.797296+0000 mgr.gibba009.xiladd (mgr.34457) 1003 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:46 gibba004 bash[30897]: cluster 2021-03-10T20:28:44.798830+0000 mgr.gibba009.xiladd (mgr.34457) 1004 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:46 gibba004 bash[31878]: cluster 2021-03-10T20:28:44.798830+0000 mgr.gibba009.xiladd (mgr.34457) 1004 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:46.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:46 gibba009 bash[26136]: cluster 2021-03-10T20:28:44.798830+0000 mgr.gibba009.xiladd (mgr.34457) 1004 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:48 gibba004 bash[30897]: cluster 2021-03-10T20:28:46.799869+0000 mgr.gibba009.xiladd (mgr.34457) 1005 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:48 gibba004 bash[31878]: cluster 2021-03-10T20:28:46.799869+0000 mgr.gibba009.xiladd (mgr.34457) 1005 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:48.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:48 gibba009 bash[26136]: cluster 2021-03-10T20:28:46.799869+0000 mgr.gibba009.xiladd (mgr.34457) 1005 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:49.987 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:28:50.211 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:28:50.211 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (17m) 3m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:28:50.212 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:28:50.212 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:28:50.212 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:28:50.212 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:28:50.213 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:28:50.213 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:28:50.213 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:28:50.213 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:28:50.213 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (23m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:28:50.214 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:28:50.214 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:28:50.214 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:28:50.214 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:28:50.215 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:28:50.215 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:28:50.215 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:28:50.216 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:28:50.216 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:28:50.216 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:50.216 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:50.466 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:28:50.466 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:28:50.466 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:50.467 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:50.467 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:28:50.467 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:50.467 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:50.467 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:28:50.468 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:28:50.468 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:28:50.468 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:28:50.468 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:28:50.469 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:28:50.469 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:28:50.469 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:28:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:50 gibba004 bash[30897]: cluster 2021-03-10T20:28:48.801551+0000 mgr.gibba009.xiladd (mgr.34457) 1006 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:50.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:50 gibba004 bash[31878]: cluster 2021-03-10T20:28:48.801551+0000 mgr.gibba009.xiladd (mgr.34457) 1006 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:50.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:50 gibba009 bash[26136]: cluster 2021-03-10T20:28:48.801551+0000 mgr.gibba009.xiladd (mgr.34457) 1006 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:51.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[30897]: audit 2021-03-10T20:28:49.977851+0000 mgr.gibba009.xiladd (mgr.34457) 1007 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[30897]: audit 2021-03-10T20:28:50.201450+0000 mgr.gibba009.xiladd (mgr.34457) 1008 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[30897]: audit 2021-03-10T20:28:50.465298+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.2.104:0/1120083801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:51.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[31878]: audit 2021-03-10T20:28:49.977851+0000 mgr.gibba009.xiladd (mgr.34457) 1007 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[31878]: audit 2021-03-10T20:28:50.201450+0000 mgr.gibba009.xiladd (mgr.34457) 1008 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:51 gibba004 bash[31878]: audit 2021-03-10T20:28:50.465298+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.2.104:0/1120083801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:51.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:51 gibba009 bash[26136]: audit 2021-03-10T20:28:49.977851+0000 mgr.gibba009.xiladd (mgr.34457) 1007 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:51 gibba009 bash[26136]: audit 2021-03-10T20:28:50.201450+0000 mgr.gibba009.xiladd (mgr.34457) 1008 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:51.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:51 gibba009 bash[26136]: audit 2021-03-10T20:28:50.465298+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.2.104:0/1120083801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:52 gibba004 bash[30897]: cluster 2021-03-10T20:28:50.803293+0000 mgr.gibba009.xiladd (mgr.34457) 1009 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:52 gibba004 bash[31878]: cluster 2021-03-10T20:28:50.803293+0000 mgr.gibba009.xiladd (mgr.34457) 1009 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:52 gibba009 bash[26136]: cluster 2021-03-10T20:28:50.803293+0000 mgr.gibba009.xiladd (mgr.34457) 1009 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:54 gibba004 bash[30897]: cluster 2021-03-10T20:28:52.805014+0000 mgr.gibba009.xiladd (mgr.34457) 1010 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:54 gibba004 bash[31878]: cluster 2021-03-10T20:28:52.805014+0000 mgr.gibba009.xiladd (mgr.34457) 1010 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:54.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:54 gibba009 bash[26136]: cluster 2021-03-10T20:28:52.805014+0000 mgr.gibba009.xiladd (mgr.34457) 1010 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:56.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: cluster 2021-03-10T20:28:54.806523+0000 mgr.gibba009.xiladd (mgr.34457) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:55.771864+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:55.997205+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:28:56.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.001391+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.003268+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.005095+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.006395+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.009842+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:56 gibba009 bash[26136]: audit 2021-03-10T20:28:56.011286+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: cluster 2021-03-10T20:28:54.806523+0000 mgr.gibba009.xiladd (mgr.34457) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:55.771864+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:55.997205+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:28:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.001391+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.003268+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.005095+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.006395+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.009842+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[30897]: audit 2021-03-10T20:28:56.011286+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: cluster 2021-03-10T20:28:54.806523+0000 mgr.gibba009.xiladd (mgr.34457) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:55.771864+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:55.997205+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:28:56.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.001391+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.003268+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.005095+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.006395+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.009842+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:56.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:56 gibba004 bash[31878]: audit 2021-03-10T20:28:56.011286+0000 mon.c (mon.1) 358 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:55.776679+0000 mgr.gibba009.xiladd (mgr.34457) 1012 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:28:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:55.778381+0000 mgr.gibba009.xiladd (mgr.34457) 1013 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:28:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.000040+0000 mgr.gibba009.xiladd (mgr.34457) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.002119+0000 mgr.gibba009.xiladd (mgr.34457) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.003908+0000 mgr.gibba009.xiladd (mgr.34457) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.003949+0000 mgr.gibba009.xiladd (mgr.34457) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.005220+0000 mgr.gibba009.xiladd (mgr.34457) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.005260+0000 mgr.gibba009.xiladd (mgr.34457) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.006817+0000 mgr.gibba009.xiladd (mgr.34457) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.008523+0000 mgr.gibba009.xiladd (mgr.34457) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.008560+0000 mgr.gibba009.xiladd (mgr.34457) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.010041+0000 mgr.gibba009.xiladd (mgr.34457) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.010352+0000 mgr.gibba009.xiladd (mgr.34457) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.011334+0000 mgr.gibba009.xiladd (mgr.34457) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.011372+0000 mgr.gibba009.xiladd (mgr.34457) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[30897]: cephadm 2021-03-10T20:28:56.011497+0000 mgr.gibba009.xiladd (mgr.34457) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:55.776679+0000 mgr.gibba009.xiladd (mgr.34457) 1012 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:28:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:55.778381+0000 mgr.gibba009.xiladd (mgr.34457) 1013 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:28:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.000040+0000 mgr.gibba009.xiladd (mgr.34457) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.002119+0000 mgr.gibba009.xiladd (mgr.34457) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.003908+0000 mgr.gibba009.xiladd (mgr.34457) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.003949+0000 mgr.gibba009.xiladd (mgr.34457) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.005220+0000 mgr.gibba009.xiladd (mgr.34457) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:57.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.005260+0000 mgr.gibba009.xiladd (mgr.34457) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.006817+0000 mgr.gibba009.xiladd (mgr.34457) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.008523+0000 mgr.gibba009.xiladd (mgr.34457) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.008560+0000 mgr.gibba009.xiladd (mgr.34457) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.010041+0000 mgr.gibba009.xiladd (mgr.34457) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:57.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.010352+0000 mgr.gibba009.xiladd (mgr.34457) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:57.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.011334+0000 mgr.gibba009.xiladd (mgr.34457) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:57.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.011372+0000 mgr.gibba009.xiladd (mgr.34457) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:57.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:57 gibba004 bash[31878]: cephadm 2021-03-10T20:28:56.011497+0000 mgr.gibba009.xiladd (mgr.34457) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:55.776679+0000 mgr.gibba009.xiladd (mgr.34457) 1012 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:28:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:55.778381+0000 mgr.gibba009.xiladd (mgr.34457) 1013 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:28:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.000040+0000 mgr.gibba009.xiladd (mgr.34457) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.002119+0000 mgr.gibba009.xiladd (mgr.34457) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.003908+0000 mgr.gibba009.xiladd (mgr.34457) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.003949+0000 mgr.gibba009.xiladd (mgr.34457) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.005220+0000 mgr.gibba009.xiladd (mgr.34457) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.005260+0000 mgr.gibba009.xiladd (mgr.34457) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.006817+0000 mgr.gibba009.xiladd (mgr.34457) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.008523+0000 mgr.gibba009.xiladd (mgr.34457) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.008560+0000 mgr.gibba009.xiladd (mgr.34457) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.010041+0000 mgr.gibba009.xiladd (mgr.34457) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.010352+0000 mgr.gibba009.xiladd (mgr.34457) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.011334+0000 mgr.gibba009.xiladd (mgr.34457) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.011372+0000 mgr.gibba009.xiladd (mgr.34457) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:57 gibba009 bash[26136]: cephadm 2021-03-10T20:28:56.011497+0000 mgr.gibba009.xiladd (mgr.34457) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:28:58.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:28:58 gibba004 bash[30897]: cluster 2021-03-10T20:28:56.807490+0000 mgr.gibba009.xiladd (mgr.34457) 1028 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:58.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:28:58 gibba004 bash[31878]: cluster 2021-03-10T20:28:56.807490+0000 mgr.gibba009.xiladd (mgr.34457) 1028 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:58.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:28:58 gibba009 bash[26136]: cluster 2021-03-10T20:28:56.807490+0000 mgr.gibba009.xiladd (mgr.34457) 1028 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:00 gibba004 bash[30897]: cluster 2021-03-10T20:28:58.809068+0000 mgr.gibba009.xiladd (mgr.34457) 1029 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:00 gibba004 bash[31878]: cluster 2021-03-10T20:28:58.809068+0000 mgr.gibba009.xiladd (mgr.34457) 1029 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:00.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:00 gibba009 bash[26136]: cluster 2021-03-10T20:28:58.809068+0000 mgr.gibba009.xiladd (mgr.34457) 1029 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:02 gibba004 bash[30897]: cluster 2021-03-10T20:29:00.810865+0000 mgr.gibba009.xiladd (mgr.34457) 1030 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:02 gibba004 bash[31878]: cluster 2021-03-10T20:29:00.810865+0000 mgr.gibba009.xiladd (mgr.34457) 1030 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:02.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:02 gibba009 bash[26136]: cluster 2021-03-10T20:29:00.810865+0000 mgr.gibba009.xiladd (mgr.34457) 1030 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:04 gibba004 bash[30897]: cluster 2021-03-10T20:29:02.812468+0000 mgr.gibba009.xiladd (mgr.34457) 1031 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:04 gibba004 bash[31878]: cluster 2021-03-10T20:29:02.812468+0000 mgr.gibba009.xiladd (mgr.34457) 1031 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:04.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:04 gibba009 bash[26136]: cluster 2021-03-10T20:29:02.812468+0000 mgr.gibba009.xiladd (mgr.34457) 1031 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:06 gibba004 bash[30897]: cluster 2021-03-10T20:29:04.813929+0000 mgr.gibba009.xiladd (mgr.34457) 1032 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:06 gibba004 bash[31878]: cluster 2021-03-10T20:29:04.813929+0000 mgr.gibba009.xiladd (mgr.34457) 1032 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:06.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:06 gibba009 bash[26136]: cluster 2021-03-10T20:29:04.813929+0000 mgr.gibba009.xiladd (mgr.34457) 1032 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:08 gibba004 bash[30897]: cluster 2021-03-10T20:29:06.815475+0000 mgr.gibba009.xiladd (mgr.34457) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:08 gibba004 bash[31878]: cluster 2021-03-10T20:29:06.815475+0000 mgr.gibba009.xiladd (mgr.34457) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:08.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:08 gibba009 bash[26136]: cluster 2021-03-10T20:29:06.815475+0000 mgr.gibba009.xiladd (mgr.34457) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:10 gibba004 bash[30897]: cluster 2021-03-10T20:29:08.817191+0000 mgr.gibba009.xiladd (mgr.34457) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:10 gibba004 bash[31878]: cluster 2021-03-10T20:29:08.817191+0000 mgr.gibba009.xiladd (mgr.34457) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:10.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:10 gibba009 bash[26136]: cluster 2021-03-10T20:29:08.817191+0000 mgr.gibba009.xiladd (mgr.34457) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:12 gibba004 bash[30897]: cluster 2021-03-10T20:29:10.818881+0000 mgr.gibba009.xiladd (mgr.34457) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:12 gibba004 bash[30897]: cephadm 2021-03-10T20:29:11.023152+0000 mgr.gibba009.xiladd (mgr.34457) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:12 gibba004 bash[31878]: cluster 2021-03-10T20:29:10.818881+0000 mgr.gibba009.xiladd (mgr.34457) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:12 gibba004 bash[31878]: cephadm 2021-03-10T20:29:11.023152+0000 mgr.gibba009.xiladd (mgr.34457) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:12.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:12 gibba009 bash[26136]: cluster 2021-03-10T20:29:10.818881+0000 mgr.gibba009.xiladd (mgr.34457) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:12 gibba009 bash[26136]: cephadm 2021-03-10T20:29:11.023152+0000 mgr.gibba009.xiladd (mgr.34457) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:14 gibba004 bash[30897]: cluster 2021-03-10T20:29:12.820394+0000 mgr.gibba009.xiladd (mgr.34457) 1037 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:14 gibba004 bash[31878]: cluster 2021-03-10T20:29:12.820394+0000 mgr.gibba009.xiladd (mgr.34457) 1037 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:14.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:14 gibba009 bash[26136]: cluster 2021-03-10T20:29:12.820394+0000 mgr.gibba009.xiladd (mgr.34457) 1037 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:15 gibba004 bash[30897]: cluster 2021-03-10T20:29:14.822068+0000 mgr.gibba009.xiladd (mgr.34457) 1038 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:15 gibba004 bash[31878]: cluster 2021-03-10T20:29:14.822068+0000 mgr.gibba009.xiladd (mgr.34457) 1038 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:15 gibba009 bash[26136]: cluster 2021-03-10T20:29:14.822068+0000 mgr.gibba009.xiladd (mgr.34457) 1038 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:17 gibba004 bash[30897]: cluster 2021-03-10T20:29:16.823393+0000 mgr.gibba009.xiladd (mgr.34457) 1039 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:17 gibba004 bash[31878]: cluster 2021-03-10T20:29:16.823393+0000 mgr.gibba009.xiladd (mgr.34457) 1039 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:18.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:17 gibba009 bash[26136]: cluster 2021-03-10T20:29:16.823393+0000 mgr.gibba009.xiladd (mgr.34457) 1039 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:19 gibba004 bash[30897]: cluster 2021-03-10T20:29:18.825055+0000 mgr.gibba009.xiladd (mgr.34457) 1040 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:19 gibba004 bash[31878]: cluster 2021-03-10T20:29:18.825055+0000 mgr.gibba009.xiladd (mgr.34457) 1040 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:20.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:19 gibba009 bash[26136]: cluster 2021-03-10T20:29:18.825055+0000 mgr.gibba009.xiladd (mgr.34457) 1040 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:20.707 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:29:20.937 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:29:20.938 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (18m) 4m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:29:20.938 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:29:20.938 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:29:20.938 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:29:20.939 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:29:20.939 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:29:20.939 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:29:20.939 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:29:20.939 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (23m) 4m ago 23m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:29:20.940 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:29:20.940 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:29:20.940 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:29:20.940 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:29:20.941 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:29:20.941 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:29:20.941 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:29:20.941 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:29:20.941 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:29:20.942 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (23m) 3m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:29:20.942 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:20.942 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:21.186 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:29:21.187 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:29:21.187 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:21.187 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:21.187 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:29:21.188 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:21.188 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:21.188 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:29:21.188 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:29:21.189 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:21.189 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:29:21.189 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:29:21.189 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:29:21.189 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:29:21.190 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:29:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[30897]: audit 2021-03-10T20:29:20.698119+0000 mgr.gibba009.xiladd (mgr.34457) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[30897]: cluster 2021-03-10T20:29:20.826834+0000 mgr.gibba009.xiladd (mgr.34457) 1042 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[30897]: audit 2021-03-10T20:29:20.923733+0000 mgr.gibba009.xiladd (mgr.34457) 1043 : audit [DBG] from='client.44766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[30897]: audit 2021-03-10T20:29:21.186743+0000 mon.a (mon.0) 692 : audit [DBG] from='client.? 172.21.2.104:0/673411447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:22.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[31878]: audit 2021-03-10T20:29:20.698119+0000 mgr.gibba009.xiladd (mgr.34457) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[31878]: cluster 2021-03-10T20:29:20.826834+0000 mgr.gibba009.xiladd (mgr.34457) 1042 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:22.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[31878]: audit 2021-03-10T20:29:20.923733+0000 mgr.gibba009.xiladd (mgr.34457) 1043 : audit [DBG] from='client.44766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:21 gibba004 bash[31878]: audit 2021-03-10T20:29:21.186743+0000 mon.a (mon.0) 692 : audit [DBG] from='client.? 172.21.2.104:0/673411447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:22.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:21 gibba009 bash[26136]: audit 2021-03-10T20:29:20.698119+0000 mgr.gibba009.xiladd (mgr.34457) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:21 gibba009 bash[26136]: cluster 2021-03-10T20:29:20.826834+0000 mgr.gibba009.xiladd (mgr.34457) 1042 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:22.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:21 gibba009 bash[26136]: audit 2021-03-10T20:29:20.923733+0000 mgr.gibba009.xiladd (mgr.34457) 1043 : audit [DBG] from='client.44766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:22.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:21 gibba009 bash[26136]: audit 2021-03-10T20:29:21.186743+0000 mon.a (mon.0) 692 : audit [DBG] from='client.? 172.21.2.104:0/673411447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:23 gibba004 bash[30897]: cluster 2021-03-10T20:29:22.828472+0000 mgr.gibba009.xiladd (mgr.34457) 1044 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:23 gibba004 bash[31878]: cluster 2021-03-10T20:29:22.828472+0000 mgr.gibba009.xiladd (mgr.34457) 1044 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:24.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:23 gibba009 bash[26136]: cluster 2021-03-10T20:29:22.828472+0000 mgr.gibba009.xiladd (mgr.34457) 1044 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:25 gibba004 bash[30897]: cluster 2021-03-10T20:29:24.829968+0000 mgr.gibba009.xiladd (mgr.34457) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:25 gibba004 bash[31878]: cluster 2021-03-10T20:29:24.829968+0000 mgr.gibba009.xiladd (mgr.34457) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:26.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:25 gibba009 bash[26136]: cluster 2021-03-10T20:29:24.829968+0000 mgr.gibba009.xiladd (mgr.34457) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:27.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:26 gibba004 bash[30897]: cephadm 2021-03-10T20:29:26.039241+0000 mgr.gibba009.xiladd (mgr.34457) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:27.312 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:26 gibba004 bash[31878]: cephadm 2021-03-10T20:29:26.039241+0000 mgr.gibba009.xiladd (mgr.34457) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:27.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:26 gibba009 bash[26136]: cephadm 2021-03-10T20:29:26.039241+0000 mgr.gibba009.xiladd (mgr.34457) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:27 gibba004 bash[30897]: cluster 2021-03-10T20:29:26.831097+0000 mgr.gibba009.xiladd (mgr.34457) 1047 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:27 gibba004 bash[31878]: cluster 2021-03-10T20:29:26.831097+0000 mgr.gibba009.xiladd (mgr.34457) 1047 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:28.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:27 gibba009 bash[26136]: cluster 2021-03-10T20:29:26.831097+0000 mgr.gibba009.xiladd (mgr.34457) 1047 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:30.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:29 gibba004 bash[30897]: cluster 2021-03-10T20:29:28.832635+0000 mgr.gibba009.xiladd (mgr.34457) 1048 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:30.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:29 gibba004 bash[31878]: cluster 2021-03-10T20:29:28.832635+0000 mgr.gibba009.xiladd (mgr.34457) 1048 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:30.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:29 gibba009 bash[26136]: cluster 2021-03-10T20:29:28.832635+0000 mgr.gibba009.xiladd (mgr.34457) 1048 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:31 gibba004 bash[30897]: cluster 2021-03-10T20:29:30.834242+0000 mgr.gibba009.xiladd (mgr.34457) 1049 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:31 gibba004 bash[31878]: cluster 2021-03-10T20:29:30.834242+0000 mgr.gibba009.xiladd (mgr.34457) 1049 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:32.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:31 gibba009 bash[26136]: cluster 2021-03-10T20:29:30.834242+0000 mgr.gibba009.xiladd (mgr.34457) 1049 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:34 gibba004 bash[30897]: cluster 2021-03-10T20:29:32.835808+0000 mgr.gibba009.xiladd (mgr.34457) 1050 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:34 gibba004 bash[31878]: cluster 2021-03-10T20:29:32.835808+0000 mgr.gibba009.xiladd (mgr.34457) 1050 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:34.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:34 gibba009 bash[26136]: cluster 2021-03-10T20:29:32.835808+0000 mgr.gibba009.xiladd (mgr.34457) 1050 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:36.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:36 gibba004 bash[30897]: cluster 2021-03-10T20:29:34.837583+0000 mgr.gibba009.xiladd (mgr.34457) 1051 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:36 gibba004 bash[31878]: cluster 2021-03-10T20:29:34.837583+0000 mgr.gibba009.xiladd (mgr.34457) 1051 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:36.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:36 gibba009 bash[26136]: cluster 2021-03-10T20:29:34.837583+0000 mgr.gibba009.xiladd (mgr.34457) 1051 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:38 gibba004 bash[30897]: cluster 2021-03-10T20:29:36.838788+0000 mgr.gibba009.xiladd (mgr.34457) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:38 gibba004 bash[31878]: cluster 2021-03-10T20:29:36.838788+0000 mgr.gibba009.xiladd (mgr.34457) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:38.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:38 gibba009 bash[26136]: cluster 2021-03-10T20:29:36.838788+0000 mgr.gibba009.xiladd (mgr.34457) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: cluster 2021-03-10T20:29:38.840407+0000 mgr.gibba009.xiladd (mgr.34457) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.624308+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.625020+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.625620+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.626163+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.627613+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.628167+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.629335+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.629539+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.682981+0000 mon.c (mon.1) 363 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.683247+0000 mon.c (mon.1) 364 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.683505+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[30897]: audit 2021-03-10T20:29:39.684009+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: cluster 2021-03-10T20:29:38.840407+0000 mgr.gibba009.xiladd (mgr.34457) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.624308+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.625020+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.625620+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.626163+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.627613+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.628167+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.629335+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.629539+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.682981+0000 mon.c (mon.1) 363 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.683247+0000 mon.c (mon.1) 364 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.683505+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:40 gibba004 bash[31878]: audit 2021-03-10T20:29:39.684009+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: cluster 2021-03-10T20:29:38.840407+0000 mgr.gibba009.xiladd (mgr.34457) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.624308+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.625020+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.625620+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:29:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.626163+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.627613+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.628167+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.629335+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:29:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.629539+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:29:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.682981+0000 mon.c (mon.1) 363 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.683247+0000 mon.c (mon.1) 364 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.683505+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:40 gibba009 bash[26136]: audit 2021-03-10T20:29:39.684009+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:42 gibba004 bash[30897]: cluster 2021-03-10T20:29:40.842057+0000 mgr.gibba009.xiladd (mgr.34457) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:42 gibba004 bash[30897]: cephadm 2021-03-10T20:29:41.055337+0000 mgr.gibba009.xiladd (mgr.34457) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:42 gibba004 bash[31878]: cluster 2021-03-10T20:29:40.842057+0000 mgr.gibba009.xiladd (mgr.34457) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:42 gibba004 bash[31878]: cephadm 2021-03-10T20:29:41.055337+0000 mgr.gibba009.xiladd (mgr.34457) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:42.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:42 gibba009 bash[26136]: cluster 2021-03-10T20:29:40.842057+0000 mgr.gibba009.xiladd (mgr.34457) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:42.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:42 gibba009 bash[26136]: cephadm 2021-03-10T20:29:41.055337+0000 mgr.gibba009.xiladd (mgr.34457) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:44.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:44 gibba004 bash[30897]: cluster 2021-03-10T20:29:42.843723+0000 mgr.gibba009.xiladd (mgr.34457) 1056 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:44.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:44 gibba004 bash[31878]: cluster 2021-03-10T20:29:42.843723+0000 mgr.gibba009.xiladd (mgr.34457) 1056 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:44.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:44 gibba009 bash[26136]: cluster 2021-03-10T20:29:42.843723+0000 mgr.gibba009.xiladd (mgr.34457) 1056 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:46 gibba004 bash[30897]: cluster 2021-03-10T20:29:44.845306+0000 mgr.gibba009.xiladd (mgr.34457) 1057 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.374 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:46 gibba004 bash[31878]: cluster 2021-03-10T20:29:44.845306+0000 mgr.gibba009.xiladd (mgr.34457) 1057 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.375 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:46 gibba009 bash[26136]: cluster 2021-03-10T20:29:44.845306+0000 mgr.gibba009.xiladd (mgr.34457) 1057 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:48.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:48 gibba009 bash[26136]: cluster 2021-03-10T20:29:46.846781+0000 mgr.gibba009.xiladd (mgr.34457) 1058 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:48 gibba004 bash[30897]: cluster 2021-03-10T20:29:46.846781+0000 mgr.gibba009.xiladd (mgr.34457) 1058 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:48 gibba004 bash[31878]: cluster 2021-03-10T20:29:46.846781+0000 mgr.gibba009.xiladd (mgr.34457) 1058 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:50.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:50 gibba009 bash[26136]: cluster 2021-03-10T20:29:48.848688+0000 mgr.gibba009.xiladd (mgr.34457) 1059 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:50.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:50 gibba004 bash[30897]: cluster 2021-03-10T20:29:48.848688+0000 mgr.gibba009.xiladd (mgr.34457) 1059 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:50.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:50 gibba004 bash[31878]: cluster 2021-03-10T20:29:48.848688+0000 mgr.gibba009.xiladd (mgr.34457) 1059 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:51.427 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:29:51.657 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:29:51.658 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (18m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:29:51.658 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:29:51.658 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:29:51.659 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:29:51.659 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:29:51.659 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:29:51.659 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:29:51.659 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:29:51.660 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (24m) 5m ago 24m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:29:51.660 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:29:51.660 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:29:51.660 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:29:51.660 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:29:51.661 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:29:51.661 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:29:51.661 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:29:51.662 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:29:51.662 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:29:51.662 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:29:51.662 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:51.663 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:51.915 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:29:51.916 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:29:51.916 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:51.916 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:51.916 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:29:51.917 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:51.917 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:51.917 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:29:51.917 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:29:51.918 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:29:51.918 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:29:51.918 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:29:51.918 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:29:51.918 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:29:51.919 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:29:52.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:52 gibba009 bash[26136]: cluster 2021-03-10T20:29:50.850204+0000 mgr.gibba009.xiladd (mgr.34457) 1060 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:52 gibba009 bash[26136]: audit 2021-03-10T20:29:51.914500+0000 mon.a (mon.0) 699 : audit [DBG] from='client.? 172.21.2.104:0/317390458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:52 gibba004 bash[30897]: cluster 2021-03-10T20:29:50.850204+0000 mgr.gibba009.xiladd (mgr.34457) 1060 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:52 gibba004 bash[30897]: audit 2021-03-10T20:29:51.914500+0000 mon.a (mon.0) 699 : audit [DBG] from='client.? 172.21.2.104:0/317390458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:52 gibba004 bash[31878]: cluster 2021-03-10T20:29:50.850204+0000 mgr.gibba009.xiladd (mgr.34457) 1060 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:52 gibba004 bash[31878]: audit 2021-03-10T20:29:51.914500+0000 mon.a (mon.0) 699 : audit [DBG] from='client.? 172.21.2.104:0/317390458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:53.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:53 gibba004 bash[30897]: audit 2021-03-10T20:29:51.417966+0000 mgr.gibba009.xiladd (mgr.34457) 1061 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:53.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:53 gibba004 bash[30897]: audit 2021-03-10T20:29:51.644138+0000 mgr.gibba009.xiladd (mgr.34457) 1062 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:53.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:53 gibba004 bash[31878]: audit 2021-03-10T20:29:51.417966+0000 mgr.gibba009.xiladd (mgr.34457) 1061 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:53.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:53 gibba004 bash[31878]: audit 2021-03-10T20:29:51.644138+0000 mgr.gibba009.xiladd (mgr.34457) 1062 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:53.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:53 gibba009 bash[26136]: audit 2021-03-10T20:29:51.417966+0000 mgr.gibba009.xiladd (mgr.34457) 1061 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:53.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:53 gibba009 bash[26136]: audit 2021-03-10T20:29:51.644138+0000 mgr.gibba009.xiladd (mgr.34457) 1062 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:54 gibba004 bash[30897]: cluster 2021-03-10T20:29:52.851868+0000 mgr.gibba009.xiladd (mgr.34457) 1063 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:54 gibba004 bash[31878]: cluster 2021-03-10T20:29:52.851868+0000 mgr.gibba009.xiladd (mgr.34457) 1063 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:54.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:54 gibba009 bash[26136]: cluster 2021-03-10T20:29:52.851868+0000 mgr.gibba009.xiladd (mgr.34457) 1063 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:56 gibba004 bash[30897]: cluster 2021-03-10T20:29:54.853394+0000 mgr.gibba009.xiladd (mgr.34457) 1064 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:56 gibba004 bash[30897]: audit 2021-03-10T20:29:56.072899+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:56 gibba004 bash[31878]: cluster 2021-03-10T20:29:54.853394+0000 mgr.gibba009.xiladd (mgr.34457) 1064 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:56 gibba004 bash[31878]: audit 2021-03-10T20:29:56.072899+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:56 gibba009 bash[26136]: cluster 2021-03-10T20:29:54.853394+0000 mgr.gibba009.xiladd (mgr.34457) 1064 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:56 gibba009 bash[26136]: audit 2021-03-10T20:29:56.072899+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.077344+0000 mgr.gibba009.xiladd (mgr.34457) 1065 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:29:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.079488+0000 mgr.gibba009.xiladd (mgr.34457) 1066 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:29:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.301792+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:29:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.304055+0000 mgr.gibba009.xiladd (mgr.34457) 1067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.305603+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.306398+0000 mgr.gibba009.xiladd (mgr.34457) 1068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.307710+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.307857+0000 mgr.gibba009.xiladd (mgr.34457) 1069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.307899+0000 mgr.gibba009.xiladd (mgr.34457) 1070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.309029+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.309031+0000 mgr.gibba009.xiladd (mgr.34457) 1071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.309068+0000 mgr.gibba009.xiladd (mgr.34457) 1072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.310242+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.310358+0000 mgr.gibba009.xiladd (mgr.34457) 1073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.312194+0000 mgr.gibba009.xiladd (mgr.34457) 1074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.312240+0000 mgr.gibba009.xiladd (mgr.34457) 1075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.313556+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.313884+0000 mgr.gibba009.xiladd (mgr.34457) 1076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.314282+0000 mgr.gibba009.xiladd (mgr.34457) 1077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.315447+0000 mgr.gibba009.xiladd (mgr.34457) 1078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.315485+0000 mgr.gibba009.xiladd (mgr.34457) 1079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: audit 2021-03-10T20:29:56.315500+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:57 gibba009 bash[26136]: cephadm 2021-03-10T20:29:56.315615+0000 mgr.gibba009.xiladd (mgr.34457) 1080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.077344+0000 mgr.gibba009.xiladd (mgr.34457) 1065 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:29:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.079488+0000 mgr.gibba009.xiladd (mgr.34457) 1066 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:29:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.301792+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:29:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.304055+0000 mgr.gibba009.xiladd (mgr.34457) 1067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.305603+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.306398+0000 mgr.gibba009.xiladd (mgr.34457) 1068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.307710+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.307857+0000 mgr.gibba009.xiladd (mgr.34457) 1069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.307899+0000 mgr.gibba009.xiladd (mgr.34457) 1070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.309029+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.309031+0000 mgr.gibba009.xiladd (mgr.34457) 1071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.309068+0000 mgr.gibba009.xiladd (mgr.34457) 1072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.310242+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.310358+0000 mgr.gibba009.xiladd (mgr.34457) 1073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.312194+0000 mgr.gibba009.xiladd (mgr.34457) 1074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.312240+0000 mgr.gibba009.xiladd (mgr.34457) 1075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.313556+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.313884+0000 mgr.gibba009.xiladd (mgr.34457) 1076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.314282+0000 mgr.gibba009.xiladd (mgr.34457) 1077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.315447+0000 mgr.gibba009.xiladd (mgr.34457) 1078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.315485+0000 mgr.gibba009.xiladd (mgr.34457) 1079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: audit 2021-03-10T20:29:56.315500+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[30897]: cephadm 2021-03-10T20:29:56.315615+0000 mgr.gibba009.xiladd (mgr.34457) 1080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:57.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.077344+0000 mgr.gibba009.xiladd (mgr.34457) 1065 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:29:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.079488+0000 mgr.gibba009.xiladd (mgr.34457) 1066 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:29:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.301792+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:29:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.304055+0000 mgr.gibba009.xiladd (mgr.34457) 1067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.305603+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.306398+0000 mgr.gibba009.xiladd (mgr.34457) 1068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.307710+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.307857+0000 mgr.gibba009.xiladd (mgr.34457) 1069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.307899+0000 mgr.gibba009.xiladd (mgr.34457) 1070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.309029+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.309031+0000 mgr.gibba009.xiladd (mgr.34457) 1071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.309068+0000 mgr.gibba009.xiladd (mgr.34457) 1072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.310242+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.310358+0000 mgr.gibba009.xiladd (mgr.34457) 1073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.312194+0000 mgr.gibba009.xiladd (mgr.34457) 1074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.312240+0000 mgr.gibba009.xiladd (mgr.34457) 1075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.313556+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.313884+0000 mgr.gibba009.xiladd (mgr.34457) 1076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.314282+0000 mgr.gibba009.xiladd (mgr.34457) 1077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.315447+0000 mgr.gibba009.xiladd (mgr.34457) 1078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.315485+0000 mgr.gibba009.xiladd (mgr.34457) 1079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: audit 2021-03-10T20:29:56.315500+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:57 gibba004 bash[31878]: cephadm 2021-03-10T20:29:56.315615+0000 mgr.gibba009.xiladd (mgr.34457) 1080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:29:58.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:29:58 gibba009 bash[26136]: cluster 2021-03-10T20:29:56.853826+0000 mgr.gibba009.xiladd (mgr.34457) 1081 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:29:58 gibba004 bash[30897]: cluster 2021-03-10T20:29:56.853826+0000 mgr.gibba009.xiladd (mgr.34457) 1081 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:29:58 gibba004 bash[31878]: cluster 2021-03-10T20:29:56.853826+0000 mgr.gibba009.xiladd (mgr.34457) 1081 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:00 gibba004 bash[30897]: debug 2021-03-10T20:29:59.996+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:00.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:00 gibba009 bash[26136]: cluster 2021-03-10T20:29:58.855202+0000 mgr.gibba009.xiladd (mgr.34457) 1082 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:00 gibba009 bash[26136]: cluster 2021-03-10T20:30:00.000168+0000 mon.a (mon.0) 701 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:00 gibba004 bash[30897]: cluster 2021-03-10T20:29:58.855202+0000 mgr.gibba009.xiladd (mgr.34457) 1082 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:00 gibba004 bash[30897]: cluster 2021-03-10T20:30:00.000168+0000 mon.a (mon.0) 701 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:00 gibba004 bash[31878]: cluster 2021-03-10T20:29:58.855202+0000 mgr.gibba009.xiladd (mgr.34457) 1082 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:00 gibba004 bash[31878]: cluster 2021-03-10T20:30:00.000168+0000 mon.a (mon.0) 701 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:01.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:01 gibba004 bash[30897]: cluster 2021-03-10T20:30:00.857014+0000 mgr.gibba009.xiladd (mgr.34457) 1083 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:01.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:01 gibba004 bash[31878]: cluster 2021-03-10T20:30:00.857014+0000 mgr.gibba009.xiladd (mgr.34457) 1083 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:01.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:01 gibba009 bash[26136]: cluster 2021-03-10T20:30:00.857014+0000 mgr.gibba009.xiladd (mgr.34457) 1083 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:03 gibba004 bash[30897]: cluster 2021-03-10T20:30:02.858615+0000 mgr.gibba009.xiladd (mgr.34457) 1084 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:03 gibba004 bash[31878]: cluster 2021-03-10T20:30:02.858615+0000 mgr.gibba009.xiladd (mgr.34457) 1084 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:03 gibba009 bash[26136]: cluster 2021-03-10T20:30:02.858615+0000 mgr.gibba009.xiladd (mgr.34457) 1084 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:05 gibba004 bash[30897]: cluster 2021-03-10T20:30:04.859143+0000 mgr.gibba009.xiladd (mgr.34457) 1085 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:05 gibba004 bash[31878]: cluster 2021-03-10T20:30:04.859143+0000 mgr.gibba009.xiladd (mgr.34457) 1085 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:05 gibba009 bash[26136]: cluster 2021-03-10T20:30:04.859143+0000 mgr.gibba009.xiladd (mgr.34457) 1085 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:07 gibba004 bash[30897]: cluster 2021-03-10T20:30:06.860028+0000 mgr.gibba009.xiladd (mgr.34457) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:07 gibba004 bash[31878]: cluster 2021-03-10T20:30:06.860028+0000 mgr.gibba009.xiladd (mgr.34457) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:07 gibba009 bash[26136]: cluster 2021-03-10T20:30:06.860028+0000 mgr.gibba009.xiladd (mgr.34457) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:09 gibba004 bash[30897]: cluster 2021-03-10T20:30:08.861746+0000 mgr.gibba009.xiladd (mgr.34457) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:09 gibba004 bash[31878]: cluster 2021-03-10T20:30:08.861746+0000 mgr.gibba009.xiladd (mgr.34457) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:09 gibba009 bash[26136]: cluster 2021-03-10T20:30:08.861746+0000 mgr.gibba009.xiladd (mgr.34457) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:12.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:11 gibba004 bash[30897]: cluster 2021-03-10T20:30:10.863442+0000 mgr.gibba009.xiladd (mgr.34457) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:12.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:11 gibba004 bash[31878]: cluster 2021-03-10T20:30:10.863442+0000 mgr.gibba009.xiladd (mgr.34457) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:12.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:11 gibba009 bash[26136]: cluster 2021-03-10T20:30:10.863442+0000 mgr.gibba009.xiladd (mgr.34457) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:13.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:13 gibba004 bash[30897]: cephadm 2021-03-10T20:30:11.331652+0000 mgr.gibba009.xiladd (mgr.34457) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:13.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:13 gibba004 bash[31878]: cephadm 2021-03-10T20:30:11.331652+0000 mgr.gibba009.xiladd (mgr.34457) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:13.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:13 gibba009 bash[26136]: cephadm 2021-03-10T20:30:11.331652+0000 mgr.gibba009.xiladd (mgr.34457) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:14.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:14 gibba004 bash[30897]: cluster 2021-03-10T20:30:12.863959+0000 mgr.gibba009.xiladd (mgr.34457) 1090 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:14.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:14 gibba004 bash[31878]: cluster 2021-03-10T20:30:12.863959+0000 mgr.gibba009.xiladd (mgr.34457) 1090 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:14.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:14 gibba009 bash[26136]: cluster 2021-03-10T20:30:12.863959+0000 mgr.gibba009.xiladd (mgr.34457) 1090 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:16.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:16 gibba004 bash[30897]: cluster 2021-03-10T20:30:14.865544+0000 mgr.gibba009.xiladd (mgr.34457) 1091 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:16 gibba004 bash[31878]: cluster 2021-03-10T20:30:14.865544+0000 mgr.gibba009.xiladd (mgr.34457) 1091 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:16.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:16 gibba009 bash[26136]: cluster 2021-03-10T20:30:14.865544+0000 mgr.gibba009.xiladd (mgr.34457) 1091 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:18.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:18 gibba004 bash[30897]: cluster 2021-03-10T20:30:16.866785+0000 mgr.gibba009.xiladd (mgr.34457) 1092 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:18.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:18 gibba004 bash[31878]: cluster 2021-03-10T20:30:16.866785+0000 mgr.gibba009.xiladd (mgr.34457) 1092 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:18.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:18 gibba009 bash[26136]: cluster 2021-03-10T20:30:16.866785+0000 mgr.gibba009.xiladd (mgr.34457) 1092 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:20.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:20 gibba004 bash[30897]: cluster 2021-03-10T20:30:18.868321+0000 mgr.gibba009.xiladd (mgr.34457) 1093 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:20.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:20 gibba004 bash[31878]: cluster 2021-03-10T20:30:18.868321+0000 mgr.gibba009.xiladd (mgr.34457) 1093 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:20.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:20 gibba009 bash[26136]: cluster 2021-03-10T20:30:18.868321+0000 mgr.gibba009.xiladd (mgr.34457) 1093 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:22.162 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:30:22.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:22 gibba004 bash[30897]: cluster 2021-03-10T20:30:20.869175+0000 mgr.gibba009.xiladd (mgr.34457) 1094 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:22 gibba004 bash[31878]: cluster 2021-03-10T20:30:20.869175+0000 mgr.gibba009.xiladd (mgr.34457) 1094 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:22.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:22 gibba009 bash[26136]: cluster 2021-03-10T20:30:20.869175+0000 mgr.gibba009.xiladd (mgr.34457) 1094 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:22.392 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:30:22.392 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (19m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:30:22.393 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:30:22.393 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (19m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:30:22.393 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:30:22.393 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:30:22.394 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:30:22.394 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:30:22.394 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:30:22.395 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (24m) 5m ago 24m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:30:22.395 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:30:22.395 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:30:22.395 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:30:22.396 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:30:22.396 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:30:22.396 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:30:22.396 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:30:22.397 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:30:22.397 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:30:22.397 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (24m) 4m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:30:22.397 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:22.398 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:22.642 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:30:22.643 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:30:22.643 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:22.644 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:22.644 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:30:22.644 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:22.645 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:22.645 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:30:22.645 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:30:22.645 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:22.646 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:30:22.646 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:30:22.646 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:30:22.646 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:30:22.647 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:30:23.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:23 gibba004 bash[30897]: audit 2021-03-10T20:30:22.152936+0000 mgr.gibba009.xiladd (mgr.34457) 1095 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:23.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:23 gibba004 bash[30897]: audit 2021-03-10T20:30:22.642653+0000 mon.a (mon.0) 702 : audit [DBG] from='client.? 172.21.2.104:0/4266082170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:23 gibba004 bash[31878]: audit 2021-03-10T20:30:22.152936+0000 mgr.gibba009.xiladd (mgr.34457) 1095 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:23.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:23 gibba004 bash[31878]: audit 2021-03-10T20:30:22.642653+0000 mon.a (mon.0) 702 : audit [DBG] from='client.? 172.21.2.104:0/4266082170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:23.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:23 gibba009 bash[26136]: audit 2021-03-10T20:30:22.152936+0000 mgr.gibba009.xiladd (mgr.34457) 1095 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:23.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:23 gibba009 bash[26136]: audit 2021-03-10T20:30:22.642653+0000 mon.a (mon.0) 702 : audit [DBG] from='client.? 172.21.2.104:0/4266082170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:24.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:24 gibba004 bash[30897]: audit 2021-03-10T20:30:22.378200+0000 mgr.gibba009.xiladd (mgr.34457) 1096 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:24 gibba004 bash[30897]: cluster 2021-03-10T20:30:22.870681+0000 mgr.gibba009.xiladd (mgr.34457) 1097 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:24 gibba004 bash[31878]: audit 2021-03-10T20:30:22.378200+0000 mgr.gibba009.xiladd (mgr.34457) 1096 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:24 gibba004 bash[31878]: cluster 2021-03-10T20:30:22.870681+0000 mgr.gibba009.xiladd (mgr.34457) 1097 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:24 gibba009 bash[26136]: audit 2021-03-10T20:30:22.378200+0000 mgr.gibba009.xiladd (mgr.34457) 1096 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:24 gibba009 bash[26136]: cluster 2021-03-10T20:30:22.870681+0000 mgr.gibba009.xiladd (mgr.34457) 1097 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:26.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:26 gibba009 bash[26136]: cluster 2021-03-10T20:30:24.872446+0000 mgr.gibba009.xiladd (mgr.34457) 1098 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:26 gibba004 bash[30897]: cluster 2021-03-10T20:30:24.872446+0000 mgr.gibba009.xiladd (mgr.34457) 1098 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:26 gibba004 bash[31878]: cluster 2021-03-10T20:30:24.872446+0000 mgr.gibba009.xiladd (mgr.34457) 1098 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:28.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:28 gibba009 bash[26136]: cephadm 2021-03-10T20:30:26.345626+0000 mgr.gibba009.xiladd (mgr.34457) 1099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:28.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:28 gibba009 bash[26136]: cluster 2021-03-10T20:30:26.873799+0000 mgr.gibba009.xiladd (mgr.34457) 1100 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:28 gibba004 bash[30897]: cephadm 2021-03-10T20:30:26.345626+0000 mgr.gibba009.xiladd (mgr.34457) 1099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:28 gibba004 bash[30897]: cluster 2021-03-10T20:30:26.873799+0000 mgr.gibba009.xiladd (mgr.34457) 1100 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:28 gibba004 bash[31878]: cephadm 2021-03-10T20:30:26.345626+0000 mgr.gibba009.xiladd (mgr.34457) 1099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:28 gibba004 bash[31878]: cluster 2021-03-10T20:30:26.873799+0000 mgr.gibba009.xiladd (mgr.34457) 1100 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:30.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:30 gibba009 bash[26136]: cluster 2021-03-10T20:30:28.874647+0000 mgr.gibba009.xiladd (mgr.34457) 1101 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:30 gibba004 bash[30897]: cluster 2021-03-10T20:30:28.874647+0000 mgr.gibba009.xiladd (mgr.34457) 1101 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:30 gibba004 bash[31878]: cluster 2021-03-10T20:30:28.874647+0000 mgr.gibba009.xiladd (mgr.34457) 1101 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:32 gibba004 bash[30897]: cluster 2021-03-10T20:30:30.876182+0000 mgr.gibba009.xiladd (mgr.34457) 1102 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:32 gibba004 bash[31878]: cluster 2021-03-10T20:30:30.876182+0000 mgr.gibba009.xiladd (mgr.34457) 1102 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:32.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:32 gibba009 bash[26136]: cluster 2021-03-10T20:30:30.876182+0000 mgr.gibba009.xiladd (mgr.34457) 1102 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:34 gibba004 bash[30897]: cluster 2021-03-10T20:30:32.877855+0000 mgr.gibba009.xiladd (mgr.34457) 1103 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:34 gibba004 bash[31878]: cluster 2021-03-10T20:30:32.877855+0000 mgr.gibba009.xiladd (mgr.34457) 1103 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:34 gibba009 bash[26136]: cluster 2021-03-10T20:30:32.877855+0000 mgr.gibba009.xiladd (mgr.34457) 1103 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:36 gibba004 bash[30897]: cluster 2021-03-10T20:30:34.879287+0000 mgr.gibba009.xiladd (mgr.34457) 1104 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:36 gibba004 bash[31878]: cluster 2021-03-10T20:30:34.879287+0000 mgr.gibba009.xiladd (mgr.34457) 1104 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:36.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:36 gibba009 bash[26136]: cluster 2021-03-10T20:30:34.879287+0000 mgr.gibba009.xiladd (mgr.34457) 1104 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:38 gibba004 bash[30897]: cluster 2021-03-10T20:30:36.879786+0000 mgr.gibba009.xiladd (mgr.34457) 1105 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:38 gibba004 bash[31878]: cluster 2021-03-10T20:30:36.879786+0000 mgr.gibba009.xiladd (mgr.34457) 1105 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:38 gibba009 bash[26136]: cluster 2021-03-10T20:30:36.879786+0000 mgr.gibba009.xiladd (mgr.34457) 1105 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: cluster 2021-03-10T20:30:38.881351+0000 mgr.gibba009.xiladd (mgr.34457) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.635480+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.635677+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.635848+0000 mon.c (mon.1) 374 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.635947+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.636020+0000 mon.c (mon.1) 375 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.636261+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.636548+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.636760+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.688156+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.688772+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.689303+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[30897]: audit 2021-03-10T20:30:39.690439+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: cluster 2021-03-10T20:30:38.881351+0000 mgr.gibba009.xiladd (mgr.34457) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.635480+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.635677+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.635848+0000 mon.c (mon.1) 374 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.635947+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.636020+0000 mon.c (mon.1) 375 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.636261+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.636548+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.636760+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.688156+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.688772+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.689303+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:40 gibba004 bash[31878]: audit 2021-03-10T20:30:39.690439+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: cluster 2021-03-10T20:30:38.881351+0000 mgr.gibba009.xiladd (mgr.34457) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.635480+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.635677+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.635848+0000 mon.c (mon.1) 374 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.635947+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:30:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.636020+0000 mon.c (mon.1) 375 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.636261+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.636548+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:30:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.636760+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:30:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.688156+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.688772+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.689303+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:40.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:40 gibba009 bash[26136]: audit 2021-03-10T20:30:39.690439+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:42 gibba004 bash[30897]: cluster 2021-03-10T20:30:40.883036+0000 mgr.gibba009.xiladd (mgr.34457) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:42 gibba004 bash[31878]: cluster 2021-03-10T20:30:40.883036+0000 mgr.gibba009.xiladd (mgr.34457) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:42.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:42 gibba009 bash[26136]: cluster 2021-03-10T20:30:40.883036+0000 mgr.gibba009.xiladd (mgr.34457) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:43.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:43 gibba004 bash[30897]: cephadm 2021-03-10T20:30:41.361750+0000 mgr.gibba009.xiladd (mgr.34457) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:43.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:43 gibba004 bash[31878]: cephadm 2021-03-10T20:30:41.361750+0000 mgr.gibba009.xiladd (mgr.34457) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:43.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:43 gibba009 bash[26136]: cephadm 2021-03-10T20:30:41.361750+0000 mgr.gibba009.xiladd (mgr.34457) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:44 gibba004 bash[30897]: cluster 2021-03-10T20:30:42.884566+0000 mgr.gibba009.xiladd (mgr.34457) 1109 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:44 gibba004 bash[31878]: cluster 2021-03-10T20:30:42.884566+0000 mgr.gibba009.xiladd (mgr.34457) 1109 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:44.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:44 gibba009 bash[26136]: cluster 2021-03-10T20:30:42.884566+0000 mgr.gibba009.xiladd (mgr.34457) 1109 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:46 gibba004 bash[30897]: cluster 2021-03-10T20:30:44.886112+0000 mgr.gibba009.xiladd (mgr.34457) 1110 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:46 gibba004 bash[31878]: cluster 2021-03-10T20:30:44.886112+0000 mgr.gibba009.xiladd (mgr.34457) 1110 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:46 gibba009 bash[26136]: cluster 2021-03-10T20:30:44.886112+0000 mgr.gibba009.xiladd (mgr.34457) 1110 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:48.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:48 gibba004 bash[30897]: cluster 2021-03-10T20:30:46.887557+0000 mgr.gibba009.xiladd (mgr.34457) 1111 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:48 gibba004 bash[31878]: cluster 2021-03-10T20:30:46.887557+0000 mgr.gibba009.xiladd (mgr.34457) 1111 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:48 gibba009 bash[26136]: cluster 2021-03-10T20:30:46.887557+0000 mgr.gibba009.xiladd (mgr.34457) 1111 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:50 gibba004 bash[30897]: cluster 2021-03-10T20:30:48.889119+0000 mgr.gibba009.xiladd (mgr.34457) 1112 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:50 gibba004 bash[31878]: cluster 2021-03-10T20:30:48.889119+0000 mgr.gibba009.xiladd (mgr.34457) 1112 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:50.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:50 gibba009 bash[26136]: cluster 2021-03-10T20:30:48.889119+0000 mgr.gibba009.xiladd (mgr.34457) 1112 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:52 gibba004 bash[30897]: cluster 2021-03-10T20:30:50.890902+0000 mgr.gibba009.xiladd (mgr.34457) 1113 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:52 gibba004 bash[31878]: cluster 2021-03-10T20:30:50.890902+0000 mgr.gibba009.xiladd (mgr.34457) 1113 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:52 gibba009 bash[26136]: cluster 2021-03-10T20:30:50.890902+0000 mgr.gibba009.xiladd (mgr.34457) 1113 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.887 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:30:53.143 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:30:53.144 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (19m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:30:53.144 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:30:53.144 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:30:53.144 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:30:53.145 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:30:53.145 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:30:53.145 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:30:53.145 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:30:53.146 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:30:53.146 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:30:53.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:30:53.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:30:53.146 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:30:53.147 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:30:53.147 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:30:53.147 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:30:53.147 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:30:53.148 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:30:53.148 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:30:53.148 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:53.148 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:53.404 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:30:53.404 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:30:53.404 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:53.404 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:53.405 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:30:53.405 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:53.405 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:53.405 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:30:53.405 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:30:53.406 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:30:53.406 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:30:53.406 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:30:53.406 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:30:53.407 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:30:53.407 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:30:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[30897]: audit 2021-03-10T20:30:52.877564+0000 mgr.gibba009.xiladd (mgr.34457) 1114 : audit [DBG] from='client.54793 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[30897]: cluster 2021-03-10T20:30:52.891524+0000 mgr.gibba009.xiladd (mgr.34457) 1115 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[30897]: audit 2021-03-10T20:30:53.099581+0000 mgr.gibba009.xiladd (mgr.34457) 1116 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[30897]: audit 2021-03-10T20:30:53.403819+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.2.104:0/2799053627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:54.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[31878]: audit 2021-03-10T20:30:52.877564+0000 mgr.gibba009.xiladd (mgr.34457) 1114 : audit [DBG] from='client.54793 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[31878]: cluster 2021-03-10T20:30:52.891524+0000 mgr.gibba009.xiladd (mgr.34457) 1115 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:54.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[31878]: audit 2021-03-10T20:30:53.099581+0000 mgr.gibba009.xiladd (mgr.34457) 1116 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:54 gibba004 bash[31878]: audit 2021-03-10T20:30:53.403819+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.2.104:0/2799053627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:54.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:54 gibba009 bash[26136]: audit 2021-03-10T20:30:52.877564+0000 mgr.gibba009.xiladd (mgr.34457) 1114 : audit [DBG] from='client.54793 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:54 gibba009 bash[26136]: cluster 2021-03-10T20:30:52.891524+0000 mgr.gibba009.xiladd (mgr.34457) 1115 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:54 gibba009 bash[26136]: audit 2021-03-10T20:30:53.099581+0000 mgr.gibba009.xiladd (mgr.34457) 1116 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:54 gibba009 bash[26136]: audit 2021-03-10T20:30:53.403819+0000 mon.a (mon.0) 709 : audit [DBG] from='client.? 172.21.2.104:0/2799053627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:56 gibba004 bash[30897]: cluster 2021-03-10T20:30:54.893205+0000 mgr.gibba009.xiladd (mgr.34457) 1117 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:56.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:56 gibba004 bash[31878]: cluster 2021-03-10T20:30:54.893205+0000 mgr.gibba009.xiladd (mgr.34457) 1117 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:56 gibba009 bash[26136]: cluster 2021-03-10T20:30:54.893205+0000 mgr.gibba009.xiladd (mgr.34457) 1117 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.378963+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.605195+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:30:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.609324+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.611175+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.612808+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.614156+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.617285+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[30897]: audit 2021-03-10T20:30:56.619073+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.378963+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.605195+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:30:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.609324+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.611175+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.612808+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.614156+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.617285+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:57 gibba004 bash[31878]: audit 2021-03-10T20:30:56.619073+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.378963+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.605195+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:30:57.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.609324+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.611175+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.612808+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.614156+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.617285+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:57.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:57 gibba009 bash[26136]: audit 2021-03-10T20:30:56.619073+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:58.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.382525+0000 mgr.gibba009.xiladd (mgr.34457) 1118 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:30:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.384425+0000 mgr.gibba009.xiladd (mgr.34457) 1119 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:30:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.607547+0000 mgr.gibba009.xiladd (mgr.34457) 1120 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.609752+0000 mgr.gibba009.xiladd (mgr.34457) 1121 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.611292+0000 mgr.gibba009.xiladd (mgr.34457) 1122 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.611331+0000 mgr.gibba009.xiladd (mgr.34457) 1123 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.612789+0000 mgr.gibba009.xiladd (mgr.34457) 1124 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.612826+0000 mgr.gibba009.xiladd (mgr.34457) 1125 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.614104+0000 mgr.gibba009.xiladd (mgr.34457) 1126 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.615723+0000 mgr.gibba009.xiladd (mgr.34457) 1127 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.615762+0000 mgr.gibba009.xiladd (mgr.34457) 1128 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.617434+0000 mgr.gibba009.xiladd (mgr.34457) 1129 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.617764+0000 mgr.gibba009.xiladd (mgr.34457) 1130 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.619429+0000 mgr.gibba009.xiladd (mgr.34457) 1131 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:58.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.619470+0000 mgr.gibba009.xiladd (mgr.34457) 1132 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:58.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cephadm 2021-03-10T20:30:56.619602+0000 mgr.gibba009.xiladd (mgr.34457) 1133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:58.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[30897]: cluster 2021-03-10T20:30:56.894633+0000 mgr.gibba009.xiladd (mgr.34457) 1134 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.382525+0000 mgr.gibba009.xiladd (mgr.34457) 1118 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:30:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.384425+0000 mgr.gibba009.xiladd (mgr.34457) 1119 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:30:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.607547+0000 mgr.gibba009.xiladd (mgr.34457) 1120 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.609752+0000 mgr.gibba009.xiladd (mgr.34457) 1121 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.611292+0000 mgr.gibba009.xiladd (mgr.34457) 1122 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.611331+0000 mgr.gibba009.xiladd (mgr.34457) 1123 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.612789+0000 mgr.gibba009.xiladd (mgr.34457) 1124 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.612826+0000 mgr.gibba009.xiladd (mgr.34457) 1125 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.614104+0000 mgr.gibba009.xiladd (mgr.34457) 1126 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.615723+0000 mgr.gibba009.xiladd (mgr.34457) 1127 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.615762+0000 mgr.gibba009.xiladd (mgr.34457) 1128 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.617434+0000 mgr.gibba009.xiladd (mgr.34457) 1129 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.617764+0000 mgr.gibba009.xiladd (mgr.34457) 1130 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:58.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.619429+0000 mgr.gibba009.xiladd (mgr.34457) 1131 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:58.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.619470+0000 mgr.gibba009.xiladd (mgr.34457) 1132 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:58.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cephadm 2021-03-10T20:30:56.619602+0000 mgr.gibba009.xiladd (mgr.34457) 1133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:58.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:30:58 gibba004 bash[31878]: cluster 2021-03-10T20:30:56.894633+0000 mgr.gibba009.xiladd (mgr.34457) 1134 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:58.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.382525+0000 mgr.gibba009.xiladd (mgr.34457) 1118 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:30:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.384425+0000 mgr.gibba009.xiladd (mgr.34457) 1119 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:30:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.607547+0000 mgr.gibba009.xiladd (mgr.34457) 1120 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.609752+0000 mgr.gibba009.xiladd (mgr.34457) 1121 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.611292+0000 mgr.gibba009.xiladd (mgr.34457) 1122 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.611331+0000 mgr.gibba009.xiladd (mgr.34457) 1123 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.612789+0000 mgr.gibba009.xiladd (mgr.34457) 1124 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.612826+0000 mgr.gibba009.xiladd (mgr.34457) 1125 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.614104+0000 mgr.gibba009.xiladd (mgr.34457) 1126 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.615723+0000 mgr.gibba009.xiladd (mgr.34457) 1127 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.615762+0000 mgr.gibba009.xiladd (mgr.34457) 1128 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.617434+0000 mgr.gibba009.xiladd (mgr.34457) 1129 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.617764+0000 mgr.gibba009.xiladd (mgr.34457) 1130 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.619429+0000 mgr.gibba009.xiladd (mgr.34457) 1131 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.619470+0000 mgr.gibba009.xiladd (mgr.34457) 1132 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cephadm 2021-03-10T20:30:56.619602+0000 mgr.gibba009.xiladd (mgr.34457) 1133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:30:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:30:58 gibba009 bash[26136]: cluster 2021-03-10T20:30:56.894633+0000 mgr.gibba009.xiladd (mgr.34457) 1134 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:00 gibba004 bash[30897]: cluster 2021-03-10T20:30:58.896319+0000 mgr.gibba009.xiladd (mgr.34457) 1135 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:00 gibba004 bash[31878]: cluster 2021-03-10T20:30:58.896319+0000 mgr.gibba009.xiladd (mgr.34457) 1135 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:00 gibba009 bash[26136]: cluster 2021-03-10T20:30:58.896319+0000 mgr.gibba009.xiladd (mgr.34457) 1135 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:02 gibba004 bash[30897]: cluster 2021-03-10T20:31:00.897377+0000 mgr.gibba009.xiladd (mgr.34457) 1136 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:02 gibba004 bash[31878]: cluster 2021-03-10T20:31:00.897377+0000 mgr.gibba009.xiladd (mgr.34457) 1136 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:02 gibba009 bash[26136]: cluster 2021-03-10T20:31:00.897377+0000 mgr.gibba009.xiladd (mgr.34457) 1136 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:04 gibba004 bash[30897]: cluster 2021-03-10T20:31:02.898715+0000 mgr.gibba009.xiladd (mgr.34457) 1137 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:04 gibba004 bash[31878]: cluster 2021-03-10T20:31:02.898715+0000 mgr.gibba009.xiladd (mgr.34457) 1137 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:04 gibba009 bash[26136]: cluster 2021-03-10T20:31:02.898715+0000 mgr.gibba009.xiladd (mgr.34457) 1137 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:06 gibba004 bash[30897]: cluster 2021-03-10T20:31:04.900544+0000 mgr.gibba009.xiladd (mgr.34457) 1138 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:06 gibba004 bash[31878]: cluster 2021-03-10T20:31:04.900544+0000 mgr.gibba009.xiladd (mgr.34457) 1138 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:06 gibba009 bash[26136]: cluster 2021-03-10T20:31:04.900544+0000 mgr.gibba009.xiladd (mgr.34457) 1138 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:08 gibba004 bash[30897]: cluster 2021-03-10T20:31:06.901778+0000 mgr.gibba009.xiladd (mgr.34457) 1139 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:08 gibba004 bash[31878]: cluster 2021-03-10T20:31:06.901778+0000 mgr.gibba009.xiladd (mgr.34457) 1139 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:08 gibba009 bash[26136]: cluster 2021-03-10T20:31:06.901778+0000 mgr.gibba009.xiladd (mgr.34457) 1139 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:10 gibba004 bash[30897]: cluster 2021-03-10T20:31:08.902607+0000 mgr.gibba009.xiladd (mgr.34457) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:10 gibba004 bash[31878]: cluster 2021-03-10T20:31:08.902607+0000 mgr.gibba009.xiladd (mgr.34457) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:10 gibba009 bash[26136]: cluster 2021-03-10T20:31:08.902607+0000 mgr.gibba009.xiladd (mgr.34457) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:12 gibba004 bash[30897]: cluster 2021-03-10T20:31:10.904314+0000 mgr.gibba009.xiladd (mgr.34457) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:12 gibba004 bash[31878]: cluster 2021-03-10T20:31:10.904314+0000 mgr.gibba009.xiladd (mgr.34457) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:12 gibba009 bash[26136]: cluster 2021-03-10T20:31:10.904314+0000 mgr.gibba009.xiladd (mgr.34457) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:13.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:13 gibba004 bash[30897]: cephadm 2021-03-10T20:31:11.635348+0000 mgr.gibba009.xiladd (mgr.34457) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:13.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:13 gibba004 bash[31878]: cephadm 2021-03-10T20:31:11.635348+0000 mgr.gibba009.xiladd (mgr.34457) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:13.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:13 gibba009 bash[26136]: cephadm 2021-03-10T20:31:11.635348+0000 mgr.gibba009.xiladd (mgr.34457) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:14 gibba004 bash[30897]: cluster 2021-03-10T20:31:12.905843+0000 mgr.gibba009.xiladd (mgr.34457) 1143 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:14 gibba004 bash[31878]: cluster 2021-03-10T20:31:12.905843+0000 mgr.gibba009.xiladd (mgr.34457) 1143 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:14.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:14 gibba009 bash[26136]: cluster 2021-03-10T20:31:12.905843+0000 mgr.gibba009.xiladd (mgr.34457) 1143 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:16 gibba004 bash[30897]: cluster 2021-03-10T20:31:14.907424+0000 mgr.gibba009.xiladd (mgr.34457) 1144 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:16 gibba004 bash[31878]: cluster 2021-03-10T20:31:14.907424+0000 mgr.gibba009.xiladd (mgr.34457) 1144 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:16 gibba009 bash[26136]: cluster 2021-03-10T20:31:14.907424+0000 mgr.gibba009.xiladd (mgr.34457) 1144 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:18 gibba009 bash[26136]: cluster 2021-03-10T20:31:16.908891+0000 mgr.gibba009.xiladd (mgr.34457) 1145 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:18 gibba004 bash[30897]: cluster 2021-03-10T20:31:16.908891+0000 mgr.gibba009.xiladd (mgr.34457) 1145 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:18 gibba004 bash[31878]: cluster 2021-03-10T20:31:16.908891+0000 mgr.gibba009.xiladd (mgr.34457) 1145 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:20.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:20 gibba009 bash[26136]: cluster 2021-03-10T20:31:18.910586+0000 mgr.gibba009.xiladd (mgr.34457) 1146 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:20 gibba004 bash[30897]: cluster 2021-03-10T20:31:18.910586+0000 mgr.gibba009.xiladd (mgr.34457) 1146 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:20 gibba004 bash[31878]: cluster 2021-03-10T20:31:18.910586+0000 mgr.gibba009.xiladd (mgr.34457) 1146 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:22 gibba009 bash[26136]: cluster 2021-03-10T20:31:20.912364+0000 mgr.gibba009.xiladd (mgr.34457) 1147 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:22 gibba004 bash[30897]: cluster 2021-03-10T20:31:20.912364+0000 mgr.gibba009.xiladd (mgr.34457) 1147 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:22 gibba004 bash[31878]: cluster 2021-03-10T20:31:20.912364+0000 mgr.gibba009.xiladd (mgr.34457) 1147 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:23.650 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:31:23.882 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:31:23.882 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (20m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:31:23.882 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:31:23.882 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (20m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:31:23.883 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:31:23.883 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:31:23.883 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:31:23.883 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:31:23.884 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:31:23.884 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:31:23.884 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:31:23.884 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:31:23.884 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:31:23.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:31:23.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:31:23.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:31:23.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:31:23.885 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:31:23.886 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:31:23.886 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (25m) 5m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:31:23.886 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:23.886 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:24.132 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:31:24.133 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:31:24.133 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:24.133 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:24.133 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:31:24.133 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:24.134 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:24.134 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:31:24.134 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:31:24.134 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:24.135 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:31:24.135 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:31:24.135 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:31:24.135 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:31:24.135 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:31:24.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:24 gibba004 bash[30897]: cluster 2021-03-10T20:31:22.913643+0000 mgr.gibba009.xiladd (mgr.34457) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:24 gibba004 bash[30897]: audit 2021-03-10T20:31:24.132480+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.2.104:0/1047462318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:24.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:24 gibba004 bash[31878]: cluster 2021-03-10T20:31:22.913643+0000 mgr.gibba009.xiladd (mgr.34457) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:24 gibba004 bash[31878]: audit 2021-03-10T20:31:24.132480+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.2.104:0/1047462318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:24 gibba009 bash[26136]: cluster 2021-03-10T20:31:22.913643+0000 mgr.gibba009.xiladd (mgr.34457) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:24 gibba009 bash[26136]: audit 2021-03-10T20:31:24.132480+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.2.104:0/1047462318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:25.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:25 gibba004 bash[30897]: audit 2021-03-10T20:31:23.640133+0000 mgr.gibba009.xiladd (mgr.34457) 1149 : audit [DBG] from='client.54811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:25.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:25 gibba004 bash[30897]: audit 2021-03-10T20:31:23.868153+0000 mgr.gibba009.xiladd (mgr.34457) 1150 : audit [DBG] from='client.44838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:25.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:25 gibba004 bash[31878]: audit 2021-03-10T20:31:23.640133+0000 mgr.gibba009.xiladd (mgr.34457) 1149 : audit [DBG] from='client.54811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:25.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:25 gibba004 bash[31878]: audit 2021-03-10T20:31:23.868153+0000 mgr.gibba009.xiladd (mgr.34457) 1150 : audit [DBG] from='client.44838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:25.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:25 gibba009 bash[26136]: audit 2021-03-10T20:31:23.640133+0000 mgr.gibba009.xiladd (mgr.34457) 1149 : audit [DBG] from='client.54811 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:25.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:25 gibba009 bash[26136]: audit 2021-03-10T20:31:23.868153+0000 mgr.gibba009.xiladd (mgr.34457) 1150 : audit [DBG] from='client.44838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:26.651 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:26 gibba009 bash[26136]: cluster 2021-03-10T20:31:24.914640+0000 mgr.gibba009.xiladd (mgr.34457) 1151 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:26 gibba004 bash[30897]: cluster 2021-03-10T20:31:24.914640+0000 mgr.gibba009.xiladd (mgr.34457) 1151 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:26 gibba004 bash[31878]: cluster 2021-03-10T20:31:24.914640+0000 mgr.gibba009.xiladd (mgr.34457) 1151 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:27.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:27 gibba004 bash[30897]: cephadm 2021-03-10T20:31:26.649865+0000 mgr.gibba009.xiladd (mgr.34457) 1152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:27.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:27 gibba004 bash[30897]: cluster 2021-03-10T20:31:26.915896+0000 mgr.gibba009.xiladd (mgr.34457) 1153 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:27.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:27 gibba004 bash[31878]: cephadm 2021-03-10T20:31:26.649865+0000 mgr.gibba009.xiladd (mgr.34457) 1152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:27.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:27 gibba004 bash[31878]: cluster 2021-03-10T20:31:26.915896+0000 mgr.gibba009.xiladd (mgr.34457) 1153 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:27 gibba009 bash[26136]: cephadm 2021-03-10T20:31:26.649865+0000 mgr.gibba009.xiladd (mgr.34457) 1152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:27.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:27 gibba009 bash[26136]: cluster 2021-03-10T20:31:26.915896+0000 mgr.gibba009.xiladd (mgr.34457) 1153 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:30.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:30 gibba004 bash[30897]: cluster 2021-03-10T20:31:28.917502+0000 mgr.gibba009.xiladd (mgr.34457) 1154 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:30.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:30 gibba004 bash[31878]: cluster 2021-03-10T20:31:28.917502+0000 mgr.gibba009.xiladd (mgr.34457) 1154 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:30.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:30 gibba009 bash[26136]: cluster 2021-03-10T20:31:28.917502+0000 mgr.gibba009.xiladd (mgr.34457) 1154 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:32.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:32 gibba004 bash[30897]: cluster 2021-03-10T20:31:30.919325+0000 mgr.gibba009.xiladd (mgr.34457) 1155 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:32 gibba004 bash[31878]: cluster 2021-03-10T20:31:30.919325+0000 mgr.gibba009.xiladd (mgr.34457) 1155 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:32.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:32 gibba009 bash[26136]: cluster 2021-03-10T20:31:30.919325+0000 mgr.gibba009.xiladd (mgr.34457) 1155 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:34.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:34 gibba004 bash[30897]: cluster 2021-03-10T20:31:32.920400+0000 mgr.gibba009.xiladd (mgr.34457) 1156 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:34 gibba004 bash[31878]: cluster 2021-03-10T20:31:32.920400+0000 mgr.gibba009.xiladd (mgr.34457) 1156 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:34.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:34 gibba009 bash[26136]: cluster 2021-03-10T20:31:32.920400+0000 mgr.gibba009.xiladd (mgr.34457) 1156 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:36.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:36 gibba004 bash[30897]: cluster 2021-03-10T20:31:34.922091+0000 mgr.gibba009.xiladd (mgr.34457) 1157 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:36 gibba004 bash[31878]: cluster 2021-03-10T20:31:34.922091+0000 mgr.gibba009.xiladd (mgr.34457) 1157 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:36.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:36 gibba009 bash[26136]: cluster 2021-03-10T20:31:34.922091+0000 mgr.gibba009.xiladd (mgr.34457) 1157 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:38 gibba004 bash[30897]: cluster 2021-03-10T20:31:36.923418+0000 mgr.gibba009.xiladd (mgr.34457) 1158 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:38 gibba004 bash[31878]: cluster 2021-03-10T20:31:36.923418+0000 mgr.gibba009.xiladd (mgr.34457) 1158 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:38.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:38 gibba009 bash[26136]: cluster 2021-03-10T20:31:36.923418+0000 mgr.gibba009.xiladd (mgr.34457) 1158 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: cluster 2021-03-10T20:31:38.925113+0000 mgr.gibba009.xiladd (mgr.34457) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:40.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.644849+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.645618+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.645987+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.646378+0000 mon.c (mon.1) 387 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.647211+0000 mon.c (mon.1) 388 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.647375+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.648511+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.649300+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.695679+0000 mon.c (mon.1) 389 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.696319+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.696834+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[30897]: audit 2021-03-10T20:31:39.697885+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: cluster 2021-03-10T20:31:38.925113+0000 mgr.gibba009.xiladd (mgr.34457) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.644849+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.645618+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.645987+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.646378+0000 mon.c (mon.1) 387 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.647211+0000 mon.c (mon.1) 388 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.647375+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.648511+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.649300+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.695679+0000 mon.c (mon.1) 389 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.696319+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.696834+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:40 gibba004 bash[31878]: audit 2021-03-10T20:31:39.697885+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:40.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: cluster 2021-03-10T20:31:38.925113+0000 mgr.gibba009.xiladd (mgr.34457) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.644849+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.645618+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.645987+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:31:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.646378+0000 mon.c (mon.1) 387 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.647211+0000 mon.c (mon.1) 388 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.647375+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.648511+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:31:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.649300+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T20:31:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.695679+0000 mon.c (mon.1) 389 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.696319+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.696834+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:40 gibba009 bash[26136]: audit 2021-03-10T20:31:39.697885+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:42 gibba004 bash[30897]: cluster 2021-03-10T20:31:40.926237+0000 mgr.gibba009.xiladd (mgr.34457) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:42 gibba004 bash[31878]: cluster 2021-03-10T20:31:40.926237+0000 mgr.gibba009.xiladd (mgr.34457) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:42.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:42 gibba009 bash[26136]: cluster 2021-03-10T20:31:40.926237+0000 mgr.gibba009.xiladd (mgr.34457) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:43.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:43 gibba004 bash[30897]: cephadm 2021-03-10T20:31:41.655001+0000 mgr.gibba009.xiladd (mgr.34457) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:43.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:43 gibba004 bash[31878]: cephadm 2021-03-10T20:31:41.655001+0000 mgr.gibba009.xiladd (mgr.34457) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:43.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:43 gibba009 bash[26136]: cephadm 2021-03-10T20:31:41.655001+0000 mgr.gibba009.xiladd (mgr.34457) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:44.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:44 gibba009 bash[26136]: cluster 2021-03-10T20:31:42.927431+0000 mgr.gibba009.xiladd (mgr.34457) 1162 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:44 gibba004 bash[30897]: cluster 2021-03-10T20:31:42.927431+0000 mgr.gibba009.xiladd (mgr.34457) 1162 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:44 gibba004 bash[31878]: cluster 2021-03-10T20:31:42.927431+0000 mgr.gibba009.xiladd (mgr.34457) 1162 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:46 gibba009 bash[26136]: cluster 2021-03-10T20:31:44.929217+0000 mgr.gibba009.xiladd (mgr.34457) 1163 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:46 gibba004 bash[30897]: cluster 2021-03-10T20:31:44.929217+0000 mgr.gibba009.xiladd (mgr.34457) 1163 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:46 gibba004 bash[31878]: cluster 2021-03-10T20:31:44.929217+0000 mgr.gibba009.xiladd (mgr.34457) 1163 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:48 gibba009 bash[26136]: cluster 2021-03-10T20:31:46.930549+0000 mgr.gibba009.xiladd (mgr.34457) 1164 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:48 gibba004 bash[30897]: cluster 2021-03-10T20:31:46.930549+0000 mgr.gibba009.xiladd (mgr.34457) 1164 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:48 gibba004 bash[31878]: cluster 2021-03-10T20:31:46.930549+0000 mgr.gibba009.xiladd (mgr.34457) 1164 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:50.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:50 gibba009 bash[26136]: cluster 2021-03-10T20:31:48.931856+0000 mgr.gibba009.xiladd (mgr.34457) 1165 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:50 gibba004 bash[30897]: cluster 2021-03-10T20:31:48.931856+0000 mgr.gibba009.xiladd (mgr.34457) 1165 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:50 gibba004 bash[31878]: cluster 2021-03-10T20:31:48.931856+0000 mgr.gibba009.xiladd (mgr.34457) 1165 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:52.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:52 gibba004 bash[30897]: cluster 2021-03-10T20:31:50.933587+0000 mgr.gibba009.xiladd (mgr.34457) 1166 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:52.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:52 gibba004 bash[31878]: cluster 2021-03-10T20:31:50.933587+0000 mgr.gibba009.xiladd (mgr.34457) 1166 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:52 gibba009 bash[26136]: cluster 2021-03-10T20:31:50.933587+0000 mgr.gibba009.xiladd (mgr.34457) 1166 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.373 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:31:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:54 gibba004 bash[30897]: cluster 2021-03-10T20:31:52.934949+0000 mgr.gibba009.xiladd (mgr.34457) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:54 gibba004 bash[31878]: cluster 2021-03-10T20:31:52.934949+0000 mgr.gibba009.xiladd (mgr.34457) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:54 gibba009 bash[26136]: cluster 2021-03-10T20:31:52.934949+0000 mgr.gibba009.xiladd (mgr.34457) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.602 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:31:54.602 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (20m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:31:54.603 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (26m) 5m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:31:54.603 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:31:54.603 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:31:54.604 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:31:54.604 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:31:54.604 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:31:54.604 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:31:54.605 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:31:54.605 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:31:54.605 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:31:54.606 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:31:54.606 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:31:54.606 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:31:54.606 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:31:54.607 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:31:54.607 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:31:54.607 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:31:54.607 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:31:54.607 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:54.608 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:54.857 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:31:54.857 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:31:54.857 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:54.858 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:54.858 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:31:54.858 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:54.858 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:54.858 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:31:54.859 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:31:54.859 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:31:54.859 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:31:54.859 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:31:54.860 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:31:54.860 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:31:54.860 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:31:55.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:55 gibba004 bash[30897]: audit 2021-03-10T20:31:54.362550+0000 mgr.gibba009.xiladd (mgr.34457) 1168 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:55.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:55 gibba004 bash[30897]: audit 2021-03-10T20:31:54.853698+0000 mon.a (mon.0) 718 : audit [DBG] from='client.? 172.21.2.104:0/961402438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:55.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:55 gibba004 bash[31878]: audit 2021-03-10T20:31:54.362550+0000 mgr.gibba009.xiladd (mgr.34457) 1168 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:55.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:55 gibba004 bash[31878]: audit 2021-03-10T20:31:54.853698+0000 mon.a (mon.0) 718 : audit [DBG] from='client.? 172.21.2.104:0/961402438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:55.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:55 gibba009 bash[26136]: audit 2021-03-10T20:31:54.362550+0000 mgr.gibba009.xiladd (mgr.34457) 1168 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:55.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:55 gibba009 bash[26136]: audit 2021-03-10T20:31:54.853698+0000 mon.a (mon.0) 718 : audit [DBG] from='client.? 172.21.2.104:0/961402438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:56 gibba004 bash[30897]: audit 2021-03-10T20:31:54.588164+0000 mgr.gibba009.xiladd (mgr.34457) 1169 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:56 gibba004 bash[30897]: cluster 2021-03-10T20:31:54.936685+0000 mgr.gibba009.xiladd (mgr.34457) 1170 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:56 gibba004 bash[31878]: audit 2021-03-10T20:31:54.588164+0000 mgr.gibba009.xiladd (mgr.34457) 1169 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:56 gibba004 bash[31878]: cluster 2021-03-10T20:31:54.936685+0000 mgr.gibba009.xiladd (mgr.34457) 1170 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:56 gibba009 bash[26136]: audit 2021-03-10T20:31:54.588164+0000 mgr.gibba009.xiladd (mgr.34457) 1169 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:56 gibba009 bash[26136]: cluster 2021-03-10T20:31:54.936685+0000 mgr.gibba009.xiladd (mgr.34457) 1170 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:56.657665+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:56.862069+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:56.872472+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.060211+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.064487+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.066039+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.067366+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.068804+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.072274+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:57 gibba009 bash[26136]: audit 2021-03-10T20:31:57.074120+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:56.657665+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:56.862069+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:56.872472+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.060211+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.064487+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.066039+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.067366+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.068804+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.072274+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[30897]: audit 2021-03-10T20:31:57.074120+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:56.657665+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:56.862069+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:56.872472+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.060211+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:31:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.064487+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:31:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.066039+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.067366+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.068804+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.072274+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:57.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:57 gibba004 bash[31878]: audit 2021-03-10T20:31:57.074120+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:58.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:56.861796+0000 mgr.gibba009.xiladd (mgr.34457) 1171 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:31:58.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:56.872531+0000 mgr.gibba009.xiladd (mgr.34457) 1172 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:31:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cluster 2021-03-10T20:31:56.937137+0000 mgr.gibba009.xiladd (mgr.34457) 1173 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.062618+0000 mgr.gibba009.xiladd (mgr.34457) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:31:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.064516+0000 mgr.gibba009.xiladd (mgr.34457) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:31:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.065955+0000 mgr.gibba009.xiladd (mgr.34457) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:31:58.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.065993+0000 mgr.gibba009.xiladd (mgr.34457) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:31:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.067375+0000 mgr.gibba009.xiladd (mgr.34457) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:31:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.067413+0000 mgr.gibba009.xiladd (mgr.34457) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:31:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.068839+0000 mgr.gibba009.xiladd (mgr.34457) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:31:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.070702+0000 mgr.gibba009.xiladd (mgr.34457) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:31:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.070740+0000 mgr.gibba009.xiladd (mgr.34457) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:31:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.072298+0000 mgr.gibba009.xiladd (mgr.34457) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:31:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.072611+0000 mgr.gibba009.xiladd (mgr.34457) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:31:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.074535+0000 mgr.gibba009.xiladd (mgr.34457) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:31:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.074574+0000 mgr.gibba009.xiladd (mgr.34457) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:31:58.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[30897]: cephadm 2021-03-10T20:31:57.074788+0000 mgr.gibba009.xiladd (mgr.34457) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:58.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:56.861796+0000 mgr.gibba009.xiladd (mgr.34457) 1171 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:31:58.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:56.872531+0000 mgr.gibba009.xiladd (mgr.34457) 1172 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:31:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cluster 2021-03-10T20:31:56.937137+0000 mgr.gibba009.xiladd (mgr.34457) 1173 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.062618+0000 mgr.gibba009.xiladd (mgr.34457) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:31:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.064516+0000 mgr.gibba009.xiladd (mgr.34457) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:31:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.065955+0000 mgr.gibba009.xiladd (mgr.34457) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:31:58.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.065993+0000 mgr.gibba009.xiladd (mgr.34457) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:31:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.067375+0000 mgr.gibba009.xiladd (mgr.34457) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:31:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.067413+0000 mgr.gibba009.xiladd (mgr.34457) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:31:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.068839+0000 mgr.gibba009.xiladd (mgr.34457) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:31:58.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.070702+0000 mgr.gibba009.xiladd (mgr.34457) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:31:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.070740+0000 mgr.gibba009.xiladd (mgr.34457) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:31:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.072298+0000 mgr.gibba009.xiladd (mgr.34457) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:31:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.072611+0000 mgr.gibba009.xiladd (mgr.34457) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:31:58.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.074535+0000 mgr.gibba009.xiladd (mgr.34457) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:31:58.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.074574+0000 mgr.gibba009.xiladd (mgr.34457) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:31:58.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:31:58 gibba004 bash[31878]: cephadm 2021-03-10T20:31:57.074788+0000 mgr.gibba009.xiladd (mgr.34457) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:31:58.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:56.861796+0000 mgr.gibba009.xiladd (mgr.34457) 1171 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:31:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:56.872531+0000 mgr.gibba009.xiladd (mgr.34457) 1172 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:31:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cluster 2021-03-10T20:31:56.937137+0000 mgr.gibba009.xiladd (mgr.34457) 1173 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.062618+0000 mgr.gibba009.xiladd (mgr.34457) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:31:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.064516+0000 mgr.gibba009.xiladd (mgr.34457) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:31:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.065955+0000 mgr.gibba009.xiladd (mgr.34457) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:31:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.065993+0000 mgr.gibba009.xiladd (mgr.34457) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:31:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.067375+0000 mgr.gibba009.xiladd (mgr.34457) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:31:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.067413+0000 mgr.gibba009.xiladd (mgr.34457) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:31:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.068839+0000 mgr.gibba009.xiladd (mgr.34457) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:31:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.070702+0000 mgr.gibba009.xiladd (mgr.34457) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:31:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.070740+0000 mgr.gibba009.xiladd (mgr.34457) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:31:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.072298+0000 mgr.gibba009.xiladd (mgr.34457) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:31:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.072611+0000 mgr.gibba009.xiladd (mgr.34457) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:31:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.074535+0000 mgr.gibba009.xiladd (mgr.34457) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:31:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.074574+0000 mgr.gibba009.xiladd (mgr.34457) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:31:58.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:31:58 gibba009 bash[26136]: cephadm 2021-03-10T20:31:57.074788+0000 mgr.gibba009.xiladd (mgr.34457) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:00 gibba004 bash[30897]: cluster 2021-03-10T20:31:58.938280+0000 mgr.gibba009.xiladd (mgr.34457) 1188 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:00 gibba004 bash[31878]: cluster 2021-03-10T20:31:58.938280+0000 mgr.gibba009.xiladd (mgr.34457) 1188 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:00 gibba009 bash[26136]: cluster 2021-03-10T20:31:58.938280+0000 mgr.gibba009.xiladd (mgr.34457) 1188 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:02 gibba004 bash[30897]: cluster 2021-03-10T20:32:00.940117+0000 mgr.gibba009.xiladd (mgr.34457) 1189 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:02 gibba004 bash[31878]: cluster 2021-03-10T20:32:00.940117+0000 mgr.gibba009.xiladd (mgr.34457) 1189 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:02 gibba009 bash[26136]: cluster 2021-03-10T20:32:00.940117+0000 mgr.gibba009.xiladd (mgr.34457) 1189 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:04.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:04 gibba004 bash[31878]: cluster 2021-03-10T20:32:02.941635+0000 mgr.gibba009.xiladd (mgr.34457) 1190 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:04.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:04 gibba004 bash[30897]: cluster 2021-03-10T20:32:02.941635+0000 mgr.gibba009.xiladd (mgr.34457) 1190 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:04.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:04 gibba009 bash[26136]: cluster 2021-03-10T20:32:02.941635+0000 mgr.gibba009.xiladd (mgr.34457) 1190 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:06.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:06 gibba004 bash[31878]: cluster 2021-03-10T20:32:04.943291+0000 mgr.gibba009.xiladd (mgr.34457) 1191 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:06 gibba004 bash[30897]: cluster 2021-03-10T20:32:04.943291+0000 mgr.gibba009.xiladd (mgr.34457) 1191 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:06 gibba009 bash[26136]: cluster 2021-03-10T20:32:04.943291+0000 mgr.gibba009.xiladd (mgr.34457) 1191 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:08 gibba004 bash[31878]: cluster 2021-03-10T20:32:06.944549+0000 mgr.gibba009.xiladd (mgr.34457) 1192 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:08.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:08 gibba004 bash[30897]: cluster 2021-03-10T20:32:06.944549+0000 mgr.gibba009.xiladd (mgr.34457) 1192 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:08.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:08 gibba009 bash[26136]: cluster 2021-03-10T20:32:06.944549+0000 mgr.gibba009.xiladd (mgr.34457) 1192 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:10.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:10 gibba004 bash[31878]: cluster 2021-03-10T20:32:08.945968+0000 mgr.gibba009.xiladd (mgr.34457) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:10.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:10 gibba004 bash[30897]: cluster 2021-03-10T20:32:08.945968+0000 mgr.gibba009.xiladd (mgr.34457) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:10.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:10 gibba009 bash[26136]: cluster 2021-03-10T20:32:08.945968+0000 mgr.gibba009.xiladd (mgr.34457) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:12.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:12 gibba004 bash[31878]: cluster 2021-03-10T20:32:10.947830+0000 mgr.gibba009.xiladd (mgr.34457) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:12.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:12 gibba004 bash[30897]: cluster 2021-03-10T20:32:10.947830+0000 mgr.gibba009.xiladd (mgr.34457) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:12 gibba009 bash[26136]: cluster 2021-03-10T20:32:10.947830+0000 mgr.gibba009.xiladd (mgr.34457) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:13.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:13 gibba004 bash[30897]: cephadm 2021-03-10T20:32:12.090823+0000 mgr.gibba009.xiladd (mgr.34457) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:13.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:13 gibba004 bash[31878]: cephadm 2021-03-10T20:32:12.090823+0000 mgr.gibba009.xiladd (mgr.34457) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:13.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:13 gibba009 bash[26136]: cephadm 2021-03-10T20:32:12.090823+0000 mgr.gibba009.xiladd (mgr.34457) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:14 gibba004 bash[30897]: cluster 2021-03-10T20:32:12.949301+0000 mgr.gibba009.xiladd (mgr.34457) 1196 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:14 gibba004 bash[31878]: cluster 2021-03-10T20:32:12.949301+0000 mgr.gibba009.xiladd (mgr.34457) 1196 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:14.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:14 gibba009 bash[26136]: cluster 2021-03-10T20:32:12.949301+0000 mgr.gibba009.xiladd (mgr.34457) 1196 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:16.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:16 gibba004 bash[30897]: cluster 2021-03-10T20:32:14.951069+0000 mgr.gibba009.xiladd (mgr.34457) 1197 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:16.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:16 gibba004 bash[31878]: cluster 2021-03-10T20:32:14.951069+0000 mgr.gibba009.xiladd (mgr.34457) 1197 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:16 gibba009 bash[26136]: cluster 2021-03-10T20:32:14.951069+0000 mgr.gibba009.xiladd (mgr.34457) 1197 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:18.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:18 gibba004 bash[30897]: cluster 2021-03-10T20:32:16.952626+0000 mgr.gibba009.xiladd (mgr.34457) 1198 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:18 gibba004 bash[31878]: cluster 2021-03-10T20:32:16.952626+0000 mgr.gibba009.xiladd (mgr.34457) 1198 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:18.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:18 gibba009 bash[26136]: cluster 2021-03-10T20:32:16.952626+0000 mgr.gibba009.xiladd (mgr.34457) 1198 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:20.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:20 gibba004 bash[30897]: cluster 2021-03-10T20:32:18.953867+0000 mgr.gibba009.xiladd (mgr.34457) 1199 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:20 gibba004 bash[31878]: cluster 2021-03-10T20:32:18.953867+0000 mgr.gibba009.xiladd (mgr.34457) 1199 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:20 gibba009 bash[26136]: cluster 2021-03-10T20:32:18.953867+0000 mgr.gibba009.xiladd (mgr.34457) 1199 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:22 gibba004 bash[30897]: cluster 2021-03-10T20:32:20.955584+0000 mgr.gibba009.xiladd (mgr.34457) 1200 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:22 gibba004 bash[31878]: cluster 2021-03-10T20:32:20.955584+0000 mgr.gibba009.xiladd (mgr.34457) 1200 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:22.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:22 gibba009 bash[26136]: cluster 2021-03-10T20:32:20.955584+0000 mgr.gibba009.xiladd (mgr.34457) 1200 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:24 gibba004 bash[30897]: cluster 2021-03-10T20:32:22.957105+0000 mgr.gibba009.xiladd (mgr.34457) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:24 gibba004 bash[31878]: cluster 2021-03-10T20:32:22.957105+0000 mgr.gibba009.xiladd (mgr.34457) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:24 gibba009 bash[26136]: cluster 2021-03-10T20:32:22.957105+0000 mgr.gibba009.xiladd (mgr.34457) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:25.099 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:32:25.331 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:32:25.332 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (21m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:32:25.332 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (26m) 6m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:32:25.332 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (21m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:32:25.332 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:32:25.333 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:32:25.333 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:32:25.333 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:32:25.333 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:32:25.333 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:32:25.334 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:32:25.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:32:25.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:32:25.334 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:32:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:32:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:32:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:32:25.335 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:32:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:32:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (26m) 6m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:32:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:25.336 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:25.582 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:32:25.582 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:32:25.582 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:25.583 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:25.583 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:32:25.583 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:25.583 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:25.584 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:32:25.584 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:32:25.584 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:25.584 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:32:25.585 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:32:25.585 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:32:25.585 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:32:25.585 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:32:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[30897]: cluster 2021-03-10T20:32:24.960155+0000 mgr.gibba009.xiladd (mgr.34457) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[30897]: audit 2021-03-10T20:32:25.085509+0000 mgr.gibba009.xiladd (mgr.34457) 1203 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[30897]: audit 2021-03-10T20:32:25.309442+0000 mgr.gibba009.xiladd (mgr.34457) 1204 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[30897]: audit 2021-03-10T20:32:25.582161+0000 mon.c (mon.1) 398 : audit [DBG] from='client.? 172.21.2.104:0/3394075968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[31878]: cluster 2021-03-10T20:32:24.960155+0000 mgr.gibba009.xiladd (mgr.34457) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[31878]: audit 2021-03-10T20:32:25.085509+0000 mgr.gibba009.xiladd (mgr.34457) 1203 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[31878]: audit 2021-03-10T20:32:25.309442+0000 mgr.gibba009.xiladd (mgr.34457) 1204 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:26 gibba004 bash[31878]: audit 2021-03-10T20:32:25.582161+0000 mon.c (mon.1) 398 : audit [DBG] from='client.? 172.21.2.104:0/3394075968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:26 gibba009 bash[26136]: cluster 2021-03-10T20:32:24.960155+0000 mgr.gibba009.xiladd (mgr.34457) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:26 gibba009 bash[26136]: audit 2021-03-10T20:32:25.085509+0000 mgr.gibba009.xiladd (mgr.34457) 1203 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:26 gibba009 bash[26136]: audit 2021-03-10T20:32:25.309442+0000 mgr.gibba009.xiladd (mgr.34457) 1204 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:26.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:26 gibba009 bash[26136]: audit 2021-03-10T20:32:25.582161+0000 mon.c (mon.1) 398 : audit [DBG] from='client.? 172.21.2.104:0/3394075968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:28 gibba004 bash[30897]: cluster 2021-03-10T20:32:26.961609+0000 mgr.gibba009.xiladd (mgr.34457) 1205 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:28 gibba004 bash[30897]: cephadm 2021-03-10T20:32:27.105421+0000 mgr.gibba009.xiladd (mgr.34457) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:28 gibba004 bash[31878]: cluster 2021-03-10T20:32:26.961609+0000 mgr.gibba009.xiladd (mgr.34457) 1205 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:28 gibba004 bash[31878]: cephadm 2021-03-10T20:32:27.105421+0000 mgr.gibba009.xiladd (mgr.34457) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:28.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:28 gibba009 bash[26136]: cluster 2021-03-10T20:32:26.961609+0000 mgr.gibba009.xiladd (mgr.34457) 1205 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:28 gibba009 bash[26136]: cephadm 2021-03-10T20:32:27.105421+0000 mgr.gibba009.xiladd (mgr.34457) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:30 gibba004 bash[30897]: cluster 2021-03-10T20:32:28.962860+0000 mgr.gibba009.xiladd (mgr.34457) 1207 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:30 gibba004 bash[31878]: cluster 2021-03-10T20:32:28.962860+0000 mgr.gibba009.xiladd (mgr.34457) 1207 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:30 gibba009 bash[26136]: cluster 2021-03-10T20:32:28.962860+0000 mgr.gibba009.xiladd (mgr.34457) 1207 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:32 gibba004 bash[30897]: cluster 2021-03-10T20:32:30.964743+0000 mgr.gibba009.xiladd (mgr.34457) 1208 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:32 gibba004 bash[31878]: cluster 2021-03-10T20:32:30.964743+0000 mgr.gibba009.xiladd (mgr.34457) 1208 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:32 gibba009 bash[26136]: cluster 2021-03-10T20:32:30.964743+0000 mgr.gibba009.xiladd (mgr.34457) 1208 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:34 gibba004 bash[30897]: cluster 2021-03-10T20:32:32.965958+0000 mgr.gibba009.xiladd (mgr.34457) 1209 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:34 gibba004 bash[31878]: cluster 2021-03-10T20:32:32.965958+0000 mgr.gibba009.xiladd (mgr.34457) 1209 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:34.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:34 gibba009 bash[26136]: cluster 2021-03-10T20:32:32.965958+0000 mgr.gibba009.xiladd (mgr.34457) 1209 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:36 gibba004 bash[30897]: cluster 2021-03-10T20:32:34.966883+0000 mgr.gibba009.xiladd (mgr.34457) 1210 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:36 gibba004 bash[31878]: cluster 2021-03-10T20:32:34.966883+0000 mgr.gibba009.xiladd (mgr.34457) 1210 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:36 gibba009 bash[26136]: cluster 2021-03-10T20:32:34.966883+0000 mgr.gibba009.xiladd (mgr.34457) 1210 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:38.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:38 gibba004 bash[30897]: cluster 2021-03-10T20:32:36.968240+0000 mgr.gibba009.xiladd (mgr.34457) 1211 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:38 gibba004 bash[31878]: cluster 2021-03-10T20:32:36.968240+0000 mgr.gibba009.xiladd (mgr.34457) 1211 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:38 gibba009 bash[26136]: cluster 2021-03-10T20:32:36.968240+0000 mgr.gibba009.xiladd (mgr.34457) 1211 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: cluster 2021-03-10T20:32:38.969736+0000 mgr.gibba009.xiladd (mgr.34457) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.655784+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.656531+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.657023+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.657230+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.658063+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.658621+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.659638+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.660458+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.701286+0000 mon.c (mon.1) 403 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.701913+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.702449+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:40 gibba009 bash[26136]: audit 2021-03-10T20:32:39.703465+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: cluster 2021-03-10T20:32:38.969736+0000 mgr.gibba009.xiladd (mgr.34457) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.655784+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.656531+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.657023+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.657230+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.658063+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.658621+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.659638+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.660458+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.701286+0000 mon.c (mon.1) 403 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.701913+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.702449+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[30897]: audit 2021-03-10T20:32:39.703465+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: cluster 2021-03-10T20:32:38.969736+0000 mgr.gibba009.xiladd (mgr.34457) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.655784+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.656531+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.657023+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:32:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.657230+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.658063+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.658621+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:32:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.659638+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.660458+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.701286+0000 mon.c (mon.1) 403 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.701913+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.702449+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:40 gibba004 bash[31878]: audit 2021-03-10T20:32:39.703465+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:42 gibba009 bash[26136]: cluster 2021-03-10T20:32:40.971324+0000 mgr.gibba009.xiladd (mgr.34457) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:42 gibba004 bash[30897]: cluster 2021-03-10T20:32:40.971324+0000 mgr.gibba009.xiladd (mgr.34457) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:42 gibba004 bash[31878]: cluster 2021-03-10T20:32:40.971324+0000 mgr.gibba009.xiladd (mgr.34457) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:43.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:43 gibba009 bash[26136]: cephadm 2021-03-10T20:32:42.121549+0000 mgr.gibba009.xiladd (mgr.34457) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:43.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:43 gibba004 bash[30897]: cephadm 2021-03-10T20:32:42.121549+0000 mgr.gibba009.xiladd (mgr.34457) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:43.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:43 gibba004 bash[31878]: cephadm 2021-03-10T20:32:42.121549+0000 mgr.gibba009.xiladd (mgr.34457) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:44.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:44 gibba004 bash[30897]: cluster 2021-03-10T20:32:42.972886+0000 mgr.gibba009.xiladd (mgr.34457) 1215 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:44 gibba004 bash[31878]: cluster 2021-03-10T20:32:42.972886+0000 mgr.gibba009.xiladd (mgr.34457) 1215 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:44 gibba009 bash[26136]: cluster 2021-03-10T20:32:42.972886+0000 mgr.gibba009.xiladd (mgr.34457) 1215 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:46 gibba004 bash[30897]: cluster 2021-03-10T20:32:44.975499+0000 mgr.gibba009.xiladd (mgr.34457) 1216 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:46 gibba004 bash[31878]: cluster 2021-03-10T20:32:44.975499+0000 mgr.gibba009.xiladd (mgr.34457) 1216 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:46 gibba009 bash[26136]: cluster 2021-03-10T20:32:44.975499+0000 mgr.gibba009.xiladd (mgr.34457) 1216 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:48 gibba004 bash[30897]: cluster 2021-03-10T20:32:46.977169+0000 mgr.gibba009.xiladd (mgr.34457) 1217 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:48 gibba004 bash[31878]: cluster 2021-03-10T20:32:46.977169+0000 mgr.gibba009.xiladd (mgr.34457) 1217 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:48 gibba009 bash[26136]: cluster 2021-03-10T20:32:46.977169+0000 mgr.gibba009.xiladd (mgr.34457) 1217 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:50 gibba004 bash[30897]: cluster 2021-03-10T20:32:48.978607+0000 mgr.gibba009.xiladd (mgr.34457) 1218 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:50 gibba004 bash[31878]: cluster 2021-03-10T20:32:48.978607+0000 mgr.gibba009.xiladd (mgr.34457) 1218 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:50 gibba009 bash[26136]: cluster 2021-03-10T20:32:48.978607+0000 mgr.gibba009.xiladd (mgr.34457) 1218 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:52.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:52 gibba004 bash[30897]: cluster 2021-03-10T20:32:50.979138+0000 mgr.gibba009.xiladd (mgr.34457) 1219 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:52 gibba004 bash[31878]: cluster 2021-03-10T20:32:50.979138+0000 mgr.gibba009.xiladd (mgr.34457) 1219 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:52 gibba009 bash[26136]: cluster 2021-03-10T20:32:50.979138+0000 mgr.gibba009.xiladd (mgr.34457) 1219 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:54 gibba004 bash[30897]: cluster 2021-03-10T20:32:52.980572+0000 mgr.gibba009.xiladd (mgr.34457) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:54 gibba004 bash[31878]: cluster 2021-03-10T20:32:52.980572+0000 mgr.gibba009.xiladd (mgr.34457) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:54 gibba009 bash[26136]: cluster 2021-03-10T20:32:52.980572+0000 mgr.gibba009.xiladd (mgr.34457) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:55.825 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:32:56.053 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:32:56.053 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (21m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:32:56.054 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:32:56.054 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (22m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:32:56.054 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (22m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:32:56.054 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:32:56.055 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:32:56.055 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:32:56.055 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:32:56.055 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:32:56.055 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:32:56.056 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:32:56.056 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:32:56.056 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:32:56.056 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:32:56.057 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:32:56.057 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:32:56.057 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:32:56.057 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (17m) 7m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:32:56.057 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (26m) 7m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:32:56.058 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:56.058 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:56.302 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:32:56.302 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:32:56.303 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:56.303 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:56.303 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:32:56.303 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:56.304 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:56.304 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:32:56.304 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:32:56.304 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:32:56.304 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:32:56.305 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:32:56.305 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:32:56.305 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:32:56.305 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:32:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:56 gibba004 bash[30897]: cluster 2021-03-10T20:32:54.981531+0000 mgr.gibba009.xiladd (mgr.34457) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:56 gibba004 bash[30897]: audit 2021-03-10T20:32:56.302153+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.2.104:0/535708393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:56 gibba004 bash[31878]: cluster 2021-03-10T20:32:54.981531+0000 mgr.gibba009.xiladd (mgr.34457) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:56 gibba004 bash[31878]: audit 2021-03-10T20:32:56.302153+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.2.104:0/535708393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:56 gibba009 bash[26136]: cluster 2021-03-10T20:32:54.981531+0000 mgr.gibba009.xiladd (mgr.34457) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:56 gibba009 bash[26136]: audit 2021-03-10T20:32:56.302153+0000 mon.a (mon.0) 728 : audit [DBG] from='client.? 172.21.2.104:0/535708393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:55.815541+0000 mgr.gibba009.xiladd (mgr.34457) 1222 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:56.039711+0000 mgr.gibba009.xiladd (mgr.34457) 1223 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cluster 2021-03-10T20:32:56.983037+0000 mgr.gibba009.xiladd (mgr.34457) 1224 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.139405+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.143734+0000 mgr.gibba009.xiladd (mgr.34457) 1225 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:32:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.145565+0000 mgr.gibba009.xiladd (mgr.34457) 1226 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:32:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.358188+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:32:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.360356+0000 mgr.gibba009.xiladd (mgr.34457) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:57.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.362475+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.362567+0000 mgr.gibba009.xiladd (mgr.34457) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.364136+0000 mgr.gibba009.xiladd (mgr.34457) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.364176+0000 mgr.gibba009.xiladd (mgr.34457) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:57.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.364345+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.365544+0000 mgr.gibba009.xiladd (mgr.34457) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.365584+0000 mgr.gibba009.xiladd (mgr.34457) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.365801+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.366611+0000 mgr.gibba009.xiladd (mgr.34457) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.367020+0000 mon.c (mon.1) 409 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.368088+0000 mgr.gibba009.xiladd (mgr.34457) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.368128+0000 mgr.gibba009.xiladd (mgr.34457) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:57.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:55.815541+0000 mgr.gibba009.xiladd (mgr.34457) 1222 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:56.039711+0000 mgr.gibba009.xiladd (mgr.34457) 1223 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cluster 2021-03-10T20:32:56.983037+0000 mgr.gibba009.xiladd (mgr.34457) 1224 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.139405+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.143734+0000 mgr.gibba009.xiladd (mgr.34457) 1225 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:32:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.145565+0000 mgr.gibba009.xiladd (mgr.34457) 1226 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:32:57.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.358188+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:32:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.360356+0000 mgr.gibba009.xiladd (mgr.34457) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.362475+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.362567+0000 mgr.gibba009.xiladd (mgr.34457) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:57.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.364136+0000 mgr.gibba009.xiladd (mgr.34457) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.364176+0000 mgr.gibba009.xiladd (mgr.34457) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.364345+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.365544+0000 mgr.gibba009.xiladd (mgr.34457) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:57.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.365584+0000 mgr.gibba009.xiladd (mgr.34457) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.365801+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.366611+0000 mgr.gibba009.xiladd (mgr.34457) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.367020+0000 mon.c (mon.1) 409 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.368088+0000 mgr.gibba009.xiladd (mgr.34457) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.368128+0000 mgr.gibba009.xiladd (mgr.34457) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:57.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.369539+0000 mgr.gibba009.xiladd (mgr.34457) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:57.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.369829+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.369870+0000 mgr.gibba009.xiladd (mgr.34457) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:57.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.370938+0000 mgr.gibba009.xiladd (mgr.34457) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:57.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.370979+0000 mgr.gibba009.xiladd (mgr.34457) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:57.825 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: cephadm 2021-03-10T20:32:57.371135+0000 mgr.gibba009.xiladd (mgr.34457) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:57.826 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[30897]: audit 2021-03-10T20:32:57.371265+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.369539+0000 mgr.gibba009.xiladd (mgr.34457) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.369829+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.369870+0000 mgr.gibba009.xiladd (mgr.34457) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.370938+0000 mgr.gibba009.xiladd (mgr.34457) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.370979+0000 mgr.gibba009.xiladd (mgr.34457) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:57.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: cephadm 2021-03-10T20:32:57.371135+0000 mgr.gibba009.xiladd (mgr.34457) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:57.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:32:57 gibba004 bash[31878]: audit 2021-03-10T20:32:57.371265+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:55.815541+0000 mgr.gibba009.xiladd (mgr.34457) 1222 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:56.039711+0000 mgr.gibba009.xiladd (mgr.34457) 1223 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:57.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cluster 2021-03-10T20:32:56.983037+0000 mgr.gibba009.xiladd (mgr.34457) 1224 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.139405+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.143734+0000 mgr.gibba009.xiladd (mgr.34457) 1225 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:32:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.145565+0000 mgr.gibba009.xiladd (mgr.34457) 1226 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:32:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.358188+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:32:57.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.360356+0000 mgr.gibba009.xiladd (mgr.34457) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.362475+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.362567+0000 mgr.gibba009.xiladd (mgr.34457) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.364136+0000 mgr.gibba009.xiladd (mgr.34457) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:57.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.364176+0000 mgr.gibba009.xiladd (mgr.34457) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.364345+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.365544+0000 mgr.gibba009.xiladd (mgr.34457) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.365584+0000 mgr.gibba009.xiladd (mgr.34457) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.365801+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.366611+0000 mgr.gibba009.xiladd (mgr.34457) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.367020+0000 mon.c (mon.1) 409 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.368088+0000 mgr.gibba009.xiladd (mgr.34457) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.368128+0000 mgr.gibba009.xiladd (mgr.34457) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.369539+0000 mgr.gibba009.xiladd (mgr.34457) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.369829+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.369870+0000 mgr.gibba009.xiladd (mgr.34457) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.370938+0000 mgr.gibba009.xiladd (mgr.34457) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.370979+0000 mgr.gibba009.xiladd (mgr.34457) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: cephadm 2021-03-10T20:32:57.371135+0000 mgr.gibba009.xiladd (mgr.34457) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:32:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:32:57 gibba009 bash[26136]: audit 2021-03-10T20:32:57.371265+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:00 gibba004 bash[30897]: cluster 2021-03-10T20:32:58.983533+0000 mgr.gibba009.xiladd (mgr.34457) 1241 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:00.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:00 gibba004 bash[31878]: cluster 2021-03-10T20:32:58.983533+0000 mgr.gibba009.xiladd (mgr.34457) 1241 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:00.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:00 gibba009 bash[26136]: cluster 2021-03-10T20:32:58.983533+0000 mgr.gibba009.xiladd (mgr.34457) 1241 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:02 gibba004 bash[30897]: cluster 2021-03-10T20:33:00.985159+0000 mgr.gibba009.xiladd (mgr.34457) 1242 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:02 gibba004 bash[31878]: cluster 2021-03-10T20:33:00.985159+0000 mgr.gibba009.xiladd (mgr.34457) 1242 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:02 gibba009 bash[26136]: cluster 2021-03-10T20:33:00.985159+0000 mgr.gibba009.xiladd (mgr.34457) 1242 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:04.337 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:04 gibba009 bash[26136]: cluster 2021-03-10T20:33:02.986663+0000 mgr.gibba009.xiladd (mgr.34457) 1243 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:04 gibba004 bash[30897]: cluster 2021-03-10T20:33:02.986663+0000 mgr.gibba009.xiladd (mgr.34457) 1243 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:04 gibba004 bash[31878]: cluster 2021-03-10T20:33:02.986663+0000 mgr.gibba009.xiladd (mgr.34457) 1243 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:06 gibba009 bash[26136]: cluster 2021-03-10T20:33:04.988291+0000 mgr.gibba009.xiladd (mgr.34457) 1244 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:06 gibba004 bash[30897]: cluster 2021-03-10T20:33:04.988291+0000 mgr.gibba009.xiladd (mgr.34457) 1244 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:06 gibba004 bash[31878]: cluster 2021-03-10T20:33:04.988291+0000 mgr.gibba009.xiladd (mgr.34457) 1244 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:08.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:08 gibba009 bash[26136]: cluster 2021-03-10T20:33:06.989168+0000 mgr.gibba009.xiladd (mgr.34457) 1245 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:08 gibba004 bash[30897]: cluster 2021-03-10T20:33:06.989168+0000 mgr.gibba009.xiladd (mgr.34457) 1245 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:08 gibba004 bash[31878]: cluster 2021-03-10T20:33:06.989168+0000 mgr.gibba009.xiladd (mgr.34457) 1245 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:10 gibba004 bash[30897]: cluster 2021-03-10T20:33:08.990299+0000 mgr.gibba009.xiladd (mgr.34457) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:10 gibba004 bash[31878]: cluster 2021-03-10T20:33:08.990299+0000 mgr.gibba009.xiladd (mgr.34457) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:10 gibba009 bash[26136]: cluster 2021-03-10T20:33:08.990299+0000 mgr.gibba009.xiladd (mgr.34457) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.387 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:12 gibba009 bash[26136]: cluster 2021-03-10T20:33:10.992092+0000 mgr.gibba009.xiladd (mgr.34457) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:12 gibba004 bash[30897]: cluster 2021-03-10T20:33:10.992092+0000 mgr.gibba009.xiladd (mgr.34457) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:12 gibba004 bash[31878]: cluster 2021-03-10T20:33:10.992092+0000 mgr.gibba009.xiladd (mgr.34457) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:13.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:13 gibba004 bash[30897]: cephadm 2021-03-10T20:33:12.385582+0000 mgr.gibba009.xiladd (mgr.34457) 1248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:13.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:13 gibba004 bash[31878]: cephadm 2021-03-10T20:33:12.385582+0000 mgr.gibba009.xiladd (mgr.34457) 1248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:13.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:13 gibba009 bash[26136]: cephadm 2021-03-10T20:33:12.385582+0000 mgr.gibba009.xiladd (mgr.34457) 1248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:14.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:14 gibba004 bash[30897]: cluster 2021-03-10T20:33:12.993632+0000 mgr.gibba009.xiladd (mgr.34457) 1249 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:14 gibba004 bash[31878]: cluster 2021-03-10T20:33:12.993632+0000 mgr.gibba009.xiladd (mgr.34457) 1249 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:14.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:14 gibba009 bash[26136]: cluster 2021-03-10T20:33:12.993632+0000 mgr.gibba009.xiladd (mgr.34457) 1249 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:16 gibba004 bash[30897]: cluster 2021-03-10T20:33:14.994436+0000 mgr.gibba009.xiladd (mgr.34457) 1250 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:16 gibba004 bash[31878]: cluster 2021-03-10T20:33:14.994436+0000 mgr.gibba009.xiladd (mgr.34457) 1250 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:16 gibba009 bash[26136]: cluster 2021-03-10T20:33:14.994436+0000 mgr.gibba009.xiladd (mgr.34457) 1250 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:18 gibba004 bash[30897]: cluster 2021-03-10T20:33:16.995781+0000 mgr.gibba009.xiladd (mgr.34457) 1251 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:18 gibba004 bash[31878]: cluster 2021-03-10T20:33:16.995781+0000 mgr.gibba009.xiladd (mgr.34457) 1251 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:18 gibba009 bash[26136]: cluster 2021-03-10T20:33:16.995781+0000 mgr.gibba009.xiladd (mgr.34457) 1251 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:20 gibba004 bash[30897]: cluster 2021-03-10T20:33:18.997368+0000 mgr.gibba009.xiladd (mgr.34457) 1252 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:20 gibba004 bash[31878]: cluster 2021-03-10T20:33:18.997368+0000 mgr.gibba009.xiladd (mgr.34457) 1252 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:20 gibba009 bash[26136]: cluster 2021-03-10T20:33:18.997368+0000 mgr.gibba009.xiladd (mgr.34457) 1252 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:22 gibba004 bash[30897]: cluster 2021-03-10T20:33:20.999100+0000 mgr.gibba009.xiladd (mgr.34457) 1253 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:22 gibba004 bash[31878]: cluster 2021-03-10T20:33:20.999100+0000 mgr.gibba009.xiladd (mgr.34457) 1253 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:22 gibba009 bash[26136]: cluster 2021-03-10T20:33:20.999100+0000 mgr.gibba009.xiladd (mgr.34457) 1253 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:24 gibba004 bash[30897]: cluster 2021-03-10T20:33:23.000500+0000 mgr.gibba009.xiladd (mgr.34457) 1254 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:24 gibba004 bash[31878]: cluster 2021-03-10T20:33:23.000500+0000 mgr.gibba009.xiladd (mgr.34457) 1254 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:24 gibba009 bash[26136]: cluster 2021-03-10T20:33:23.000500+0000 mgr.gibba009.xiladd (mgr.34457) 1254 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.544 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:33:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:26 gibba004 bash[30897]: cluster 2021-03-10T20:33:25.002037+0000 mgr.gibba009.xiladd (mgr.34457) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:26 gibba004 bash[31878]: cluster 2021-03-10T20:33:25.002037+0000 mgr.gibba009.xiladd (mgr.34457) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:26 gibba009 bash[26136]: cluster 2021-03-10T20:33:25.002037+0000 mgr.gibba009.xiladd (mgr.34457) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.780 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:33:26.780 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (22m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:33:26.780 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:33:26.781 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (22m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:33:26.781 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:33:26.781 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:33:26.781 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:33:26.782 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:33:26.782 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:33:26.782 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:33:26.782 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:33:26.782 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:33:26.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:33:26.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:33:26.783 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:33:26.785 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:33:26.785 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:33:26.786 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:33:26.786 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:33:26.786 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (27m) 7m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:33:26.786 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:26.786 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:27.029 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:33:27.030 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:33:27.030 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:27.030 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:27.030 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:33:27.031 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:27.031 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:27.031 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:33:27.031 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:33:27.032 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:27.032 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:33:27.032 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:33:27.032 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:33:27.032 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:33:27.033 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:33:27.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:27 gibba004 bash[30897]: audit 2021-03-10T20:33:27.029564+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.2.104:0/3896401766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:27.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:27 gibba004 bash[31878]: audit 2021-03-10T20:33:27.029564+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.2.104:0/3896401766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:27.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:27 gibba009 bash[26136]: audit 2021-03-10T20:33:27.029564+0000 mon.a (mon.0) 730 : audit [DBG] from='client.? 172.21.2.104:0/3896401766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[30897]: audit 2021-03-10T20:33:26.534431+0000 mgr.gibba009.xiladd (mgr.34457) 1256 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[30897]: audit 2021-03-10T20:33:26.762537+0000 mgr.gibba009.xiladd (mgr.34457) 1257 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[30897]: cluster 2021-03-10T20:33:27.003530+0000 mgr.gibba009.xiladd (mgr.34457) 1258 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[31878]: audit 2021-03-10T20:33:26.534431+0000 mgr.gibba009.xiladd (mgr.34457) 1256 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[31878]: audit 2021-03-10T20:33:26.762537+0000 mgr.gibba009.xiladd (mgr.34457) 1257 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:28 gibba004 bash[31878]: cluster 2021-03-10T20:33:27.003530+0000 mgr.gibba009.xiladd (mgr.34457) 1258 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:28 gibba009 bash[26136]: audit 2021-03-10T20:33:26.534431+0000 mgr.gibba009.xiladd (mgr.34457) 1256 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:28 gibba009 bash[26136]: audit 2021-03-10T20:33:26.762537+0000 mgr.gibba009.xiladd (mgr.34457) 1257 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:28 gibba009 bash[26136]: cluster 2021-03-10T20:33:27.003530+0000 mgr.gibba009.xiladd (mgr.34457) 1258 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:29.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:29 gibba004 bash[30897]: cephadm 2021-03-10T20:33:27.401612+0000 mgr.gibba009.xiladd (mgr.34457) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:29.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:29 gibba004 bash[31878]: cephadm 2021-03-10T20:33:27.401612+0000 mgr.gibba009.xiladd (mgr.34457) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:29.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:29 gibba009 bash[26136]: cephadm 2021-03-10T20:33:27.401612+0000 mgr.gibba009.xiladd (mgr.34457) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:30 gibba004 bash[30897]: cluster 2021-03-10T20:33:29.004967+0000 mgr.gibba009.xiladd (mgr.34457) 1260 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:30 gibba004 bash[31878]: cluster 2021-03-10T20:33:29.004967+0000 mgr.gibba009.xiladd (mgr.34457) 1260 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:30 gibba009 bash[26136]: cluster 2021-03-10T20:33:29.004967+0000 mgr.gibba009.xiladd (mgr.34457) 1260 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:32 gibba004 bash[30897]: cluster 2021-03-10T20:33:31.005691+0000 mgr.gibba009.xiladd (mgr.34457) 1261 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:32 gibba004 bash[31878]: cluster 2021-03-10T20:33:31.005691+0000 mgr.gibba009.xiladd (mgr.34457) 1261 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:32 gibba009 bash[26136]: cluster 2021-03-10T20:33:31.005691+0000 mgr.gibba009.xiladd (mgr.34457) 1261 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:34 gibba004 bash[30897]: cluster 2021-03-10T20:33:33.006820+0000 mgr.gibba009.xiladd (mgr.34457) 1262 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:34 gibba004 bash[31878]: cluster 2021-03-10T20:33:33.006820+0000 mgr.gibba009.xiladd (mgr.34457) 1262 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:34 gibba009 bash[26136]: cluster 2021-03-10T20:33:33.006820+0000 mgr.gibba009.xiladd (mgr.34457) 1262 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:36 gibba004 bash[30897]: cluster 2021-03-10T20:33:35.007772+0000 mgr.gibba009.xiladd (mgr.34457) 1263 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:36 gibba004 bash[31878]: cluster 2021-03-10T20:33:35.007772+0000 mgr.gibba009.xiladd (mgr.34457) 1263 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:36 gibba009 bash[26136]: cluster 2021-03-10T20:33:35.007772+0000 mgr.gibba009.xiladd (mgr.34457) 1263 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:38 gibba004 bash[30897]: cluster 2021-03-10T20:33:37.009062+0000 mgr.gibba009.xiladd (mgr.34457) 1264 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:38 gibba004 bash[31878]: cluster 2021-03-10T20:33:37.009062+0000 mgr.gibba009.xiladd (mgr.34457) 1264 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:38 gibba009 bash[26136]: cluster 2021-03-10T20:33:37.009062+0000 mgr.gibba009.xiladd (mgr.34457) 1264 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: cluster 2021-03-10T20:33:39.009683+0000 mgr.gibba009.xiladd (mgr.34457) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.665613+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.666533+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.666811+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.667443+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.668259+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.668591+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.669334+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.669814+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.706117+0000 mon.c (mon.1) 416 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.706349+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.706511+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[30897]: audit 2021-03-10T20:33:39.706745+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: cluster 2021-03-10T20:33:39.009683+0000 mgr.gibba009.xiladd (mgr.34457) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.665613+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.666533+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.666811+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.667443+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.668259+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.668591+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.669334+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.669814+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.706117+0000 mon.c (mon.1) 416 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.706349+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.706511+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:40 gibba004 bash[31878]: audit 2021-03-10T20:33:39.706745+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: cluster 2021-03-10T20:33:39.009683+0000 mgr.gibba009.xiladd (mgr.34457) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.665613+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.666533+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.666811+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:33:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.667443+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.668259+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.668591+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.669334+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:33:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.669814+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:33:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.706117+0000 mon.c (mon.1) 416 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.706349+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.706511+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:40 gibba009 bash[26136]: audit 2021-03-10T20:33:39.706745+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:42 gibba004 bash[30897]: cluster 2021-03-10T20:33:41.011154+0000 mgr.gibba009.xiladd (mgr.34457) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:42 gibba004 bash[31878]: cluster 2021-03-10T20:33:41.011154+0000 mgr.gibba009.xiladd (mgr.34457) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:42 gibba009 bash[26136]: cluster 2021-03-10T20:33:41.011154+0000 mgr.gibba009.xiladd (mgr.34457) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:44.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:44 gibba004 bash[30897]: cephadm 2021-03-10T20:33:42.417706+0000 mgr.gibba009.xiladd (mgr.34457) 1267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:44 gibba004 bash[30897]: cluster 2021-03-10T20:33:43.012785+0000 mgr.gibba009.xiladd (mgr.34457) 1268 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:44 gibba004 bash[31878]: cephadm 2021-03-10T20:33:42.417706+0000 mgr.gibba009.xiladd (mgr.34457) 1267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:44 gibba004 bash[31878]: cluster 2021-03-10T20:33:43.012785+0000 mgr.gibba009.xiladd (mgr.34457) 1268 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:44.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:44 gibba009 bash[26136]: cephadm 2021-03-10T20:33:42.417706+0000 mgr.gibba009.xiladd (mgr.34457) 1267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:33:44.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:44 gibba009 bash[26136]: cluster 2021-03-10T20:33:43.012785+0000 mgr.gibba009.xiladd (mgr.34457) 1268 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:46 gibba004 bash[30897]: cluster 2021-03-10T20:33:45.013467+0000 mgr.gibba009.xiladd (mgr.34457) 1269 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:46 gibba004 bash[31878]: cluster 2021-03-10T20:33:45.013467+0000 mgr.gibba009.xiladd (mgr.34457) 1269 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:46.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:46 gibba009 bash[26136]: cluster 2021-03-10T20:33:45.013467+0000 mgr.gibba009.xiladd (mgr.34457) 1269 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:48 gibba004 bash[30897]: cluster 2021-03-10T20:33:47.014234+0000 mgr.gibba009.xiladd (mgr.34457) 1270 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:48 gibba004 bash[31878]: cluster 2021-03-10T20:33:47.014234+0000 mgr.gibba009.xiladd (mgr.34457) 1270 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:48 gibba009 bash[26136]: cluster 2021-03-10T20:33:47.014234+0000 mgr.gibba009.xiladd (mgr.34457) 1270 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:50 gibba004 bash[30897]: cluster 2021-03-10T20:33:49.015324+0000 mgr.gibba009.xiladd (mgr.34457) 1271 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:50 gibba004 bash[31878]: cluster 2021-03-10T20:33:49.015324+0000 mgr.gibba009.xiladd (mgr.34457) 1271 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:50 gibba009 bash[26136]: cluster 2021-03-10T20:33:49.015324+0000 mgr.gibba009.xiladd (mgr.34457) 1271 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:52 gibba004 bash[30897]: cluster 2021-03-10T20:33:51.017093+0000 mgr.gibba009.xiladd (mgr.34457) 1272 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:52 gibba004 bash[31878]: cluster 2021-03-10T20:33:51.017093+0000 mgr.gibba009.xiladd (mgr.34457) 1272 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:52.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:52 gibba009 bash[26136]: cluster 2021-03-10T20:33:51.017093+0000 mgr.gibba009.xiladd (mgr.34457) 1272 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:54 gibba004 bash[30897]: cluster 2021-03-10T20:33:53.018452+0000 mgr.gibba009.xiladd (mgr.34457) 1273 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:54 gibba004 bash[31878]: cluster 2021-03-10T20:33:53.018452+0000 mgr.gibba009.xiladd (mgr.34457) 1273 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:54 gibba009 bash[26136]: cluster 2021-03-10T20:33:53.018452+0000 mgr.gibba009.xiladd (mgr.34457) 1273 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:56 gibba009 bash[26136]: cluster 2021-03-10T20:33:55.019123+0000 mgr.gibba009.xiladd (mgr.34457) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:56 gibba004 bash[30897]: cluster 2021-03-10T20:33:55.019123+0000 mgr.gibba009.xiladd (mgr.34457) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:56 gibba004 bash[31878]: cluster 2021-03-10T20:33:55.019123+0000 mgr.gibba009.xiladd (mgr.34457) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:57.317 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:33:57.538 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:33:57.539 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (22m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:33:57.539 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:33:57.540 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (23m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:33:57.540 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (23m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:33:57.541 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:33:57.541 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:33:57.542 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:33:57.542 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:33:57.542 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:33:57.543 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:33:57.543 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:33:57.544 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:33:57.544 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:33:57.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:33:57.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:33:57.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:33:57.546 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:33:57.546 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (18m) 8m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:33:57.547 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (27m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:33:57.547 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:57.548 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:57.792 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:33:57.793 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:33:57.793 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:57.793 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:57.793 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:33:57.794 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:57.794 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:57.794 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:33:57.794 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:33:57.795 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:33:57.795 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:33:57.795 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:33:57.795 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:33:57.795 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:33:57.796 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:33:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:58 gibba009 bash[26136]: cluster 2021-03-10T20:33:57.020719+0000 mgr.gibba009.xiladd (mgr.34457) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:58 gibba009 bash[26136]: audit 2021-03-10T20:33:57.305884+0000 mgr.gibba009.xiladd (mgr.34457) 1276 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:58 gibba009 bash[26136]: audit 2021-03-10T20:33:57.435250+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:58 gibba009 bash[26136]: audit 2021-03-10T20:33:57.440036+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:58.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:58 gibba009 bash[26136]: audit 2021-03-10T20:33:57.792635+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.104:0/640097498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:58.640 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[30897]: cluster 2021-03-10T20:33:57.020719+0000 mgr.gibba009.xiladd (mgr.34457) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:58.641 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[30897]: audit 2021-03-10T20:33:57.305884+0000 mgr.gibba009.xiladd (mgr.34457) 1276 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:58.641 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[30897]: audit 2021-03-10T20:33:57.435250+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:58.641 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[30897]: audit 2021-03-10T20:33:57.440036+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:58.642 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[30897]: audit 2021-03-10T20:33:57.792635+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.104:0/640097498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:58.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[31878]: cluster 2021-03-10T20:33:57.020719+0000 mgr.gibba009.xiladd (mgr.34457) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:58.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[31878]: audit 2021-03-10T20:33:57.305884+0000 mgr.gibba009.xiladd (mgr.34457) 1276 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:58.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[31878]: audit 2021-03-10T20:33:57.435250+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:58.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[31878]: audit 2021-03-10T20:33:57.440036+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:58.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:58 gibba004 bash[31878]: audit 2021-03-10T20:33:57.792635+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.104:0/640097498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:59.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:59 gibba009 bash[26136]: cephadm 2021-03-10T20:33:57.438889+0000 mgr.gibba009.xiladd (mgr.34457) 1277 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:33:59.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:33:59 gibba009 bash[26136]: audit 2021-03-10T20:33:57.529091+0000 mgr.gibba009.xiladd (mgr.34457) 1278 : audit [DBG] from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:59.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:59 gibba004 bash[30897]: cephadm 2021-03-10T20:33:57.438889+0000 mgr.gibba009.xiladd (mgr.34457) 1277 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:33:59.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:33:59 gibba004 bash[30897]: audit 2021-03-10T20:33:57.529091+0000 mgr.gibba009.xiladd (mgr.34457) 1278 : audit [DBG] from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:59.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:59 gibba004 bash[31878]: cephadm 2021-03-10T20:33:57.438889+0000 mgr.gibba009.xiladd (mgr.34457) 1277 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:33:59.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:33:59 gibba004 bash[31878]: audit 2021-03-10T20:33:57.529091+0000 mgr.gibba009.xiladd (mgr.34457) 1278 : audit [DBG] from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:00 gibba004 bash[30897]: cluster 2021-03-10T20:33:59.022069+0000 mgr.gibba009.xiladd (mgr.34457) 1279 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:00 gibba004 bash[31878]: cluster 2021-03-10T20:33:59.022069+0000 mgr.gibba009.xiladd (mgr.34457) 1279 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:00 gibba009 bash[26136]: cluster 2021-03-10T20:33:59.022069+0000 mgr.gibba009.xiladd (mgr.34457) 1279 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[30897]: cluster 2021-03-10T20:34:01.023832+0000 mgr.gibba009.xiladd (mgr.34457) 1280 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[30897]: audit 2021-03-10T20:34:02.017518+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:02.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[30897]: audit 2021-03-10T20:34:02.208331+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[31878]: cluster 2021-03-10T20:34:01.023832+0000 mgr.gibba009.xiladd (mgr.34457) 1280 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[31878]: audit 2021-03-10T20:34:02.017518+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:02 gibba004 bash[31878]: audit 2021-03-10T20:34:02.208331+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:02 gibba009 bash[26136]: cluster 2021-03-10T20:34:01.023832+0000 mgr.gibba009.xiladd (mgr.34457) 1280 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:02 gibba009 bash[26136]: audit 2021-03-10T20:34:02.017518+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:02.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:02 gibba009 bash[26136]: audit 2021-03-10T20:34:02.208331+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.209526+0000 mgr.gibba009.xiladd (mgr.34457) 1281 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:34:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.437481+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.445457+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.447327+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.449234+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.451091+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.454521+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[30897]: audit 2021-03-10T20:34:02.456415+0000 mon.c (mon.1) 426 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.209526+0000 mgr.gibba009.xiladd (mgr.34457) 1281 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:34:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.437481+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:03.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.445457+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.447327+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.449234+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.451091+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.454521+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:03 gibba004 bash[31878]: audit 2021-03-10T20:34:02.456415+0000 mon.c (mon.1) 426 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.209526+0000 mgr.gibba009.xiladd (mgr.34457) 1281 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:34:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.437481+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:34:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.445457+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.447327+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.449234+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.451091+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.454521+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:03.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:03 gibba009 bash[26136]: audit 2021-03-10T20:34:02.456415+0000 mon.c (mon.1) 426 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:04.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.443254+0000 mgr.gibba009.xiladd (mgr.34457) 1282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:04.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.445541+0000 mgr.gibba009.xiladd (mgr.34457) 1283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:04.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.447300+0000 mgr.gibba009.xiladd (mgr.34457) 1284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:04.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.447347+0000 mgr.gibba009.xiladd (mgr.34457) 1285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:04.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.449338+0000 mgr.gibba009.xiladd (mgr.34457) 1286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:04.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.449388+0000 mgr.gibba009.xiladd (mgr.34457) 1287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:04.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.450777+0000 mgr.gibba009.xiladd (mgr.34457) 1288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:04.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.452655+0000 mgr.gibba009.xiladd (mgr.34457) 1289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:04.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.452719+0000 mgr.gibba009.xiladd (mgr.34457) 1290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:04.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.454314+0000 mgr.gibba009.xiladd (mgr.34457) 1291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:04.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.454742+0000 mgr.gibba009.xiladd (mgr.34457) 1292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:04.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.456175+0000 mgr.gibba009.xiladd (mgr.34457) 1293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:04.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.456229+0000 mgr.gibba009.xiladd (mgr.34457) 1294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:04.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cephadm 2021-03-10T20:34:02.456403+0000 mgr.gibba009.xiladd (mgr.34457) 1295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:04.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[30897]: cluster 2021-03-10T20:34:03.024576+0000 mgr.gibba009.xiladd (mgr.34457) 1296 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:04.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.443254+0000 mgr.gibba009.xiladd (mgr.34457) 1282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:04.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.445541+0000 mgr.gibba009.xiladd (mgr.34457) 1283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:04.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.447300+0000 mgr.gibba009.xiladd (mgr.34457) 1284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:04.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.447347+0000 mgr.gibba009.xiladd (mgr.34457) 1285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:04.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.449338+0000 mgr.gibba009.xiladd (mgr.34457) 1286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:04.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.449388+0000 mgr.gibba009.xiladd (mgr.34457) 1287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:04.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.450777+0000 mgr.gibba009.xiladd (mgr.34457) 1288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:04.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.452655+0000 mgr.gibba009.xiladd (mgr.34457) 1289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:04.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.452719+0000 mgr.gibba009.xiladd (mgr.34457) 1290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:04.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.454314+0000 mgr.gibba009.xiladd (mgr.34457) 1291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:04.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.454742+0000 mgr.gibba009.xiladd (mgr.34457) 1292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:04.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.456175+0000 mgr.gibba009.xiladd (mgr.34457) 1293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:04.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.456229+0000 mgr.gibba009.xiladd (mgr.34457) 1294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:04.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cephadm 2021-03-10T20:34:02.456403+0000 mgr.gibba009.xiladd (mgr.34457) 1295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:04.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:04 gibba004 bash[31878]: cluster 2021-03-10T20:34:03.024576+0000 mgr.gibba009.xiladd (mgr.34457) 1296 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:04.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.443254+0000 mgr.gibba009.xiladd (mgr.34457) 1282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:04.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.445541+0000 mgr.gibba009.xiladd (mgr.34457) 1283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:04.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.447300+0000 mgr.gibba009.xiladd (mgr.34457) 1284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:04.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.447347+0000 mgr.gibba009.xiladd (mgr.34457) 1285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:04.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.449338+0000 mgr.gibba009.xiladd (mgr.34457) 1286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:04.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.449388+0000 mgr.gibba009.xiladd (mgr.34457) 1287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:04.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.450777+0000 mgr.gibba009.xiladd (mgr.34457) 1288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:04.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.452655+0000 mgr.gibba009.xiladd (mgr.34457) 1289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:04.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.452719+0000 mgr.gibba009.xiladd (mgr.34457) 1290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:04.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.454314+0000 mgr.gibba009.xiladd (mgr.34457) 1291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:04.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.454742+0000 mgr.gibba009.xiladd (mgr.34457) 1292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:04.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.456175+0000 mgr.gibba009.xiladd (mgr.34457) 1293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:04.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.456229+0000 mgr.gibba009.xiladd (mgr.34457) 1294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:04.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cephadm 2021-03-10T20:34:02.456403+0000 mgr.gibba009.xiladd (mgr.34457) 1295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:04.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:04 gibba009 bash[26136]: cluster 2021-03-10T20:34:03.024576+0000 mgr.gibba009.xiladd (mgr.34457) 1296 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:06 gibba004 bash[30897]: cluster 2021-03-10T20:34:05.025252+0000 mgr.gibba009.xiladd (mgr.34457) 1297 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:06 gibba004 bash[31878]: cluster 2021-03-10T20:34:05.025252+0000 mgr.gibba009.xiladd (mgr.34457) 1297 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:06 gibba009 bash[26136]: cluster 2021-03-10T20:34:05.025252+0000 mgr.gibba009.xiladd (mgr.34457) 1297 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:08.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:08 gibba004 bash[30897]: cluster 2021-03-10T20:34:07.026666+0000 mgr.gibba009.xiladd (mgr.34457) 1298 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:08.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:08 gibba004 bash[31878]: cluster 2021-03-10T20:34:07.026666+0000 mgr.gibba009.xiladd (mgr.34457) 1298 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:08 gibba009 bash[26136]: cluster 2021-03-10T20:34:07.026666+0000 mgr.gibba009.xiladd (mgr.34457) 1298 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:10 gibba004 bash[30897]: cluster 2021-03-10T20:34:09.028053+0000 mgr.gibba009.xiladd (mgr.34457) 1299 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:10 gibba004 bash[31878]: cluster 2021-03-10T20:34:09.028053+0000 mgr.gibba009.xiladd (mgr.34457) 1299 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:10 gibba009 bash[26136]: cluster 2021-03-10T20:34:09.028053+0000 mgr.gibba009.xiladd (mgr.34457) 1299 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:12 gibba004 bash[30897]: cluster 2021-03-10T20:34:11.029853+0000 mgr.gibba009.xiladd (mgr.34457) 1300 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:12.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:12 gibba004 bash[31878]: cluster 2021-03-10T20:34:11.029853+0000 mgr.gibba009.xiladd (mgr.34457) 1300 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:12 gibba009 bash[26136]: cluster 2021-03-10T20:34:11.029853+0000 mgr.gibba009.xiladd (mgr.34457) 1300 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:14 gibba004 bash[30897]: cluster 2021-03-10T20:34:13.031341+0000 mgr.gibba009.xiladd (mgr.34457) 1301 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:14 gibba004 bash[31878]: cluster 2021-03-10T20:34:13.031341+0000 mgr.gibba009.xiladd (mgr.34457) 1301 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:14 gibba009 bash[26136]: cluster 2021-03-10T20:34:13.031341+0000 mgr.gibba009.xiladd (mgr.34457) 1301 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:16 gibba004 bash[30897]: cluster 2021-03-10T20:34:15.032253+0000 mgr.gibba009.xiladd (mgr.34457) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:16 gibba004 bash[31878]: cluster 2021-03-10T20:34:15.032253+0000 mgr.gibba009.xiladd (mgr.34457) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:16 gibba009 bash[26136]: cluster 2021-03-10T20:34:15.032253+0000 mgr.gibba009.xiladd (mgr.34457) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:18 gibba004 bash[30897]: cluster 2021-03-10T20:34:17.033689+0000 mgr.gibba009.xiladd (mgr.34457) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:18 gibba004 bash[31878]: cluster 2021-03-10T20:34:17.033689+0000 mgr.gibba009.xiladd (mgr.34457) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:18 gibba009 bash[26136]: cluster 2021-03-10T20:34:17.033689+0000 mgr.gibba009.xiladd (mgr.34457) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:19.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:19 gibba004 bash[30897]: cephadm 2021-03-10T20:34:17.471944+0000 mgr.gibba009.xiladd (mgr.34457) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:19.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:19 gibba004 bash[31878]: cephadm 2021-03-10T20:34:17.471944+0000 mgr.gibba009.xiladd (mgr.34457) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:19.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:19 gibba009 bash[26136]: cephadm 2021-03-10T20:34:17.471944+0000 mgr.gibba009.xiladd (mgr.34457) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:20 gibba004 bash[30897]: cluster 2021-03-10T20:34:19.034627+0000 mgr.gibba009.xiladd (mgr.34457) 1305 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:20 gibba004 bash[31878]: cluster 2021-03-10T20:34:19.034627+0000 mgr.gibba009.xiladd (mgr.34457) 1305 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:20.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:20 gibba009 bash[26136]: cluster 2021-03-10T20:34:19.034627+0000 mgr.gibba009.xiladd (mgr.34457) 1305 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:21.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:21 gibba004 bash[30897]: cluster 2021-03-10T20:34:21.036374+0000 mgr.gibba009.xiladd (mgr.34457) 1306 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:21 gibba004 bash[31878]: cluster 2021-03-10T20:34:21.036374+0000 mgr.gibba009.xiladd (mgr.34457) 1306 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:21.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:21 gibba009 bash[26136]: cluster 2021-03-10T20:34:21.036374+0000 mgr.gibba009.xiladd (mgr.34457) 1306 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:24.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:24 gibba004 bash[30897]: cluster 2021-03-10T20:34:23.037783+0000 mgr.gibba009.xiladd (mgr.34457) 1307 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:24 gibba004 bash[31878]: cluster 2021-03-10T20:34:23.037783+0000 mgr.gibba009.xiladd (mgr.34457) 1307 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:24 gibba009 bash[26136]: cluster 2021-03-10T20:34:23.037783+0000 mgr.gibba009.xiladd (mgr.34457) 1307 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:26 gibba004 bash[30897]: cluster 2021-03-10T20:34:25.038846+0000 mgr.gibba009.xiladd (mgr.34457) 1308 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:26 gibba004 bash[31878]: cluster 2021-03-10T20:34:25.038846+0000 mgr.gibba009.xiladd (mgr.34457) 1308 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:26 gibba009 bash[26136]: cluster 2021-03-10T20:34:25.038846+0000 mgr.gibba009.xiladd (mgr.34457) 1308 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.036 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:34:28.266 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:34:28.266 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (23m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:34:28.266 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:34:28.267 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (23m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:34:28.267 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:34:28.267 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:34:28.267 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:34:28.268 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:34:28.268 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:34:28.268 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:34:28.268 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:34:28.269 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:34:28.269 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:34:28.269 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:34:28.269 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:34:28.269 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:34:28.270 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:34:28.270 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:34:28.270 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:34:28.270 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (28m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:34:28.271 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:28.271 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:28.517 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:34:28.518 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:34:28.518 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:28.518 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:28.518 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:34:28.519 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:28.519 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:28.519 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:34:28.519 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:34:28.519 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:28.520 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:34:28.520 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:34:28.520 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:34:28.520 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:34:28.521 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:34:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:28 gibba004 bash[30897]: cluster 2021-03-10T20:34:27.039754+0000 mgr.gibba009.xiladd (mgr.34457) 1309 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:28 gibba004 bash[31878]: cluster 2021-03-10T20:34:27.039754+0000 mgr.gibba009.xiladd (mgr.34457) 1309 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:28 gibba009 bash[26136]: cluster 2021-03-10T20:34:27.039754+0000 mgr.gibba009.xiladd (mgr.34457) 1309 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:29.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[30897]: audit 2021-03-10T20:34:28.024181+0000 mgr.gibba009.xiladd (mgr.34457) 1310 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[30897]: audit 2021-03-10T20:34:28.251580+0000 mgr.gibba009.xiladd (mgr.34457) 1311 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[30897]: audit 2021-03-10T20:34:28.517392+0000 mon.c (mon.1) 427 : audit [DBG] from='client.? 172.21.2.104:0/3243126692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:29.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[31878]: audit 2021-03-10T20:34:28.024181+0000 mgr.gibba009.xiladd (mgr.34457) 1310 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[31878]: audit 2021-03-10T20:34:28.251580+0000 mgr.gibba009.xiladd (mgr.34457) 1311 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:29 gibba004 bash[31878]: audit 2021-03-10T20:34:28.517392+0000 mon.c (mon.1) 427 : audit [DBG] from='client.? 172.21.2.104:0/3243126692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:29.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:29 gibba009 bash[26136]: audit 2021-03-10T20:34:28.024181+0000 mgr.gibba009.xiladd (mgr.34457) 1310 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:29 gibba009 bash[26136]: audit 2021-03-10T20:34:28.251580+0000 mgr.gibba009.xiladd (mgr.34457) 1311 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:29.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:29 gibba009 bash[26136]: audit 2021-03-10T20:34:28.517392+0000 mon.c (mon.1) 427 : audit [DBG] from='client.? 172.21.2.104:0/3243126692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:30 gibba004 bash[30897]: cluster 2021-03-10T20:34:29.041200+0000 mgr.gibba009.xiladd (mgr.34457) 1312 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:30 gibba004 bash[31878]: cluster 2021-03-10T20:34:29.041200+0000 mgr.gibba009.xiladd (mgr.34457) 1312 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:30 gibba009 bash[26136]: cluster 2021-03-10T20:34:29.041200+0000 mgr.gibba009.xiladd (mgr.34457) 1312 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.483 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:32 gibba009 bash[26136]: cluster 2021-03-10T20:34:31.042987+0000 mgr.gibba009.xiladd (mgr.34457) 1313 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:32 gibba004 bash[30897]: cluster 2021-03-10T20:34:31.042987+0000 mgr.gibba009.xiladd (mgr.34457) 1313 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:32 gibba004 bash[31878]: cluster 2021-03-10T20:34:31.042987+0000 mgr.gibba009.xiladd (mgr.34457) 1313 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:34 gibba004 bash[30897]: cephadm 2021-03-10T20:34:32.481698+0000 mgr.gibba009.xiladd (mgr.34457) 1314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:34 gibba004 bash[30897]: cluster 2021-03-10T20:34:33.044506+0000 mgr.gibba009.xiladd (mgr.34457) 1315 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:34 gibba004 bash[31878]: cephadm 2021-03-10T20:34:32.481698+0000 mgr.gibba009.xiladd (mgr.34457) 1314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:34 gibba004 bash[31878]: cluster 2021-03-10T20:34:33.044506+0000 mgr.gibba009.xiladd (mgr.34457) 1315 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:34 gibba009 bash[26136]: cephadm 2021-03-10T20:34:32.481698+0000 mgr.gibba009.xiladd (mgr.34457) 1314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:34 gibba009 bash[26136]: cluster 2021-03-10T20:34:33.044506+0000 mgr.gibba009.xiladd (mgr.34457) 1315 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:36 gibba004 bash[30897]: cluster 2021-03-10T20:34:35.045865+0000 mgr.gibba009.xiladd (mgr.34457) 1316 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:36 gibba004 bash[31878]: cluster 2021-03-10T20:34:35.045865+0000 mgr.gibba009.xiladd (mgr.34457) 1316 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:36 gibba009 bash[26136]: cluster 2021-03-10T20:34:35.045865+0000 mgr.gibba009.xiladd (mgr.34457) 1316 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:38 gibba004 bash[30897]: cluster 2021-03-10T20:34:37.047278+0000 mgr.gibba009.xiladd (mgr.34457) 1317 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:38 gibba004 bash[31878]: cluster 2021-03-10T20:34:37.047278+0000 mgr.gibba009.xiladd (mgr.34457) 1317 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:38 gibba009 bash[26136]: cluster 2021-03-10T20:34:37.047278+0000 mgr.gibba009.xiladd (mgr.34457) 1317 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: cluster 2021-03-10T20:34:39.048820+0000 mgr.gibba009.xiladd (mgr.34457) 1318 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.676708+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.677476+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.677953+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.678174+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.679060+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.679578+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.680582+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.681376+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.709348+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.710043+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.710528+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[30897]: audit 2021-03-10T20:34:39.711612+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: cluster 2021-03-10T20:34:39.048820+0000 mgr.gibba009.xiladd (mgr.34457) 1318 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.676708+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.677476+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.677953+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.678174+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.679060+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.679578+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.680582+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.681376+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.709348+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.710043+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.710528+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:40 gibba004 bash[31878]: audit 2021-03-10T20:34:39.711612+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: cluster 2021-03-10T20:34:39.048820+0000 mgr.gibba009.xiladd (mgr.34457) 1318 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.676708+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.677476+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.677953+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:34:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.678174+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.679060+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.679578+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.680582+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:34:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.681376+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:34:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.709348+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.710043+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.710528+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:40 gibba009 bash[26136]: audit 2021-03-10T20:34:39.711612+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:42.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:42 gibba004 bash[30897]: cluster 2021-03-10T20:34:41.050353+0000 mgr.gibba009.xiladd (mgr.34457) 1319 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:42 gibba004 bash[31878]: cluster 2021-03-10T20:34:41.050353+0000 mgr.gibba009.xiladd (mgr.34457) 1319 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:42 gibba009 bash[26136]: cluster 2021-03-10T20:34:41.050353+0000 mgr.gibba009.xiladd (mgr.34457) 1319 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:44 gibba004 bash[30897]: cluster 2021-03-10T20:34:43.051519+0000 mgr.gibba009.xiladd (mgr.34457) 1320 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.679 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:44 gibba004 bash[31878]: cluster 2021-03-10T20:34:43.051519+0000 mgr.gibba009.xiladd (mgr.34457) 1320 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.680 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:44 gibba009 bash[26136]: cluster 2021-03-10T20:34:43.051519+0000 mgr.gibba009.xiladd (mgr.34457) 1320 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:46 gibba004 bash[30897]: cluster 2021-03-10T20:34:45.052545+0000 mgr.gibba009.xiladd (mgr.34457) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:46 gibba004 bash[31878]: cluster 2021-03-10T20:34:45.052545+0000 mgr.gibba009.xiladd (mgr.34457) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:46 gibba009 bash[26136]: cluster 2021-03-10T20:34:45.052545+0000 mgr.gibba009.xiladd (mgr.34457) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:48 gibba004 bash[30897]: cluster 2021-03-10T20:34:47.053949+0000 mgr.gibba009.xiladd (mgr.34457) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:48 gibba004 bash[31878]: cluster 2021-03-10T20:34:47.053949+0000 mgr.gibba009.xiladd (mgr.34457) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:48 gibba009 bash[26136]: cluster 2021-03-10T20:34:47.053949+0000 mgr.gibba009.xiladd (mgr.34457) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:49.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:49 gibba004 bash[30897]: cephadm 2021-03-10T20:34:47.497494+0000 mgr.gibba009.xiladd (mgr.34457) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:49.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:49 gibba004 bash[31878]: cephadm 2021-03-10T20:34:47.497494+0000 mgr.gibba009.xiladd (mgr.34457) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:49.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:49 gibba009 bash[26136]: cephadm 2021-03-10T20:34:47.497494+0000 mgr.gibba009.xiladd (mgr.34457) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:34:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:50 gibba004 bash[30897]: cluster 2021-03-10T20:34:49.055483+0000 mgr.gibba009.xiladd (mgr.34457) 1324 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:50 gibba004 bash[31878]: cluster 2021-03-10T20:34:49.055483+0000 mgr.gibba009.xiladd (mgr.34457) 1324 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:50.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:50 gibba009 bash[26136]: cluster 2021-03-10T20:34:49.055483+0000 mgr.gibba009.xiladd (mgr.34457) 1324 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:52 gibba004 bash[30897]: cluster 2021-03-10T20:34:51.056970+0000 mgr.gibba009.xiladd (mgr.34457) 1325 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:52 gibba004 bash[31878]: cluster 2021-03-10T20:34:51.056970+0000 mgr.gibba009.xiladd (mgr.34457) 1325 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:52.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:52 gibba009 bash[26136]: cluster 2021-03-10T20:34:51.056970+0000 mgr.gibba009.xiladd (mgr.34457) 1325 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:54 gibba004 bash[30897]: cluster 2021-03-10T20:34:53.058180+0000 mgr.gibba009.xiladd (mgr.34457) 1326 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:54 gibba004 bash[31878]: cluster 2021-03-10T20:34:53.058180+0000 mgr.gibba009.xiladd (mgr.34457) 1326 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:54 gibba009 bash[26136]: cluster 2021-03-10T20:34:53.058180+0000 mgr.gibba009.xiladd (mgr.34457) 1326 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:56.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:56 gibba004 bash[30897]: cluster 2021-03-10T20:34:55.059346+0000 mgr.gibba009.xiladd (mgr.34457) 1327 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:56 gibba004 bash[31878]: cluster 2021-03-10T20:34:55.059346+0000 mgr.gibba009.xiladd (mgr.34457) 1327 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:56 gibba009 bash[26136]: cluster 2021-03-10T20:34:55.059346+0000 mgr.gibba009.xiladd (mgr.34457) 1327 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:34:58 gibba004 bash[30897]: cluster 2021-03-10T20:34:57.060987+0000 mgr.gibba009.xiladd (mgr.34457) 1328 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:34:58 gibba004 bash[31878]: cluster 2021-03-10T20:34:57.060987+0000 mgr.gibba009.xiladd (mgr.34457) 1328 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:34:58 gibba009 bash[26136]: cluster 2021-03-10T20:34:57.060987+0000 mgr.gibba009.xiladd (mgr.34457) 1328 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.760 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:34:58.988 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:34:58.989 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (23m) 10m ago 29m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:34:58.989 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:34:58.989 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (24m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:34:58.990 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (24m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:34:58.990 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:34:58.990 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:34:58.990 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:34:58.990 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (23m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:34:58.991 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (29m) 10m ago 29m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:34:58.991 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:34:58.991 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (22m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:34:58.991 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:34:58.992 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:34:58.992 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:34:58.992 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:34:58.992 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:34:58.992 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:34:58.993 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (19m) 9m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:34:58.993 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (28m) 9m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:34:58.993 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:58.993 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:59.241 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:34:59.241 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:34:59.241 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:59.241 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:59.242 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:34:59.242 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:59.242 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:59.242 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:34:59.243 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:34:59.243 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:34:59.243 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:34:59.243 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:34:59.243 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:34:59.244 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:34:59.244 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:35:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[30897]: audit 2021-03-10T20:34:58.750454+0000 mgr.gibba009.xiladd (mgr.34457) 1329 : audit [DBG] from='client.54937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[30897]: audit 2021-03-10T20:34:58.974119+0000 mgr.gibba009.xiladd (mgr.34457) 1330 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[30897]: cluster 2021-03-10T20:34:59.062255+0000 mgr.gibba009.xiladd (mgr.34457) 1331 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[30897]: audit 2021-03-10T20:34:59.240807+0000 mon.c (mon.1) 434 : audit [DBG] from='client.? 172.21.2.104:0/3860182747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:00.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[31878]: audit 2021-03-10T20:34:58.750454+0000 mgr.gibba009.xiladd (mgr.34457) 1329 : audit [DBG] from='client.54937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[31878]: audit 2021-03-10T20:34:58.974119+0000 mgr.gibba009.xiladd (mgr.34457) 1330 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[31878]: cluster 2021-03-10T20:34:59.062255+0000 mgr.gibba009.xiladd (mgr.34457) 1331 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:00.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:00 gibba004 bash[31878]: audit 2021-03-10T20:34:59.240807+0000 mon.c (mon.1) 434 : audit [DBG] from='client.? 172.21.2.104:0/3860182747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:00 gibba009 bash[26136]: audit 2021-03-10T20:34:58.750454+0000 mgr.gibba009.xiladd (mgr.34457) 1329 : audit [DBG] from='client.54937 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:00 gibba009 bash[26136]: audit 2021-03-10T20:34:58.974119+0000 mgr.gibba009.xiladd (mgr.34457) 1330 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:00.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:00 gibba009 bash[26136]: cluster 2021-03-10T20:34:59.062255+0000 mgr.gibba009.xiladd (mgr.34457) 1331 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:00.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:00 gibba009 bash[26136]: audit 2021-03-10T20:34:59.240807+0000 mon.c (mon.1) 434 : audit [DBG] from='client.? 172.21.2.104:0/3860182747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:02 gibba004 bash[30897]: cluster 2021-03-10T20:35:01.064077+0000 mgr.gibba009.xiladd (mgr.34457) 1332 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:02 gibba004 bash[31878]: cluster 2021-03-10T20:35:01.064077+0000 mgr.gibba009.xiladd (mgr.34457) 1332 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:02.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:02 gibba009 bash[26136]: cluster 2021-03-10T20:35:01.064077+0000 mgr.gibba009.xiladd (mgr.34457) 1332 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:03.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:03 gibba004 bash[30897]: audit 2021-03-10T20:35:02.510398+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:03.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:03 gibba004 bash[30897]: audit 2021-03-10T20:35:02.517386+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:35:03.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:03 gibba004 bash[31878]: audit 2021-03-10T20:35:02.510398+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:03.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:03 gibba004 bash[31878]: audit 2021-03-10T20:35:02.517386+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:35:03.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:03 gibba009 bash[26136]: audit 2021-03-10T20:35:02.510398+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:03.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:03 gibba009 bash[26136]: audit 2021-03-10T20:35:02.517386+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:35:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:04 gibba004 bash[30897]: cephadm 2021-03-10T20:35:02.515464+0000 mgr.gibba009.xiladd (mgr.34457) 1333 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:35:04.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:04 gibba004 bash[30897]: cluster 2021-03-10T20:35:03.065477+0000 mgr.gibba009.xiladd (mgr.34457) 1334 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:04 gibba004 bash[31878]: cephadm 2021-03-10T20:35:02.515464+0000 mgr.gibba009.xiladd (mgr.34457) 1333 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:35:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:04 gibba004 bash[31878]: cluster 2021-03-10T20:35:03.065477+0000 mgr.gibba009.xiladd (mgr.34457) 1334 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:04 gibba009 bash[26136]: cephadm 2021-03-10T20:35:02.515464+0000 mgr.gibba009.xiladd (mgr.34457) 1333 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:35:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:04 gibba009 bash[26136]: cluster 2021-03-10T20:35:03.065477+0000 mgr.gibba009.xiladd (mgr.34457) 1334 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:06 gibba004 bash[30897]: cluster 2021-03-10T20:35:05.066837+0000 mgr.gibba009.xiladd (mgr.34457) 1335 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:06 gibba004 bash[30897]: audit 2021-03-10T20:35:05.997400+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:06.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:06 gibba004 bash[31878]: cluster 2021-03-10T20:35:05.066837+0000 mgr.gibba009.xiladd (mgr.34457) 1335 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:06 gibba004 bash[31878]: audit 2021-03-10T20:35:05.997400+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:06 gibba009 bash[26136]: cluster 2021-03-10T20:35:05.066837+0000 mgr.gibba009.xiladd (mgr.34457) 1335 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:06 gibba009 bash[26136]: audit 2021-03-10T20:35:05.997400+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:07.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:05.997069+0000 mgr.gibba009.xiladd (mgr.34457) 1336 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:35:07.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.199088+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:07.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.203579+0000 mgr.gibba009.xiladd (mgr.34457) 1337 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:07.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.206153+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:07.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.206602+0000 mgr.gibba009.xiladd (mgr.34457) 1338 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:07.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.208112+0000 mgr.gibba009.xiladd (mgr.34457) 1339 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:07.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.208151+0000 mgr.gibba009.xiladd (mgr.34457) 1340 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:07.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.208652+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.209612+0000 mgr.gibba009.xiladd (mgr.34457) 1341 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:07.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.209650+0000 mgr.gibba009.xiladd (mgr.34457) 1342 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.210151+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.210871+0000 mgr.gibba009.xiladd (mgr.34457) 1343 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.211438+0000 mon.c (mon.1) 440 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.212460+0000 mgr.gibba009.xiladd (mgr.34457) 1344 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:07.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.212500+0000 mgr.gibba009.xiladd (mgr.34457) 1345 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.213914+0000 mgr.gibba009.xiladd (mgr.34457) 1346 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:07.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.214355+0000 mgr.gibba009.xiladd (mgr.34457) 1347 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:07.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.214511+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.215482+0000 mgr.gibba009.xiladd (mgr.34457) 1348 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:07.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.215526+0000 mgr.gibba009.xiladd (mgr.34457) 1349 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:07.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: cephadm 2021-03-10T20:35:06.215675+0000 mgr.gibba009.xiladd (mgr.34457) 1350 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:07.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[30897]: audit 2021-03-10T20:35:06.216127+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:05.997069+0000 mgr.gibba009.xiladd (mgr.34457) 1336 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:35:07.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.199088+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.203579+0000 mgr.gibba009.xiladd (mgr.34457) 1337 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.206153+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.206602+0000 mgr.gibba009.xiladd (mgr.34457) 1338 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:07.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.208112+0000 mgr.gibba009.xiladd (mgr.34457) 1339 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.208151+0000 mgr.gibba009.xiladd (mgr.34457) 1340 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.208652+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.209612+0000 mgr.gibba009.xiladd (mgr.34457) 1341 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.209650+0000 mgr.gibba009.xiladd (mgr.34457) 1342 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:07.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.210151+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.210871+0000 mgr.gibba009.xiladd (mgr.34457) 1343 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:07.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.211438+0000 mon.c (mon.1) 440 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.212460+0000 mgr.gibba009.xiladd (mgr.34457) 1344 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:07.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.212500+0000 mgr.gibba009.xiladd (mgr.34457) 1345 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:07.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.213914+0000 mgr.gibba009.xiladd (mgr.34457) 1346 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:07.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.214355+0000 mgr.gibba009.xiladd (mgr.34457) 1347 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:07.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.214511+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.215482+0000 mgr.gibba009.xiladd (mgr.34457) 1348 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:07.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.215526+0000 mgr.gibba009.xiladd (mgr.34457) 1349 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:07.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: cephadm 2021-03-10T20:35:06.215675+0000 mgr.gibba009.xiladd (mgr.34457) 1350 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:07.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:07 gibba004 bash[31878]: audit 2021-03-10T20:35:06.216127+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:05.997069+0000 mgr.gibba009.xiladd (mgr.34457) 1336 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:35:07.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.199088+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:35:07.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.203579+0000 mgr.gibba009.xiladd (mgr.34457) 1337 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:07.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.206153+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.206602+0000 mgr.gibba009.xiladd (mgr.34457) 1338 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.208112+0000 mgr.gibba009.xiladd (mgr.34457) 1339 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.208151+0000 mgr.gibba009.xiladd (mgr.34457) 1340 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.208652+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.209612+0000 mgr.gibba009.xiladd (mgr.34457) 1341 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.209650+0000 mgr.gibba009.xiladd (mgr.34457) 1342 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.210151+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.210871+0000 mgr.gibba009.xiladd (mgr.34457) 1343 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:07.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.211438+0000 mon.c (mon.1) 440 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.212460+0000 mgr.gibba009.xiladd (mgr.34457) 1344 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:07.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.212500+0000 mgr.gibba009.xiladd (mgr.34457) 1345 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:07.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.213914+0000 mgr.gibba009.xiladd (mgr.34457) 1346 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:07.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.214355+0000 mgr.gibba009.xiladd (mgr.34457) 1347 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:07.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.214511+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:07.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.215482+0000 mgr.gibba009.xiladd (mgr.34457) 1348 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:07.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.215526+0000 mgr.gibba009.xiladd (mgr.34457) 1349 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:07.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: cephadm 2021-03-10T20:35:06.215675+0000 mgr.gibba009.xiladd (mgr.34457) 1350 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:07.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:07 gibba009 bash[26136]: audit 2021-03-10T20:35:06.216127+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:08 gibba004 bash[30897]: cluster 2021-03-10T20:35:07.068000+0000 mgr.gibba009.xiladd (mgr.34457) 1351 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:08 gibba004 bash[31878]: cluster 2021-03-10T20:35:07.068000+0000 mgr.gibba009.xiladd (mgr.34457) 1351 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:08.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:08 gibba009 bash[26136]: cluster 2021-03-10T20:35:07.068000+0000 mgr.gibba009.xiladd (mgr.34457) 1351 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:10 gibba004 bash[30897]: cluster 2021-03-10T20:35:09.069494+0000 mgr.gibba009.xiladd (mgr.34457) 1352 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:10 gibba004 bash[31878]: cluster 2021-03-10T20:35:09.069494+0000 mgr.gibba009.xiladd (mgr.34457) 1352 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:10 gibba009 bash[26136]: cluster 2021-03-10T20:35:09.069494+0000 mgr.gibba009.xiladd (mgr.34457) 1352 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:12 gibba004 bash[30897]: cluster 2021-03-10T20:35:11.071318+0000 mgr.gibba009.xiladd (mgr.34457) 1353 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:12 gibba004 bash[31878]: cluster 2021-03-10T20:35:11.071318+0000 mgr.gibba009.xiladd (mgr.34457) 1353 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:12 gibba009 bash[26136]: cluster 2021-03-10T20:35:11.071318+0000 mgr.gibba009.xiladd (mgr.34457) 1353 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:14 gibba004 bash[30897]: cluster 2021-03-10T20:35:13.072739+0000 mgr.gibba009.xiladd (mgr.34457) 1354 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:14 gibba004 bash[31878]: cluster 2021-03-10T20:35:13.072739+0000 mgr.gibba009.xiladd (mgr.34457) 1354 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:14 gibba009 bash[26136]: cluster 2021-03-10T20:35:13.072739+0000 mgr.gibba009.xiladd (mgr.34457) 1354 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:16 gibba004 bash[30897]: cluster 2021-03-10T20:35:15.074417+0000 mgr.gibba009.xiladd (mgr.34457) 1355 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:16 gibba004 bash[31878]: cluster 2021-03-10T20:35:15.074417+0000 mgr.gibba009.xiladd (mgr.34457) 1355 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:16 gibba009 bash[26136]: cluster 2021-03-10T20:35:15.074417+0000 mgr.gibba009.xiladd (mgr.34457) 1355 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:18 gibba004 bash[30897]: cluster 2021-03-10T20:35:17.076061+0000 mgr.gibba009.xiladd (mgr.34457) 1356 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:18 gibba004 bash[31878]: cluster 2021-03-10T20:35:17.076061+0000 mgr.gibba009.xiladd (mgr.34457) 1356 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:18 gibba009 bash[26136]: cluster 2021-03-10T20:35:17.076061+0000 mgr.gibba009.xiladd (mgr.34457) 1356 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:20 gibba004 bash[30897]: cluster 2021-03-10T20:35:19.077643+0000 mgr.gibba009.xiladd (mgr.34457) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:20 gibba004 bash[31878]: cluster 2021-03-10T20:35:19.077643+0000 mgr.gibba009.xiladd (mgr.34457) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:20 gibba009 bash[26136]: cluster 2021-03-10T20:35:19.077643+0000 mgr.gibba009.xiladd (mgr.34457) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:22 gibba004 bash[30897]: cluster 2021-03-10T20:35:21.079242+0000 mgr.gibba009.xiladd (mgr.34457) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:22 gibba004 bash[30897]: cephadm 2021-03-10T20:35:21.231587+0000 mgr.gibba009.xiladd (mgr.34457) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:22.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:22 gibba004 bash[31878]: cluster 2021-03-10T20:35:21.079242+0000 mgr.gibba009.xiladd (mgr.34457) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:22 gibba004 bash[31878]: cephadm 2021-03-10T20:35:21.231587+0000 mgr.gibba009.xiladd (mgr.34457) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:22.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:22 gibba009 bash[26136]: cluster 2021-03-10T20:35:21.079242+0000 mgr.gibba009.xiladd (mgr.34457) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:22 gibba009 bash[26136]: cephadm 2021-03-10T20:35:21.231587+0000 mgr.gibba009.xiladd (mgr.34457) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:24 gibba004 bash[30897]: cluster 2021-03-10T20:35:23.080639+0000 mgr.gibba009.xiladd (mgr.34457) 1360 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:24 gibba004 bash[31878]: cluster 2021-03-10T20:35:23.080639+0000 mgr.gibba009.xiladd (mgr.34457) 1360 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:24 gibba009 bash[26136]: cluster 2021-03-10T20:35:23.080639+0000 mgr.gibba009.xiladd (mgr.34457) 1360 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:26 gibba004 bash[30897]: cluster 2021-03-10T20:35:25.082528+0000 mgr.gibba009.xiladd (mgr.34457) 1361 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:26 gibba004 bash[31878]: cluster 2021-03-10T20:35:25.082528+0000 mgr.gibba009.xiladd (mgr.34457) 1361 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:26 gibba009 bash[26136]: cluster 2021-03-10T20:35:25.082528+0000 mgr.gibba009.xiladd (mgr.34457) 1361 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:28 gibba004 bash[30897]: cluster 2021-03-10T20:35:27.083983+0000 mgr.gibba009.xiladd (mgr.34457) 1362 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:28 gibba004 bash[31878]: cluster 2021-03-10T20:35:27.083983+0000 mgr.gibba009.xiladd (mgr.34457) 1362 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:28 gibba009 bash[26136]: cluster 2021-03-10T20:35:27.083983+0000 mgr.gibba009.xiladd (mgr.34457) 1362 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:29.485 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:35:29.716 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:35:29.717 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (24m) 23s ago 29m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:35:29.717 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:35:29.717 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (24m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:35:29.717 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:35:29.718 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (24m) 23s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:35:29.718 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (23m) 23s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:35:29.718 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:35:29.718 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (23m) 23s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:35:29.719 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (29m) 23s ago 29m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:35:29.719 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:35:29.719 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (22m) 23s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:35:29.719 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (22m) 23s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:35:29.719 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (21m) 23s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:35:29.720 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (21m) 23s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:35:29.720 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:35:29.720 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:35:29.720 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:35:29.721 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:35:29.721 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (29m) 9m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:35:29.721 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 23s ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:29.721 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:29.965 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:35:29.965 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:35:29.966 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:29.966 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:35:29.967 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:35:29.967 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:29.967 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:35:29.968 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:35:29.968 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:35:29.969 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:35:29.969 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:35:29.970 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:35:29.970 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:35:29.970 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:35:29.971 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:35:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:30 gibba004 bash[30897]: cluster 2021-03-10T20:35:29.085426+0000 mgr.gibba009.xiladd (mgr.34457) 1363 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:30 gibba004 bash[30897]: audit 2021-03-10T20:35:29.964726+0000 mon.c (mon.1) 443 : audit [DBG] from='client.? 172.21.2.104:0/1321340125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:30 gibba004 bash[31878]: cluster 2021-03-10T20:35:29.085426+0000 mgr.gibba009.xiladd (mgr.34457) 1363 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:30 gibba004 bash[31878]: audit 2021-03-10T20:35:29.964726+0000 mon.c (mon.1) 443 : audit [DBG] from='client.? 172.21.2.104:0/1321340125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:30.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:30 gibba009 bash[26136]: cluster 2021-03-10T20:35:29.085426+0000 mgr.gibba009.xiladd (mgr.34457) 1363 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:30.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:30 gibba009 bash[26136]: audit 2021-03-10T20:35:29.964726+0000 mon.c (mon.1) 443 : audit [DBG] from='client.? 172.21.2.104:0/1321340125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:31.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:31 gibba009 bash[26136]: audit 2021-03-10T20:35:29.474234+0000 mgr.gibba009.xiladd (mgr.34457) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:31.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:31 gibba009 bash[26136]: audit 2021-03-10T20:35:29.702403+0000 mgr.gibba009.xiladd (mgr.34457) 1365 : audit [DBG] from='client.44982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:31.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:31 gibba004 bash[30897]: audit 2021-03-10T20:35:29.474234+0000 mgr.gibba009.xiladd (mgr.34457) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:31.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:31 gibba004 bash[30897]: audit 2021-03-10T20:35:29.702403+0000 mgr.gibba009.xiladd (mgr.34457) 1365 : audit [DBG] from='client.44982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:31 gibba004 bash[31878]: audit 2021-03-10T20:35:29.474234+0000 mgr.gibba009.xiladd (mgr.34457) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:31.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:31 gibba004 bash[31878]: audit 2021-03-10T20:35:29.702403+0000 mgr.gibba009.xiladd (mgr.34457) 1365 : audit [DBG] from='client.44982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:32 gibba009 bash[26136]: cluster 2021-03-10T20:35:31.087270+0000 mgr.gibba009.xiladd (mgr.34457) 1366 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:32.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:32 gibba004 bash[30897]: cluster 2021-03-10T20:35:31.087270+0000 mgr.gibba009.xiladd (mgr.34457) 1366 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:32 gibba004 bash[31878]: cluster 2021-03-10T20:35:31.087270+0000 mgr.gibba009.xiladd (mgr.34457) 1366 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:34 gibba009 bash[26136]: cluster 2021-03-10T20:35:33.088507+0000 mgr.gibba009.xiladd (mgr.34457) 1367 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:34 gibba004 bash[30897]: cluster 2021-03-10T20:35:33.088507+0000 mgr.gibba009.xiladd (mgr.34457) 1367 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:34 gibba004 bash[31878]: cluster 2021-03-10T20:35:33.088507+0000 mgr.gibba009.xiladd (mgr.34457) 1367 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:36 gibba009 bash[26136]: cluster 2021-03-10T20:35:35.090077+0000 mgr.gibba009.xiladd (mgr.34457) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:36 gibba004 bash[30897]: cluster 2021-03-10T20:35:35.090077+0000 mgr.gibba009.xiladd (mgr.34457) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:36 gibba004 bash[31878]: cluster 2021-03-10T20:35:35.090077+0000 mgr.gibba009.xiladd (mgr.34457) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:37.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:37 gibba004 bash[30897]: cephadm 2021-03-10T20:35:36.241782+0000 mgr.gibba009.xiladd (mgr.34457) 1369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:37.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:37 gibba004 bash[31878]: cephadm 2021-03-10T20:35:36.241782+0000 mgr.gibba009.xiladd (mgr.34457) 1369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:37 gibba009 bash[26136]: cephadm 2021-03-10T20:35:36.241782+0000 mgr.gibba009.xiladd (mgr.34457) 1369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:38.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:38 gibba004 bash[30897]: cluster 2021-03-10T20:35:37.091554+0000 mgr.gibba009.xiladd (mgr.34457) 1370 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:38.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:38 gibba004 bash[31878]: cluster 2021-03-10T20:35:37.091554+0000 mgr.gibba009.xiladd (mgr.34457) 1370 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:38.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:38 gibba009 bash[26136]: cluster 2021-03-10T20:35:37.091554+0000 mgr.gibba009.xiladd (mgr.34457) 1370 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: cluster 2021-03-10T20:35:39.093100+0000 mgr.gibba009.xiladd (mgr.34457) 1371 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.686715+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.687513+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.687920+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.688452+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.689202+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.689655+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.690290+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.691093+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.714964+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.715786+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.716111+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[30897]: audit 2021-03-10T20:35:39.717221+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: cluster 2021-03-10T20:35:39.093100+0000 mgr.gibba009.xiladd (mgr.34457) 1371 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.686715+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.687513+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.687920+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.688452+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.689202+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.689655+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.690290+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.691093+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.714964+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.715786+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.716111+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:40 gibba004 bash[31878]: audit 2021-03-10T20:35:39.717221+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: cluster 2021-03-10T20:35:39.093100+0000 mgr.gibba009.xiladd (mgr.34457) 1371 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.686715+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.687513+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.687920+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:35:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.688452+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.689202+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:35:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.689655+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.690290+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.691093+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:35:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.714964+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.715786+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.716111+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:40 gibba009 bash[26136]: audit 2021-03-10T20:35:39.717221+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:42 gibba004 bash[30897]: cluster 2021-03-10T20:35:41.094810+0000 mgr.gibba009.xiladd (mgr.34457) 1372 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:42 gibba004 bash[31878]: cluster 2021-03-10T20:35:41.094810+0000 mgr.gibba009.xiladd (mgr.34457) 1372 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:42 gibba009 bash[26136]: cluster 2021-03-10T20:35:41.094810+0000 mgr.gibba009.xiladd (mgr.34457) 1372 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:44 gibba004 bash[30897]: cluster 2021-03-10T20:35:43.096343+0000 mgr.gibba009.xiladd (mgr.34457) 1373 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:44 gibba004 bash[31878]: cluster 2021-03-10T20:35:43.096343+0000 mgr.gibba009.xiladd (mgr.34457) 1373 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:44 gibba009 bash[26136]: cluster 2021-03-10T20:35:43.096343+0000 mgr.gibba009.xiladd (mgr.34457) 1373 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:46 gibba004 bash[30897]: cluster 2021-03-10T20:35:45.098138+0000 mgr.gibba009.xiladd (mgr.34457) 1374 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:46 gibba004 bash[31878]: cluster 2021-03-10T20:35:45.098138+0000 mgr.gibba009.xiladd (mgr.34457) 1374 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:46 gibba009 bash[26136]: cluster 2021-03-10T20:35:45.098138+0000 mgr.gibba009.xiladd (mgr.34457) 1374 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:48 gibba004 bash[30897]: cluster 2021-03-10T20:35:47.099619+0000 mgr.gibba009.xiladd (mgr.34457) 1375 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:48 gibba004 bash[31878]: cluster 2021-03-10T20:35:47.099619+0000 mgr.gibba009.xiladd (mgr.34457) 1375 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:48 gibba009 bash[26136]: cluster 2021-03-10T20:35:47.099619+0000 mgr.gibba009.xiladd (mgr.34457) 1375 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:50 gibba004 bash[30897]: cluster 2021-03-10T20:35:49.101132+0000 mgr.gibba009.xiladd (mgr.34457) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:50 gibba004 bash[31878]: cluster 2021-03-10T20:35:49.101132+0000 mgr.gibba009.xiladd (mgr.34457) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:50 gibba009 bash[26136]: cluster 2021-03-10T20:35:49.101132+0000 mgr.gibba009.xiladd (mgr.34457) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:52 gibba004 bash[30897]: cluster 2021-03-10T20:35:51.102965+0000 mgr.gibba009.xiladd (mgr.34457) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:52 gibba004 bash[30897]: cephadm 2021-03-10T20:35:51.245700+0000 mgr.gibba009.xiladd (mgr.34457) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:52.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:52 gibba004 bash[31878]: cluster 2021-03-10T20:35:51.102965+0000 mgr.gibba009.xiladd (mgr.34457) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:52 gibba004 bash[31878]: cephadm 2021-03-10T20:35:51.245700+0000 mgr.gibba009.xiladd (mgr.34457) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:52 gibba009 bash[26136]: cluster 2021-03-10T20:35:51.102965+0000 mgr.gibba009.xiladd (mgr.34457) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:52 gibba009 bash[26136]: cephadm 2021-03-10T20:35:51.245700+0000 mgr.gibba009.xiladd (mgr.34457) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:35:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:54 gibba004 bash[30897]: cluster 2021-03-10T20:35:53.104530+0000 mgr.gibba009.xiladd (mgr.34457) 1379 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:54 gibba004 bash[31878]: cluster 2021-03-10T20:35:53.104530+0000 mgr.gibba009.xiladd (mgr.34457) 1379 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:54 gibba009 bash[26136]: cluster 2021-03-10T20:35:53.104530+0000 mgr.gibba009.xiladd (mgr.34457) 1379 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:56 gibba004 bash[30897]: cluster 2021-03-10T20:35:55.106094+0000 mgr.gibba009.xiladd (mgr.34457) 1380 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:56 gibba004 bash[31878]: cluster 2021-03-10T20:35:55.106094+0000 mgr.gibba009.xiladd (mgr.34457) 1380 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:56 gibba009 bash[26136]: cluster 2021-03-10T20:35:55.106094+0000 mgr.gibba009.xiladd (mgr.34457) 1380 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:35:58 gibba004 bash[30897]: cluster 2021-03-10T20:35:57.107673+0000 mgr.gibba009.xiladd (mgr.34457) 1381 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:35:58 gibba004 bash[31878]: cluster 2021-03-10T20:35:57.107673+0000 mgr.gibba009.xiladd (mgr.34457) 1381 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:35:58 gibba009 bash[26136]: cluster 2021-03-10T20:35:57.107673+0000 mgr.gibba009.xiladd (mgr.34457) 1381 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:00.208 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:36:00.435 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:36:00.436 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (24m) 54s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:36:00.436 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (30m) 10m ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:36:00.436 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:36:00.437 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:36:00.437 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (24m) 54s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:36:00.437 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (24m) 54s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:36:00.437 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (24m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:36:00.437 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (24m) 54s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:36:00.438 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (30m) 54s ago 30m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:36:00.438 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (30m) 10m ago 30m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:36:00.438 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (23m) 54s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:36:00.438 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (22m) 54s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:36:00.439 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (22m) 54s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:36:00.439 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (22m) 54s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:36:00.439 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:36:00.439 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:36:00.439 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:36:00.440 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (20m) 10m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:36:00.440 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (29m) 10m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:36:00.440 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 54s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:00.440 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 10m ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:00.687 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:36:00.688 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:36:00.688 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:00.688 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:00.688 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:36:00.689 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:00.689 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:00.689 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:36:00.689 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:36:00.689 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:00.690 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:36:00.690 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:36:00.690 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:36:00.690 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:36:00.691 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:36:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:00 gibba004 bash[30897]: cluster 2021-03-10T20:35:59.109230+0000 mgr.gibba009.xiladd (mgr.34457) 1382 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:00 gibba004 bash[31878]: cluster 2021-03-10T20:35:59.109230+0000 mgr.gibba009.xiladd (mgr.34457) 1382 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:00 gibba009 bash[26136]: cluster 2021-03-10T20:35:59.109230+0000 mgr.gibba009.xiladd (mgr.34457) 1382 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:01.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[30897]: audit 2021-03-10T20:36:00.197174+0000 mgr.gibba009.xiladd (mgr.34457) 1383 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[30897]: audit 2021-03-10T20:36:00.421527+0000 mgr.gibba009.xiladd (mgr.34457) 1384 : audit [DBG] from='client.45000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[30897]: audit 2021-03-10T20:36:00.687395+0000 mon.c (mon.1) 450 : audit [DBG] from='client.? 172.21.2.104:0/3972424463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:01.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[31878]: audit 2021-03-10T20:36:00.197174+0000 mgr.gibba009.xiladd (mgr.34457) 1383 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[31878]: audit 2021-03-10T20:36:00.421527+0000 mgr.gibba009.xiladd (mgr.34457) 1384 : audit [DBG] from='client.45000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:01 gibba004 bash[31878]: audit 2021-03-10T20:36:00.687395+0000 mon.c (mon.1) 450 : audit [DBG] from='client.? 172.21.2.104:0/3972424463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:01.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:01 gibba009 bash[26136]: audit 2021-03-10T20:36:00.197174+0000 mgr.gibba009.xiladd (mgr.34457) 1383 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:01 gibba009 bash[26136]: audit 2021-03-10T20:36:00.421527+0000 mgr.gibba009.xiladd (mgr.34457) 1384 : audit [DBG] from='client.45000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:01.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:01 gibba009 bash[26136]: audit 2021-03-10T20:36:00.687395+0000 mon.c (mon.1) 450 : audit [DBG] from='client.? 172.21.2.104:0/3972424463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:02.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:02 gibba004 bash[30897]: cluster 2021-03-10T20:36:01.111087+0000 mgr.gibba009.xiladd (mgr.34457) 1385 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:02.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:02 gibba004 bash[31878]: cluster 2021-03-10T20:36:01.111087+0000 mgr.gibba009.xiladd (mgr.34457) 1385 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:02 gibba009 bash[26136]: cluster 2021-03-10T20:36:01.111087+0000 mgr.gibba009.xiladd (mgr.34457) 1385 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:03 gibba004 bash[30897]: cluster 2021-03-10T20:36:03.112411+0000 mgr.gibba009.xiladd (mgr.34457) 1386 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:03.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:03 gibba004 bash[31878]: cluster 2021-03-10T20:36:03.112411+0000 mgr.gibba009.xiladd (mgr.34457) 1386 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:03.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:03 gibba009 bash[26136]: cluster 2021-03-10T20:36:03.112411+0000 mgr.gibba009.xiladd (mgr.34457) 1386 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:06 gibba004 bash[30897]: cluster 2021-03-10T20:36:05.114229+0000 mgr.gibba009.xiladd (mgr.34457) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:06 gibba004 bash[31878]: cluster 2021-03-10T20:36:05.114229+0000 mgr.gibba009.xiladd (mgr.34457) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:06 gibba009 bash[26136]: cluster 2021-03-10T20:36:05.114229+0000 mgr.gibba009.xiladd (mgr.34457) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:07.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[30897]: audit 2021-03-10T20:36:06.259853+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:07.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[30897]: cephadm 2021-03-10T20:36:06.263933+0000 mgr.gibba009.xiladd (mgr.34457) 1388 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:36:07.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[30897]: audit 2021-03-10T20:36:06.268452+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:07.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[31878]: audit 2021-03-10T20:36:06.259853+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:07.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[31878]: cephadm 2021-03-10T20:36:06.263933+0000 mgr.gibba009.xiladd (mgr.34457) 1388 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:36:07.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:07 gibba004 bash[31878]: audit 2021-03-10T20:36:06.268452+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:07 gibba009 bash[26136]: audit 2021-03-10T20:36:06.259853+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:07.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:07 gibba009 bash[26136]: cephadm 2021-03-10T20:36:06.263933+0000 mgr.gibba009.xiladd (mgr.34457) 1388 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:36:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:07 gibba009 bash[26136]: audit 2021-03-10T20:36:06.268452+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:08 gibba004 bash[30897]: cluster 2021-03-10T20:36:07.115838+0000 mgr.gibba009.xiladd (mgr.34457) 1389 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:08 gibba004 bash[31878]: cluster 2021-03-10T20:36:07.115838+0000 mgr.gibba009.xiladd (mgr.34457) 1389 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:08.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:08 gibba009 bash[26136]: cluster 2021-03-10T20:36:07.115838+0000 mgr.gibba009.xiladd (mgr.34457) 1389 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[30897]: cluster 2021-03-10T20:36:09.117287+0000 mgr.gibba009.xiladd (mgr.34457) 1390 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[30897]: audit 2021-03-10T20:36:10.038446+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:10.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[30897]: audit 2021-03-10T20:36:10.040322+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:36:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[31878]: cluster 2021-03-10T20:36:09.117287+0000 mgr.gibba009.xiladd (mgr.34457) 1390 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[31878]: audit 2021-03-10T20:36:10.038446+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:10.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:10 gibba004 bash[31878]: audit 2021-03-10T20:36:10.040322+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:36:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:10 gibba009 bash[26136]: cluster 2021-03-10T20:36:09.117287+0000 mgr.gibba009.xiladd (mgr.34457) 1390 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:10 gibba009 bash[26136]: audit 2021-03-10T20:36:10.038446+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:10 gibba009 bash[26136]: audit 2021-03-10T20:36:10.040322+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:36:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:12 gibba004 bash[30897]: cluster 2021-03-10T20:36:11.118875+0000 mgr.gibba009.xiladd (mgr.34457) 1391 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:12 gibba004 bash[31878]: cluster 2021-03-10T20:36:11.118875+0000 mgr.gibba009.xiladd (mgr.34457) 1391 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:12 gibba009 bash[26136]: cluster 2021-03-10T20:36:11.118875+0000 mgr.gibba009.xiladd (mgr.34457) 1391 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:14 gibba009 bash[26136]: cluster 2021-03-10T20:36:13.119597+0000 mgr.gibba009.xiladd (mgr.34457) 1392 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:14 gibba004 bash[31878]: cluster 2021-03-10T20:36:13.119597+0000 mgr.gibba009.xiladd (mgr.34457) 1392 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:14 gibba004 bash[30897]: cluster 2021-03-10T20:36:13.119597+0000 mgr.gibba009.xiladd (mgr.34457) 1392 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.498949+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.677043+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.868934+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.873073+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:15.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.874578+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.877073+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.878367+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.882273+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[30897]: audit 2021-03-10T20:36:14.884295+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.498949+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:15.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.677043+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.868934+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.873073+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:15.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.874578+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.877073+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.878367+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.882273+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:15 gibba004 bash[31878]: audit 2021-03-10T20:36:14.884295+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.498949+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:36:15.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.677043+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.868934+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:36:15.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.873073+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:15.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.874578+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.877073+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.878367+0000 mon.c (mon.1) 458 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.882273+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:15.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:15 gibba009 bash[26136]: audit 2021-03-10T20:36:14.884295+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.676972+0000 mgr.gibba009.xiladd (mgr.34457) 1393 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:36:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.870618+0000 mgr.gibba009.xiladd (mgr.34457) 1394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:16.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.872864+0000 mgr.gibba009.xiladd (mgr.34457) 1395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:16.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.874984+0000 mgr.gibba009.xiladd (mgr.34457) 1396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:16.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.875026+0000 mgr.gibba009.xiladd (mgr.34457) 1397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:16.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.876538+0000 mgr.gibba009.xiladd (mgr.34457) 1398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:16.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.876580+0000 mgr.gibba009.xiladd (mgr.34457) 1399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:16.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.878183+0000 mgr.gibba009.xiladd (mgr.34457) 1400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:16.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.880322+0000 mgr.gibba009.xiladd (mgr.34457) 1401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:16.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.880362+0000 mgr.gibba009.xiladd (mgr.34457) 1402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.882114+0000 mgr.gibba009.xiladd (mgr.34457) 1403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.882528+0000 mgr.gibba009.xiladd (mgr.34457) 1404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.883926+0000 mgr.gibba009.xiladd (mgr.34457) 1405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:16.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.883966+0000 mgr.gibba009.xiladd (mgr.34457) 1406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:16.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cephadm 2021-03-10T20:36:14.884106+0000 mgr.gibba009.xiladd (mgr.34457) 1407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:16.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[30897]: cluster 2021-03-10T20:36:15.121253+0000 mgr.gibba009.xiladd (mgr.34457) 1408 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.676972+0000 mgr.gibba009.xiladd (mgr.34457) 1393 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:36:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.870618+0000 mgr.gibba009.xiladd (mgr.34457) 1394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.872864+0000 mgr.gibba009.xiladd (mgr.34457) 1395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.874984+0000 mgr.gibba009.xiladd (mgr.34457) 1396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.875026+0000 mgr.gibba009.xiladd (mgr.34457) 1397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:16.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.876538+0000 mgr.gibba009.xiladd (mgr.34457) 1398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:16.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.876580+0000 mgr.gibba009.xiladd (mgr.34457) 1399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:16.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.878183+0000 mgr.gibba009.xiladd (mgr.34457) 1400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:16.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.880322+0000 mgr.gibba009.xiladd (mgr.34457) 1401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:16.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.880362+0000 mgr.gibba009.xiladd (mgr.34457) 1402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:16.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.882114+0000 mgr.gibba009.xiladd (mgr.34457) 1403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:16.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.882528+0000 mgr.gibba009.xiladd (mgr.34457) 1404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:16.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.883926+0000 mgr.gibba009.xiladd (mgr.34457) 1405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:16.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.883966+0000 mgr.gibba009.xiladd (mgr.34457) 1406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:16.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cephadm 2021-03-10T20:36:14.884106+0000 mgr.gibba009.xiladd (mgr.34457) 1407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:16.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:16 gibba004 bash[31878]: cluster 2021-03-10T20:36:15.121253+0000 mgr.gibba009.xiladd (mgr.34457) 1408 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.676972+0000 mgr.gibba009.xiladd (mgr.34457) 1393 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:36:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.870618+0000 mgr.gibba009.xiladd (mgr.34457) 1394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.872864+0000 mgr.gibba009.xiladd (mgr.34457) 1395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.874984+0000 mgr.gibba009.xiladd (mgr.34457) 1396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.875026+0000 mgr.gibba009.xiladd (mgr.34457) 1397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.876538+0000 mgr.gibba009.xiladd (mgr.34457) 1398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.876580+0000 mgr.gibba009.xiladd (mgr.34457) 1399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.878183+0000 mgr.gibba009.xiladd (mgr.34457) 1400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.880322+0000 mgr.gibba009.xiladd (mgr.34457) 1401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.880362+0000 mgr.gibba009.xiladd (mgr.34457) 1402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.882114+0000 mgr.gibba009.xiladd (mgr.34457) 1403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.882528+0000 mgr.gibba009.xiladd (mgr.34457) 1404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.883926+0000 mgr.gibba009.xiladd (mgr.34457) 1405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.883966+0000 mgr.gibba009.xiladd (mgr.34457) 1406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:16.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cephadm 2021-03-10T20:36:14.884106+0000 mgr.gibba009.xiladd (mgr.34457) 1407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:16.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:16 gibba009 bash[26136]: cluster 2021-03-10T20:36:15.121253+0000 mgr.gibba009.xiladd (mgr.34457) 1408 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:18 gibba004 bash[30897]: cluster 2021-03-10T20:36:17.122874+0000 mgr.gibba009.xiladd (mgr.34457) 1409 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:18 gibba004 bash[31878]: cluster 2021-03-10T20:36:17.122874+0000 mgr.gibba009.xiladd (mgr.34457) 1409 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:18 gibba009 bash[26136]: cluster 2021-03-10T20:36:17.122874+0000 mgr.gibba009.xiladd (mgr.34457) 1409 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:20 gibba004 bash[30897]: cluster 2021-03-10T20:36:19.124380+0000 mgr.gibba009.xiladd (mgr.34457) 1410 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:20 gibba004 bash[31878]: cluster 2021-03-10T20:36:19.124380+0000 mgr.gibba009.xiladd (mgr.34457) 1410 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:20 gibba009 bash[26136]: cluster 2021-03-10T20:36:19.124380+0000 mgr.gibba009.xiladd (mgr.34457) 1410 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:22 gibba004 bash[30897]: cluster 2021-03-10T20:36:21.125999+0000 mgr.gibba009.xiladd (mgr.34457) 1411 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:22 gibba004 bash[31878]: cluster 2021-03-10T20:36:21.125999+0000 mgr.gibba009.xiladd (mgr.34457) 1411 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:22 gibba009 bash[26136]: cluster 2021-03-10T20:36:21.125999+0000 mgr.gibba009.xiladd (mgr.34457) 1411 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:24 gibba004 bash[30897]: cluster 2021-03-10T20:36:23.127523+0000 mgr.gibba009.xiladd (mgr.34457) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:24 gibba004 bash[31878]: cluster 2021-03-10T20:36:23.127523+0000 mgr.gibba009.xiladd (mgr.34457) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:24 gibba009 bash[26136]: cluster 2021-03-10T20:36:23.127523+0000 mgr.gibba009.xiladd (mgr.34457) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:26 gibba004 bash[30897]: cluster 2021-03-10T20:36:25.129414+0000 mgr.gibba009.xiladd (mgr.34457) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:26 gibba004 bash[31878]: cluster 2021-03-10T20:36:25.129414+0000 mgr.gibba009.xiladd (mgr.34457) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:26 gibba009 bash[26136]: cluster 2021-03-10T20:36:25.129414+0000 mgr.gibba009.xiladd (mgr.34457) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:28 gibba004 bash[30897]: cluster 2021-03-10T20:36:27.131060+0000 mgr.gibba009.xiladd (mgr.34457) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:28 gibba004 bash[31878]: cluster 2021-03-10T20:36:27.131060+0000 mgr.gibba009.xiladd (mgr.34457) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:28 gibba009 bash[26136]: cluster 2021-03-10T20:36:27.131060+0000 mgr.gibba009.xiladd (mgr.34457) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:30 gibba004 bash[30897]: cluster 2021-03-10T20:36:29.132333+0000 mgr.gibba009.xiladd (mgr.34457) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:30 gibba004 bash[31878]: cluster 2021-03-10T20:36:29.132333+0000 mgr.gibba009.xiladd (mgr.34457) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:30 gibba009 bash[26136]: cluster 2021-03-10T20:36:29.132333+0000 mgr.gibba009.xiladd (mgr.34457) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.930 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:36:31.159 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:36:31.159 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (25m) 85s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:36:31.160 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (30m) 21s ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:36:31.160 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (25m) 21s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:36:31.160 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (26m) 21s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:36:31.160 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (25m) 85s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:36:31.161 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (24m) 85s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:36:31.161 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (24m) 21s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:36:31.161 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (24m) 85s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:36:31.161 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (30m) 85s ago 30m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:36:31.161 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (30m) 21s ago 30m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:36:31.162 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (23m) 85s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:36:31.162 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (23m) 85s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:36:31.162 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (22m) 85s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:36:31.162 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (22m) 85s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:36:31.163 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (22m) 21s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:36:31.163 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (21m) 21s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:36:31.164 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (21m) 21s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:36:31.164 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (20m) 21s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:36:31.165 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (30m) 21s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:36:31.165 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 85s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:31.165 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 21s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:31.409 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:36:31.409 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:36:31.410 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:31.410 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:31.411 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:36:31.411 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:31.412 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:31.412 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:36:31.412 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:36:31.413 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:36:31.413 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:36:31.414 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:36:31.414 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:36:31.415 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:36:31.415 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:36:31.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:31 gibba004 bash[30897]: cephadm 2021-03-10T20:36:29.889636+0000 mgr.gibba009.xiladd (mgr.34457) 1416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:31.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:31 gibba004 bash[31878]: cephadm 2021-03-10T20:36:29.889636+0000 mgr.gibba009.xiladd (mgr.34457) 1416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:31.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:31 gibba009 bash[26136]: cephadm 2021-03-10T20:36:29.889636+0000 mgr.gibba009.xiladd (mgr.34457) 1416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[30897]: audit 2021-03-10T20:36:30.920404+0000 mgr.gibba009.xiladd (mgr.34457) 1417 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[30897]: cluster 2021-03-10T20:36:31.134142+0000 mgr.gibba009.xiladd (mgr.34457) 1418 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[30897]: audit 2021-03-10T20:36:31.143502+0000 mgr.gibba009.xiladd (mgr.34457) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[30897]: audit 2021-03-10T20:36:31.409118+0000 mon.c (mon.1) 461 : audit [DBG] from='client.? 172.21.2.104:0/3849515545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[31878]: audit 2021-03-10T20:36:30.920404+0000 mgr.gibba009.xiladd (mgr.34457) 1417 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[31878]: cluster 2021-03-10T20:36:31.134142+0000 mgr.gibba009.xiladd (mgr.34457) 1418 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[31878]: audit 2021-03-10T20:36:31.143502+0000 mgr.gibba009.xiladd (mgr.34457) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:32 gibba004 bash[31878]: audit 2021-03-10T20:36:31.409118+0000 mon.c (mon.1) 461 : audit [DBG] from='client.? 172.21.2.104:0/3849515545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:32 gibba009 bash[26136]: audit 2021-03-10T20:36:30.920404+0000 mgr.gibba009.xiladd (mgr.34457) 1417 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:32 gibba009 bash[26136]: cluster 2021-03-10T20:36:31.134142+0000 mgr.gibba009.xiladd (mgr.34457) 1418 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:32 gibba009 bash[26136]: audit 2021-03-10T20:36:31.143502+0000 mgr.gibba009.xiladd (mgr.34457) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:32.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:32 gibba009 bash[26136]: audit 2021-03-10T20:36:31.409118+0000 mon.c (mon.1) 461 : audit [DBG] from='client.? 172.21.2.104:0/3849515545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:34.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:34 gibba004 bash[30897]: cluster 2021-03-10T20:36:33.135694+0000 mgr.gibba009.xiladd (mgr.34457) 1420 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:34 gibba004 bash[31878]: cluster 2021-03-10T20:36:33.135694+0000 mgr.gibba009.xiladd (mgr.34457) 1420 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:34.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:34 gibba009 bash[26136]: cluster 2021-03-10T20:36:33.135694+0000 mgr.gibba009.xiladd (mgr.34457) 1420 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:36 gibba004 bash[30897]: cluster 2021-03-10T20:36:35.137469+0000 mgr.gibba009.xiladd (mgr.34457) 1421 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:36 gibba004 bash[31878]: cluster 2021-03-10T20:36:35.137469+0000 mgr.gibba009.xiladd (mgr.34457) 1421 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:36 gibba009 bash[26136]: cluster 2021-03-10T20:36:35.137469+0000 mgr.gibba009.xiladd (mgr.34457) 1421 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:38 gibba004 bash[30897]: cluster 2021-03-10T20:36:37.139063+0000 mgr.gibba009.xiladd (mgr.34457) 1422 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:38 gibba004 bash[31878]: cluster 2021-03-10T20:36:37.139063+0000 mgr.gibba009.xiladd (mgr.34457) 1422 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:38 gibba009 bash[26136]: cluster 2021-03-10T20:36:37.139063+0000 mgr.gibba009.xiladd (mgr.34457) 1422 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: cluster 2021-03-10T20:36:39.140449+0000 mgr.gibba009.xiladd (mgr.34457) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.697134+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.697888+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.698404+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.698590+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.699462+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.699652+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.700799+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.701580+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.718936+0000 mon.c (mon.1) 466 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.719599+0000 mon.c (mon.1) 467 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.719935+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:40 gibba009 bash[26136]: audit 2021-03-10T20:36:39.720917+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: cluster 2021-03-10T20:36:39.140449+0000 mgr.gibba009.xiladd (mgr.34457) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.697134+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.697888+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.698404+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.698590+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.699462+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.699652+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.700799+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.701580+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.718936+0000 mon.c (mon.1) 466 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.719599+0000 mon.c (mon.1) 467 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.719935+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[30897]: audit 2021-03-10T20:36:39.720917+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: cluster 2021-03-10T20:36:39.140449+0000 mgr.gibba009.xiladd (mgr.34457) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.697134+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.697888+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.698404+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:36:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.698590+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.699462+0000 mon.c (mon.1) 465 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.699652+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.700799+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:36:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.701580+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:36:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.718936+0000 mon.c (mon.1) 466 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.719599+0000 mon.c (mon.1) 467 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.719935+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:40 gibba004 bash[31878]: audit 2021-03-10T20:36:39.720917+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:42 gibba009 bash[26136]: cluster 2021-03-10T20:36:41.142082+0000 mgr.gibba009.xiladd (mgr.34457) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:42 gibba004 bash[30897]: cluster 2021-03-10T20:36:41.142082+0000 mgr.gibba009.xiladd (mgr.34457) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:42 gibba004 bash[31878]: cluster 2021-03-10T20:36:41.142082+0000 mgr.gibba009.xiladd (mgr.34457) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:44 gibba009 bash[26136]: cluster 2021-03-10T20:36:43.143652+0000 mgr.gibba009.xiladd (mgr.34457) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:44 gibba004 bash[30897]: cluster 2021-03-10T20:36:43.143652+0000 mgr.gibba009.xiladd (mgr.34457) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:44 gibba004 bash[31878]: cluster 2021-03-10T20:36:43.143652+0000 mgr.gibba009.xiladd (mgr.34457) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:46 gibba004 bash[30897]: cephadm 2021-03-10T20:36:44.904948+0000 mgr.gibba009.xiladd (mgr.34457) 1426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:46.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:46 gibba004 bash[30897]: cluster 2021-03-10T20:36:45.145420+0000 mgr.gibba009.xiladd (mgr.34457) 1427 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:46 gibba004 bash[31878]: cephadm 2021-03-10T20:36:44.904948+0000 mgr.gibba009.xiladd (mgr.34457) 1426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:46.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:46 gibba004 bash[31878]: cluster 2021-03-10T20:36:45.145420+0000 mgr.gibba009.xiladd (mgr.34457) 1427 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:46 gibba009 bash[26136]: cephadm 2021-03-10T20:36:44.904948+0000 mgr.gibba009.xiladd (mgr.34457) 1426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:36:46.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:46 gibba009 bash[26136]: cluster 2021-03-10T20:36:45.145420+0000 mgr.gibba009.xiladd (mgr.34457) 1427 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:48 gibba004 bash[30897]: cluster 2021-03-10T20:36:47.147023+0000 mgr.gibba009.xiladd (mgr.34457) 1428 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:48 gibba004 bash[31878]: cluster 2021-03-10T20:36:47.147023+0000 mgr.gibba009.xiladd (mgr.34457) 1428 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:48 gibba009 bash[26136]: cluster 2021-03-10T20:36:47.147023+0000 mgr.gibba009.xiladd (mgr.34457) 1428 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:50 gibba004 bash[30897]: cluster 2021-03-10T20:36:49.148258+0000 mgr.gibba009.xiladd (mgr.34457) 1429 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:50 gibba004 bash[31878]: cluster 2021-03-10T20:36:49.148258+0000 mgr.gibba009.xiladd (mgr.34457) 1429 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:50 gibba009 bash[26136]: cluster 2021-03-10T20:36:49.148258+0000 mgr.gibba009.xiladd (mgr.34457) 1429 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:52 gibba004 bash[30897]: cluster 2021-03-10T20:36:51.149919+0000 mgr.gibba009.xiladd (mgr.34457) 1430 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:52 gibba004 bash[31878]: cluster 2021-03-10T20:36:51.149919+0000 mgr.gibba009.xiladd (mgr.34457) 1430 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:52 gibba009 bash[26136]: cluster 2021-03-10T20:36:51.149919+0000 mgr.gibba009.xiladd (mgr.34457) 1430 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:54 gibba004 bash[30897]: cluster 2021-03-10T20:36:53.151427+0000 mgr.gibba009.xiladd (mgr.34457) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:54 gibba004 bash[31878]: cluster 2021-03-10T20:36:53.151427+0000 mgr.gibba009.xiladd (mgr.34457) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:54 gibba009 bash[26136]: cluster 2021-03-10T20:36:53.151427+0000 mgr.gibba009.xiladd (mgr.34457) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:56 gibba004 bash[30897]: cluster 2021-03-10T20:36:55.153206+0000 mgr.gibba009.xiladd (mgr.34457) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:56 gibba004 bash[31878]: cluster 2021-03-10T20:36:55.153206+0000 mgr.gibba009.xiladd (mgr.34457) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:56 gibba009 bash[26136]: cluster 2021-03-10T20:36:55.153206+0000 mgr.gibba009.xiladd (mgr.34457) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:36:58 gibba004 bash[30897]: cluster 2021-03-10T20:36:57.154680+0000 mgr.gibba009.xiladd (mgr.34457) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:36:58 gibba004 bash[31878]: cluster 2021-03-10T20:36:57.154680+0000 mgr.gibba009.xiladd (mgr.34457) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:36:58 gibba009 bash[26136]: cluster 2021-03-10T20:36:57.154680+0000 mgr.gibba009.xiladd (mgr.34457) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:00.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:00 gibba004 bash[30897]: cluster 2021-03-10T20:36:59.155199+0000 mgr.gibba009.xiladd (mgr.34457) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:01.223 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:00 gibba004 bash[31878]: cluster 2021-03-10T20:36:59.155199+0000 mgr.gibba009.xiladd (mgr.34457) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:01.224 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:00 gibba009 bash[26136]: cluster 2021-03-10T20:36:59.155199+0000 mgr.gibba009.xiladd (mgr.34457) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:01.651 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:37:01.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:01 gibba004 bash[30897]: cephadm 2021-03-10T20:36:59.920751+0000 mgr.gibba009.xiladd (mgr.34457) 1435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:01.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:01 gibba004 bash[31878]: cephadm 2021-03-10T20:36:59.920751+0000 mgr.gibba009.xiladd (mgr.34457) 1435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:01.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:01 gibba009 bash[26136]: cephadm 2021-03-10T20:36:59.920751+0000 mgr.gibba009.xiladd (mgr.34457) 1435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:01.878 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:37:01.879 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (25m) 115s ago 31m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:37:01.879 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (31m) 51s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:37:01.879 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (26m) 51s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:37:01.879 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (26m) 51s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:37:01.879 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (25m) 115s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:37:01.880 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (25m) 115s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:37:01.880 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (25m) 51s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:37:01.880 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (25m) 115s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:37:01.880 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (31m) 115s ago 31m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:37:01.881 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (31m) 51s ago 31m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:37:01.881 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (24m) 115s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:37:01.881 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (23m) 115s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:37:01.881 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (23m) 115s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:37:01.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (23m) 115s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:37:01.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (22m) 51s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:37:01.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (22m) 51s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:37:01.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (21m) 51s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:37:01.882 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (21m) 51s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:37:01.883 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (30m) 51s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:37:01.883 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 115s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:01.883 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 51s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:02.124 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:37:02.124 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:37:02.125 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:02.125 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:02.125 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:37:02.126 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:02.126 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:02.126 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:37:02.126 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:37:02.127 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:02.127 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:37:02.127 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:37:02.127 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:37:02.128 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:37:02.128 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:37:02.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:02 gibba004 bash[30897]: cluster 2021-03-10T20:37:01.156840+0000 mgr.gibba009.xiladd (mgr.34457) 1436 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:02 gibba004 bash[30897]: audit 2021-03-10T20:37:02.124084+0000 mon.c (mon.1) 468 : audit [DBG] from='client.? 172.21.2.104:0/339838083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:02 gibba004 bash[31878]: cluster 2021-03-10T20:37:01.156840+0000 mgr.gibba009.xiladd (mgr.34457) 1436 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:02 gibba004 bash[31878]: audit 2021-03-10T20:37:02.124084+0000 mon.c (mon.1) 468 : audit [DBG] from='client.? 172.21.2.104:0/339838083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:02 gibba009 bash[26136]: cluster 2021-03-10T20:37:01.156840+0000 mgr.gibba009.xiladd (mgr.34457) 1436 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:02 gibba009 bash[26136]: audit 2021-03-10T20:37:02.124084+0000 mon.c (mon.1) 468 : audit [DBG] from='client.? 172.21.2.104:0/339838083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:03 gibba004 bash[30897]: audit 2021-03-10T20:37:01.641075+0000 mgr.gibba009.xiladd (mgr.34457) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:03 gibba004 bash[30897]: audit 2021-03-10T20:37:01.863988+0000 mgr.gibba009.xiladd (mgr.34457) 1438 : audit [DBG] from='client.55015 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:03.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:03 gibba004 bash[31878]: audit 2021-03-10T20:37:01.641075+0000 mgr.gibba009.xiladd (mgr.34457) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:03.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:03 gibba004 bash[31878]: audit 2021-03-10T20:37:01.863988+0000 mgr.gibba009.xiladd (mgr.34457) 1438 : audit [DBG] from='client.55015 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:03.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:03 gibba009 bash[26136]: audit 2021-03-10T20:37:01.641075+0000 mgr.gibba009.xiladd (mgr.34457) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:03.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:03 gibba009 bash[26136]: audit 2021-03-10T20:37:01.863988+0000 mgr.gibba009.xiladd (mgr.34457) 1438 : audit [DBG] from='client.55015 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:04.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:04 gibba004 bash[30897]: cluster 2021-03-10T20:37:03.158154+0000 mgr.gibba009.xiladd (mgr.34457) 1439 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:04.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:04 gibba004 bash[31878]: cluster 2021-03-10T20:37:03.158154+0000 mgr.gibba009.xiladd (mgr.34457) 1439 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:04 gibba009 bash[26136]: cluster 2021-03-10T20:37:03.158154+0000 mgr.gibba009.xiladd (mgr.34457) 1439 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:06 gibba004 bash[30897]: cluster 2021-03-10T20:37:05.159803+0000 mgr.gibba009.xiladd (mgr.34457) 1440 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:06 gibba004 bash[31878]: cluster 2021-03-10T20:37:05.159803+0000 mgr.gibba009.xiladd (mgr.34457) 1440 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:06 gibba009 bash[26136]: cluster 2021-03-10T20:37:05.159803+0000 mgr.gibba009.xiladd (mgr.34457) 1440 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:08 gibba004 bash[30897]: cluster 2021-03-10T20:37:07.161472+0000 mgr.gibba009.xiladd (mgr.34457) 1441 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:08 gibba004 bash[31878]: cluster 2021-03-10T20:37:07.161472+0000 mgr.gibba009.xiladd (mgr.34457) 1441 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:08 gibba009 bash[26136]: cluster 2021-03-10T20:37:07.161472+0000 mgr.gibba009.xiladd (mgr.34457) 1441 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:10 gibba004 bash[30897]: cluster 2021-03-10T20:37:09.162778+0000 mgr.gibba009.xiladd (mgr.34457) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:10 gibba004 bash[31878]: cluster 2021-03-10T20:37:09.162778+0000 mgr.gibba009.xiladd (mgr.34457) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:10 gibba009 bash[26136]: cluster 2021-03-10T20:37:09.162778+0000 mgr.gibba009.xiladd (mgr.34457) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:12 gibba004 bash[30897]: cluster 2021-03-10T20:37:11.164507+0000 mgr.gibba009.xiladd (mgr.34457) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:12 gibba004 bash[31878]: cluster 2021-03-10T20:37:11.164507+0000 mgr.gibba009.xiladd (mgr.34457) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:12 gibba009 bash[26136]: cluster 2021-03-10T20:37:11.164507+0000 mgr.gibba009.xiladd (mgr.34457) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:14.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:14 gibba004 bash[30897]: cluster 2021-03-10T20:37:13.166056+0000 mgr.gibba009.xiladd (mgr.34457) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:14 gibba004 bash[31878]: cluster 2021-03-10T20:37:13.166056+0000 mgr.gibba009.xiladd (mgr.34457) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:14 gibba009 bash[26136]: cluster 2021-03-10T20:37:13.166056+0000 mgr.gibba009.xiladd (mgr.34457) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:15.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:14.939085+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.151779+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:37:15.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.155644+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.157135+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.158561+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.159761+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.162924+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[30897]: audit 2021-03-10T20:37:15.164338+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:14.939085+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.151779+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:37:15.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.155644+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.157135+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.158561+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.159761+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.162924+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:15 gibba004 bash[31878]: audit 2021-03-10T20:37:15.164338+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:14.939085+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.151779+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:37:15.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.155644+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:15.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.157135+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.158561+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.159761+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.162924+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:15.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:15 gibba009 bash[26136]: audit 2021-03-10T20:37:15.164338+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:16.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:14.942866+0000 mgr.gibba009.xiladd (mgr.34457) 1445 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:37:16.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:14.944724+0000 mgr.gibba009.xiladd (mgr.34457) 1446 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:37:16.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.153560+0000 mgr.gibba009.xiladd (mgr.34457) 1447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:16.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.155326+0000 mgr.gibba009.xiladd (mgr.34457) 1448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:16.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.156650+0000 mgr.gibba009.xiladd (mgr.34457) 1449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:16.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.156783+0000 mgr.gibba009.xiladd (mgr.34457) 1450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.157897+0000 mgr.gibba009.xiladd (mgr.34457) 1451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.157937+0000 mgr.gibba009.xiladd (mgr.34457) 1452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.159284+0000 mgr.gibba009.xiladd (mgr.34457) 1453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.160936+0000 mgr.gibba009.xiladd (mgr.34457) 1454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.160975+0000 mgr.gibba009.xiladd (mgr.34457) 1455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.162264+0000 mgr.gibba009.xiladd (mgr.34457) 1456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.162585+0000 mgr.gibba009.xiladd (mgr.34457) 1457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.163632+0000 mgr.gibba009.xiladd (mgr.34457) 1458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.163672+0000 mgr.gibba009.xiladd (mgr.34457) 1459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cephadm 2021-03-10T20:37:15.163800+0000 mgr.gibba009.xiladd (mgr.34457) 1460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[31878]: cluster 2021-03-10T20:37:15.166572+0000 mgr.gibba009.xiladd (mgr.34457) 1461 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:16.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:14.942866+0000 mgr.gibba009.xiladd (mgr.34457) 1445 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:37:16.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:14.944724+0000 mgr.gibba009.xiladd (mgr.34457) 1446 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:37:16.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.153560+0000 mgr.gibba009.xiladd (mgr.34457) 1447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:16.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.155326+0000 mgr.gibba009.xiladd (mgr.34457) 1448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:16.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.156650+0000 mgr.gibba009.xiladd (mgr.34457) 1449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:16.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.156783+0000 mgr.gibba009.xiladd (mgr.34457) 1450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:16.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.157897+0000 mgr.gibba009.xiladd (mgr.34457) 1451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:16.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.157937+0000 mgr.gibba009.xiladd (mgr.34457) 1452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:16.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.159284+0000 mgr.gibba009.xiladd (mgr.34457) 1453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:16.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.160936+0000 mgr.gibba009.xiladd (mgr.34457) 1454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:16.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.160975+0000 mgr.gibba009.xiladd (mgr.34457) 1455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:16.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.162264+0000 mgr.gibba009.xiladd (mgr.34457) 1456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:16.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.162585+0000 mgr.gibba009.xiladd (mgr.34457) 1457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:16.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.163632+0000 mgr.gibba009.xiladd (mgr.34457) 1458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:16.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.163672+0000 mgr.gibba009.xiladd (mgr.34457) 1459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:16.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cephadm 2021-03-10T20:37:15.163800+0000 mgr.gibba009.xiladd (mgr.34457) 1460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:16.823 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:16 gibba004 bash[30897]: cluster 2021-03-10T20:37:15.166572+0000 mgr.gibba009.xiladd (mgr.34457) 1461 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:16.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:14.942866+0000 mgr.gibba009.xiladd (mgr.34457) 1445 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:37:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:14.944724+0000 mgr.gibba009.xiladd (mgr.34457) 1446 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:37:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.153560+0000 mgr.gibba009.xiladd (mgr.34457) 1447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.155326+0000 mgr.gibba009.xiladd (mgr.34457) 1448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.156650+0000 mgr.gibba009.xiladd (mgr.34457) 1449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.156783+0000 mgr.gibba009.xiladd (mgr.34457) 1450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.157897+0000 mgr.gibba009.xiladd (mgr.34457) 1451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.157937+0000 mgr.gibba009.xiladd (mgr.34457) 1452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.159284+0000 mgr.gibba009.xiladd (mgr.34457) 1453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.160936+0000 mgr.gibba009.xiladd (mgr.34457) 1454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.160975+0000 mgr.gibba009.xiladd (mgr.34457) 1455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.162264+0000 mgr.gibba009.xiladd (mgr.34457) 1456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.162585+0000 mgr.gibba009.xiladd (mgr.34457) 1457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.163632+0000 mgr.gibba009.xiladd (mgr.34457) 1458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.163672+0000 mgr.gibba009.xiladd (mgr.34457) 1459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:16.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cephadm 2021-03-10T20:37:15.163800+0000 mgr.gibba009.xiladd (mgr.34457) 1460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:16.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:16 gibba009 bash[26136]: cluster 2021-03-10T20:37:15.166572+0000 mgr.gibba009.xiladd (mgr.34457) 1461 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:18 gibba004 bash[31878]: cluster 2021-03-10T20:37:17.168061+0000 mgr.gibba009.xiladd (mgr.34457) 1462 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:18 gibba004 bash[30897]: cluster 2021-03-10T20:37:17.168061+0000 mgr.gibba009.xiladd (mgr.34457) 1462 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:18 gibba009 bash[26136]: cluster 2021-03-10T20:37:17.168061+0000 mgr.gibba009.xiladd (mgr.34457) 1462 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.562 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:20 gibba004 bash[31878]: cluster 2021-03-10T20:37:19.169352+0000 mgr.gibba009.xiladd (mgr.34457) 1463 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:20 gibba004 bash[30897]: cluster 2021-03-10T20:37:19.169352+0000 mgr.gibba009.xiladd (mgr.34457) 1463 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:20 gibba009 bash[26136]: cluster 2021-03-10T20:37:19.169352+0000 mgr.gibba009.xiladd (mgr.34457) 1463 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:22 gibba004 bash[30897]: cluster 2021-03-10T20:37:21.171198+0000 mgr.gibba009.xiladd (mgr.34457) 1464 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:22 gibba004 bash[31878]: cluster 2021-03-10T20:37:21.171198+0000 mgr.gibba009.xiladd (mgr.34457) 1464 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:22 gibba009 bash[26136]: cluster 2021-03-10T20:37:21.171198+0000 mgr.gibba009.xiladd (mgr.34457) 1464 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:24 gibba004 bash[30897]: cluster 2021-03-10T20:37:23.172587+0000 mgr.gibba009.xiladd (mgr.34457) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:24 gibba004 bash[31878]: cluster 2021-03-10T20:37:23.172587+0000 mgr.gibba009.xiladd (mgr.34457) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:24 gibba009 bash[26136]: cluster 2021-03-10T20:37:23.172587+0000 mgr.gibba009.xiladd (mgr.34457) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:26 gibba004 bash[30897]: cluster 2021-03-10T20:37:25.174370+0000 mgr.gibba009.xiladd (mgr.34457) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:26 gibba004 bash[31878]: cluster 2021-03-10T20:37:25.174370+0000 mgr.gibba009.xiladd (mgr.34457) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:26 gibba009 bash[26136]: cluster 2021-03-10T20:37:25.174370+0000 mgr.gibba009.xiladd (mgr.34457) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:28 gibba004 bash[30897]: cluster 2021-03-10T20:37:27.175931+0000 mgr.gibba009.xiladd (mgr.34457) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:28 gibba004 bash[31878]: cluster 2021-03-10T20:37:27.175931+0000 mgr.gibba009.xiladd (mgr.34457) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:28 gibba009 bash[26136]: cluster 2021-03-10T20:37:27.175931+0000 mgr.gibba009.xiladd (mgr.34457) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:30 gibba004 bash[30897]: cluster 2021-03-10T20:37:29.176573+0000 mgr.gibba009.xiladd (mgr.34457) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:30 gibba004 bash[31878]: cluster 2021-03-10T20:37:29.176573+0000 mgr.gibba009.xiladd (mgr.34457) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:30 gibba009 bash[26136]: cluster 2021-03-10T20:37:29.176573+0000 mgr.gibba009.xiladd (mgr.34457) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:31.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:31 gibba004 bash[30897]: cephadm 2021-03-10T20:37:30.170896+0000 mgr.gibba009.xiladd (mgr.34457) 1469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:31.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:31 gibba004 bash[31878]: cephadm 2021-03-10T20:37:30.170896+0000 mgr.gibba009.xiladd (mgr.34457) 1469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:31.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:31 gibba009 bash[26136]: cephadm 2021-03-10T20:37:30.170896+0000 mgr.gibba009.xiladd (mgr.34457) 1469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:32.369 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:37:32.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:32 gibba004 bash[30897]: cluster 2021-03-10T20:37:31.178272+0000 mgr.gibba009.xiladd (mgr.34457) 1470 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:32 gibba004 bash[31878]: cluster 2021-03-10T20:37:31.178272+0000 mgr.gibba009.xiladd (mgr.34457) 1470 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:32 gibba009 bash[26136]: cluster 2021-03-10T20:37:31.178272+0000 mgr.gibba009.xiladd (mgr.34457) 1470 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.598 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:37:32.599 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (26m) 2m ago 31m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:37:32.599 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (31m) 82s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:37:32.599 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (26m) 82s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:37:32.599 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (27m) 82s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:37:32.600 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:37:32.600 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:37:32.600 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (25m) 82s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:37:32.600 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:37:32.601 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (31m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:37:32.601 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (31m) 82s ago 32m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:37:32.601 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:37:32.601 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:37:32.601 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:37:32.602 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:37:32.602 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (23m) 82s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:37:32.602 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (22m) 82s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:37:32.602 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (22m) 82s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:37:32.603 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (21m) 82s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:37:32.603 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (31m) 82s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:37:32.603 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:32.603 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 82s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:32.846 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:37:32.846 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:37:32.846 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:32.847 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:32.847 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:37:32.847 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:32.847 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:32.848 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:37:32.848 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:37:32.848 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:37:32.848 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:37:32.848 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:37:32.849 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:37:32.849 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:37:32.849 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:37:33.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:33 gibba004 bash[30897]: audit 2021-03-10T20:37:32.358600+0000 mgr.gibba009.xiladd (mgr.34457) 1471 : audit [DBG] from='client.55027 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:33.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:33 gibba004 bash[30897]: audit 2021-03-10T20:37:32.845930+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.104:0/3291846339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:33.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:33 gibba004 bash[31878]: audit 2021-03-10T20:37:32.358600+0000 mgr.gibba009.xiladd (mgr.34457) 1471 : audit [DBG] from='client.55027 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:33.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:33 gibba004 bash[31878]: audit 2021-03-10T20:37:32.845930+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.104:0/3291846339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:33.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:33 gibba009 bash[26136]: audit 2021-03-10T20:37:32.358600+0000 mgr.gibba009.xiladd (mgr.34457) 1471 : audit [DBG] from='client.55027 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:33.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:33 gibba009 bash[26136]: audit 2021-03-10T20:37:32.845930+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.104:0/3291846339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:34 gibba004 bash[30897]: audit 2021-03-10T20:37:32.584405+0000 mgr.gibba009.xiladd (mgr.34457) 1472 : audit [DBG] from='client.55033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:34 gibba004 bash[30897]: cluster 2021-03-10T20:37:33.179505+0000 mgr.gibba009.xiladd (mgr.34457) 1473 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:34 gibba004 bash[31878]: audit 2021-03-10T20:37:32.584405+0000 mgr.gibba009.xiladd (mgr.34457) 1472 : audit [DBG] from='client.55033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:34.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:34 gibba004 bash[31878]: cluster 2021-03-10T20:37:33.179505+0000 mgr.gibba009.xiladd (mgr.34457) 1473 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:34 gibba009 bash[26136]: audit 2021-03-10T20:37:32.584405+0000 mgr.gibba009.xiladd (mgr.34457) 1472 : audit [DBG] from='client.55033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:34.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:34 gibba009 bash[26136]: cluster 2021-03-10T20:37:33.179505+0000 mgr.gibba009.xiladd (mgr.34457) 1473 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:36 gibba004 bash[30897]: cluster 2021-03-10T20:37:35.181348+0000 mgr.gibba009.xiladd (mgr.34457) 1474 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:36 gibba004 bash[31878]: cluster 2021-03-10T20:37:35.181348+0000 mgr.gibba009.xiladd (mgr.34457) 1474 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:36 gibba009 bash[26136]: cluster 2021-03-10T20:37:35.181348+0000 mgr.gibba009.xiladd (mgr.34457) 1474 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:38 gibba004 bash[30897]: cluster 2021-03-10T20:37:37.182899+0000 mgr.gibba009.xiladd (mgr.34457) 1475 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:38 gibba004 bash[31878]: cluster 2021-03-10T20:37:37.182899+0000 mgr.gibba009.xiladd (mgr.34457) 1475 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:38 gibba009 bash[26136]: cluster 2021-03-10T20:37:37.182899+0000 mgr.gibba009.xiladd (mgr.34457) 1475 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: cluster 2021-03-10T20:37:39.184144+0000 mgr.gibba009.xiladd (mgr.34457) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.707393+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.708124+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.708590+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.708826+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.709647+0000 mon.c (mon.1) 479 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.709778+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.710902+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.711655+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.723176+0000 mon.c (mon.1) 480 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.723803+0000 mon.c (mon.1) 481 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.724291+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[30897]: audit 2021-03-10T20:37:39.725440+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: cluster 2021-03-10T20:37:39.184144+0000 mgr.gibba009.xiladd (mgr.34457) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.707393+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.708124+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.708590+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.708826+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.709647+0000 mon.c (mon.1) 479 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.709778+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.710902+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.711655+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.723176+0000 mon.c (mon.1) 480 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.723803+0000 mon.c (mon.1) 481 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.724291+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:40 gibba004 bash[31878]: audit 2021-03-10T20:37:39.725440+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: cluster 2021-03-10T20:37:39.184144+0000 mgr.gibba009.xiladd (mgr.34457) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.707393+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.708124+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.708590+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T20:37:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.708826+0000 mon.c (mon.1) 478 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.709647+0000 mon.c (mon.1) 479 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.709778+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.710902+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:37:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.711655+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.723176+0000 mon.c (mon.1) 480 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.723803+0000 mon.c (mon.1) 481 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:40.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.724291+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:40.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:40 gibba009 bash[26136]: audit 2021-03-10T20:37:39.725440+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:42 gibba004 bash[30897]: cluster 2021-03-10T20:37:41.185917+0000 mgr.gibba009.xiladd (mgr.34457) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:42 gibba004 bash[31878]: cluster 2021-03-10T20:37:41.185917+0000 mgr.gibba009.xiladd (mgr.34457) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:42 gibba009 bash[26136]: cluster 2021-03-10T20:37:41.185917+0000 mgr.gibba009.xiladd (mgr.34457) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:44 gibba004 bash[30897]: cluster 2021-03-10T20:37:43.187391+0000 mgr.gibba009.xiladd (mgr.34457) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:44 gibba004 bash[31878]: cluster 2021-03-10T20:37:43.187391+0000 mgr.gibba009.xiladd (mgr.34457) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:44.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:44 gibba009 bash[26136]: cluster 2021-03-10T20:37:43.187391+0000 mgr.gibba009.xiladd (mgr.34457) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:46 gibba004 bash[30897]: cephadm 2021-03-10T20:37:45.186952+0000 mgr.gibba009.xiladd (mgr.34457) 1479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:46.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:46 gibba004 bash[30897]: cluster 2021-03-10T20:37:45.188896+0000 mgr.gibba009.xiladd (mgr.34457) 1480 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:46 gibba004 bash[31878]: cephadm 2021-03-10T20:37:45.186952+0000 mgr.gibba009.xiladd (mgr.34457) 1479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:46.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:46 gibba004 bash[31878]: cluster 2021-03-10T20:37:45.188896+0000 mgr.gibba009.xiladd (mgr.34457) 1480 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:46 gibba009 bash[26136]: cephadm 2021-03-10T20:37:45.186952+0000 mgr.gibba009.xiladd (mgr.34457) 1479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:37:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:46 gibba009 bash[26136]: cluster 2021-03-10T20:37:45.188896+0000 mgr.gibba009.xiladd (mgr.34457) 1480 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:48 gibba009 bash[26136]: cluster 2021-03-10T20:37:47.190493+0000 mgr.gibba009.xiladd (mgr.34457) 1481 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:48 gibba004 bash[30897]: cluster 2021-03-10T20:37:47.190493+0000 mgr.gibba009.xiladd (mgr.34457) 1481 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:48 gibba004 bash[31878]: cluster 2021-03-10T20:37:47.190493+0000 mgr.gibba009.xiladd (mgr.34457) 1481 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:50 gibba004 bash[30897]: cluster 2021-03-10T20:37:49.191198+0000 mgr.gibba009.xiladd (mgr.34457) 1482 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:50 gibba004 bash[31878]: cluster 2021-03-10T20:37:49.191198+0000 mgr.gibba009.xiladd (mgr.34457) 1482 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:50 gibba009 bash[26136]: cluster 2021-03-10T20:37:49.191198+0000 mgr.gibba009.xiladd (mgr.34457) 1482 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:52 gibba004 bash[30897]: cluster 2021-03-10T20:37:51.192705+0000 mgr.gibba009.xiladd (mgr.34457) 1483 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:52 gibba004 bash[31878]: cluster 2021-03-10T20:37:51.192705+0000 mgr.gibba009.xiladd (mgr.34457) 1483 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:52 gibba009 bash[26136]: cluster 2021-03-10T20:37:51.192705+0000 mgr.gibba009.xiladd (mgr.34457) 1483 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:54 gibba004 bash[30897]: cluster 2021-03-10T20:37:53.194269+0000 mgr.gibba009.xiladd (mgr.34457) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:54 gibba004 bash[31878]: cluster 2021-03-10T20:37:53.194269+0000 mgr.gibba009.xiladd (mgr.34457) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:54 gibba009 bash[26136]: cluster 2021-03-10T20:37:53.194269+0000 mgr.gibba009.xiladd (mgr.34457) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:56 gibba004 bash[30897]: cluster 2021-03-10T20:37:55.196061+0000 mgr.gibba009.xiladd (mgr.34457) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:56 gibba004 bash[31878]: cluster 2021-03-10T20:37:55.196061+0000 mgr.gibba009.xiladd (mgr.34457) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:56 gibba009 bash[26136]: cluster 2021-03-10T20:37:55.196061+0000 mgr.gibba009.xiladd (mgr.34457) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:37:58 gibba004 bash[30897]: cluster 2021-03-10T20:37:57.197736+0000 mgr.gibba009.xiladd (mgr.34457) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:37:58 gibba004 bash[31878]: cluster 2021-03-10T20:37:57.197736+0000 mgr.gibba009.xiladd (mgr.34457) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:37:58 gibba009 bash[26136]: cluster 2021-03-10T20:37:57.197736+0000 mgr.gibba009.xiladd (mgr.34457) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:00.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:00 gibba004 bash[30897]: cluster 2021-03-10T20:37:59.198986+0000 mgr.gibba009.xiladd (mgr.34457) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:00 gibba004 bash[31878]: cluster 2021-03-10T20:37:59.198986+0000 mgr.gibba009.xiladd (mgr.34457) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:00 gibba009 bash[26136]: cluster 2021-03-10T20:37:59.198986+0000 mgr.gibba009.xiladd (mgr.34457) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:01.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:01 gibba004 bash[30897]: cephadm 2021-03-10T20:38:00.201384+0000 mgr.gibba009.xiladd (mgr.34457) 1488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:01.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:01 gibba004 bash[31878]: cephadm 2021-03-10T20:38:00.201384+0000 mgr.gibba009.xiladd (mgr.34457) 1488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:01.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:01 gibba009 bash[26136]: cephadm 2021-03-10T20:38:00.201384+0000 mgr.gibba009.xiladd (mgr.34457) 1488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:02.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:02 gibba004 bash[30897]: cluster 2021-03-10T20:38:01.200757+0000 mgr.gibba009.xiladd (mgr.34457) 1489 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:02 gibba004 bash[31878]: cluster 2021-03-10T20:38:01.200757+0000 mgr.gibba009.xiladd (mgr.34457) 1489 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:02.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:02 gibba009 bash[26136]: cluster 2021-03-10T20:38:01.200757+0000 mgr.gibba009.xiladd (mgr.34457) 1489 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:03.091 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:38:03.350 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:38:03.350 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (26m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:38:03.351 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (32m) 113s ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:38:03.351 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (27m) 113s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:38:03.351 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (27m) 113s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:38:03.351 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:38:03.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:38:03.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (26m) 113s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:38:03.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:38:03.352 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:38:03.352 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (32m) 113s ago 32m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:38:03.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:38:03.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:38:03.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:38:03.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:38:03.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (23m) 113s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:38:03.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (23m) 113s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:38:03.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (22m) 113s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:38:03.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (22m) 113s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:38:03.354 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (31m) 113s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:38:03.355 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:03.355 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 113s ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:03.603 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:38:03.603 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:38:03.604 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:03.604 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:03.604 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:38:03.604 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:03.605 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:03.605 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:38:03.605 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:38:03.605 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:03.606 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:38:03.606 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:38:03.606 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:38:03.606 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:38:03.607 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:38:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[30897]: audit 2021-03-10T20:38:03.080489+0000 mgr.gibba009.xiladd (mgr.34457) 1490 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[30897]: cluster 2021-03-10T20:38:03.202248+0000 mgr.gibba009.xiladd (mgr.34457) 1491 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[30897]: audit 2021-03-10T20:38:03.305401+0000 mgr.gibba009.xiladd (mgr.34457) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[30897]: audit 2021-03-10T20:38:03.602899+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.2.104:0/278164436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[31878]: audit 2021-03-10T20:38:03.080489+0000 mgr.gibba009.xiladd (mgr.34457) 1490 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[31878]: cluster 2021-03-10T20:38:03.202248+0000 mgr.gibba009.xiladd (mgr.34457) 1491 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[31878]: audit 2021-03-10T20:38:03.305401+0000 mgr.gibba009.xiladd (mgr.34457) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:04 gibba004 bash[31878]: audit 2021-03-10T20:38:03.602899+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.2.104:0/278164436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:04 gibba009 bash[26136]: audit 2021-03-10T20:38:03.080489+0000 mgr.gibba009.xiladd (mgr.34457) 1490 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:04 gibba009 bash[26136]: cluster 2021-03-10T20:38:03.202248+0000 mgr.gibba009.xiladd (mgr.34457) 1491 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:04 gibba009 bash[26136]: audit 2021-03-10T20:38:03.305401+0000 mgr.gibba009.xiladd (mgr.34457) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:04.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:04 gibba009 bash[26136]: audit 2021-03-10T20:38:03.602899+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.2.104:0/278164436' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:06 gibba004 bash[30897]: cluster 2021-03-10T20:38:05.204025+0000 mgr.gibba009.xiladd (mgr.34457) 1493 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:06 gibba004 bash[31878]: cluster 2021-03-10T20:38:05.204025+0000 mgr.gibba009.xiladd (mgr.34457) 1493 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:06 gibba009 bash[26136]: cluster 2021-03-10T20:38:05.204025+0000 mgr.gibba009.xiladd (mgr.34457) 1493 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:08 gibba004 bash[30897]: cluster 2021-03-10T20:38:07.205705+0000 mgr.gibba009.xiladd (mgr.34457) 1494 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:08 gibba004 bash[31878]: cluster 2021-03-10T20:38:07.205705+0000 mgr.gibba009.xiladd (mgr.34457) 1494 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:08 gibba009 bash[26136]: cluster 2021-03-10T20:38:07.205705+0000 mgr.gibba009.xiladd (mgr.34457) 1494 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:10 gibba004 bash[30897]: cluster 2021-03-10T20:38:09.206947+0000 mgr.gibba009.xiladd (mgr.34457) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:10 gibba004 bash[31878]: cluster 2021-03-10T20:38:09.206947+0000 mgr.gibba009.xiladd (mgr.34457) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:10 gibba009 bash[26136]: cluster 2021-03-10T20:38:09.206947+0000 mgr.gibba009.xiladd (mgr.34457) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:12 gibba004 bash[30897]: cluster 2021-03-10T20:38:11.208757+0000 mgr.gibba009.xiladd (mgr.34457) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:12 gibba004 bash[31878]: cluster 2021-03-10T20:38:11.208757+0000 mgr.gibba009.xiladd (mgr.34457) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:12 gibba009 bash[26136]: cluster 2021-03-10T20:38:11.208757+0000 mgr.gibba009.xiladd (mgr.34457) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:14.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:14 gibba004 bash[30897]: cluster 2021-03-10T20:38:13.210193+0000 mgr.gibba009.xiladd (mgr.34457) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:14.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:14 gibba004 bash[31878]: cluster 2021-03-10T20:38:13.210193+0000 mgr.gibba009.xiladd (mgr.34457) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:14.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:14 gibba009 bash[26136]: cluster 2021-03-10T20:38:13.210193+0000 mgr.gibba009.xiladd (mgr.34457) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:15.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:15 gibba004 bash[30897]: audit 2021-03-10T20:38:15.219551+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:15.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:15 gibba004 bash[31878]: audit 2021-03-10T20:38:15.219551+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:15.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:15 gibba009 bash[26136]: audit 2021-03-10T20:38:15.219551+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cluster 2021-03-10T20:38:15.211750+0000 mgr.gibba009.xiladd (mgr.34457) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.223061+0000 mgr.gibba009.xiladd (mgr.34457) 1499 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:38:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.224870+0000 mgr.gibba009.xiladd (mgr.34457) 1500 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:38:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.427265+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:38:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.428850+0000 mgr.gibba009.xiladd (mgr.34457) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.430553+0000 mgr.gibba009.xiladd (mgr.34457) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.431103+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.432114+0000 mgr.gibba009.xiladd (mgr.34457) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.432153+0000 mgr.gibba009.xiladd (mgr.34457) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.432659+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.433755+0000 mgr.gibba009.xiladd (mgr.34457) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.433792+0000 mgr.gibba009.xiladd (mgr.34457) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.434106+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.434899+0000 mgr.gibba009.xiladd (mgr.34457) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.435554+0000 mon.c (mon.1) 486 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.436515+0000 mgr.gibba009.xiladd (mgr.34457) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.436552+0000 mgr.gibba009.xiladd (mgr.34457) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.437862+0000 mgr.gibba009.xiladd (mgr.34457) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.438181+0000 mgr.gibba009.xiladd (mgr.34457) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.438516+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.439254+0000 mgr.gibba009.xiladd (mgr.34457) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cluster 2021-03-10T20:38:15.211750+0000 mgr.gibba009.xiladd (mgr.34457) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.223061+0000 mgr.gibba009.xiladd (mgr.34457) 1499 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:38:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.224870+0000 mgr.gibba009.xiladd (mgr.34457) 1500 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:38:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.427265+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:38:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.428850+0000 mgr.gibba009.xiladd (mgr.34457) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.430553+0000 mgr.gibba009.xiladd (mgr.34457) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.431103+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.432114+0000 mgr.gibba009.xiladd (mgr.34457) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.432153+0000 mgr.gibba009.xiladd (mgr.34457) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:16.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.432659+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.433755+0000 mgr.gibba009.xiladd (mgr.34457) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:16.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.433792+0000 mgr.gibba009.xiladd (mgr.34457) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:16.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.434106+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.434899+0000 mgr.gibba009.xiladd (mgr.34457) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:16.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.435554+0000 mon.c (mon.1) 486 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.436515+0000 mgr.gibba009.xiladd (mgr.34457) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:16.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.436552+0000 mgr.gibba009.xiladd (mgr.34457) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:16.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.437862+0000 mgr.gibba009.xiladd (mgr.34457) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:16.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.438181+0000 mgr.gibba009.xiladd (mgr.34457) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:16.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.438516+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.439254+0000 mgr.gibba009.xiladd (mgr.34457) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:16.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.439293+0000 mgr.gibba009.xiladd (mgr.34457) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:16.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: cephadm 2021-03-10T20:38:15.439419+0000 mgr.gibba009.xiladd (mgr.34457) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:16.824 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[30897]: audit 2021-03-10T20:38:15.439901+0000 mon.c (mon.1) 488 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.439293+0000 mgr.gibba009.xiladd (mgr.34457) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:16.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: cephadm 2021-03-10T20:38:15.439419+0000 mgr.gibba009.xiladd (mgr.34457) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:16.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:16 gibba004 bash[31878]: audit 2021-03-10T20:38:15.439901+0000 mon.c (mon.1) 488 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cluster 2021-03-10T20:38:15.211750+0000 mgr.gibba009.xiladd (mgr.34457) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.223061+0000 mgr.gibba009.xiladd (mgr.34457) 1499 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:38:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.224870+0000 mgr.gibba009.xiladd (mgr.34457) 1500 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:38:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.427265+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:38:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.428850+0000 mgr.gibba009.xiladd (mgr.34457) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.430553+0000 mgr.gibba009.xiladd (mgr.34457) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.431103+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.432114+0000 mgr.gibba009.xiladd (mgr.34457) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.432153+0000 mgr.gibba009.xiladd (mgr.34457) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:16.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.432659+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.433755+0000 mgr.gibba009.xiladd (mgr.34457) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:16.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.433792+0000 mgr.gibba009.xiladd (mgr.34457) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:16.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.434106+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.434899+0000 mgr.gibba009.xiladd (mgr.34457) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:16.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.435554+0000 mon.c (mon.1) 486 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.436515+0000 mgr.gibba009.xiladd (mgr.34457) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:16.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.436552+0000 mgr.gibba009.xiladd (mgr.34457) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:16.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.437862+0000 mgr.gibba009.xiladd (mgr.34457) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:16.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.438181+0000 mgr.gibba009.xiladd (mgr.34457) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:16.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.438516+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:16.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.439254+0000 mgr.gibba009.xiladd (mgr.34457) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:16.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.439293+0000 mgr.gibba009.xiladd (mgr.34457) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:16.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: cephadm 2021-03-10T20:38:15.439419+0000 mgr.gibba009.xiladd (mgr.34457) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:16.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:16 gibba009 bash[26136]: audit 2021-03-10T20:38:15.439901+0000 mon.c (mon.1) 488 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:18.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:18 gibba004 bash[30897]: cluster 2021-03-10T20:38:17.213328+0000 mgr.gibba009.xiladd (mgr.34457) 1515 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:18.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:18 gibba004 bash[31878]: cluster 2021-03-10T20:38:17.213328+0000 mgr.gibba009.xiladd (mgr.34457) 1515 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:18 gibba009 bash[26136]: cluster 2021-03-10T20:38:17.213328+0000 mgr.gibba009.xiladd (mgr.34457) 1515 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:20 gibba004 bash[30897]: cluster 2021-03-10T20:38:19.214221+0000 mgr.gibba009.xiladd (mgr.34457) 1516 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:20 gibba004 bash[31878]: cluster 2021-03-10T20:38:19.214221+0000 mgr.gibba009.xiladd (mgr.34457) 1516 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:20 gibba009 bash[26136]: cluster 2021-03-10T20:38:19.214221+0000 mgr.gibba009.xiladd (mgr.34457) 1516 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:22 gibba004 bash[30897]: cluster 2021-03-10T20:38:21.215888+0000 mgr.gibba009.xiladd (mgr.34457) 1517 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:22 gibba004 bash[31878]: cluster 2021-03-10T20:38:21.215888+0000 mgr.gibba009.xiladd (mgr.34457) 1517 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:22 gibba009 bash[26136]: cluster 2021-03-10T20:38:21.215888+0000 mgr.gibba009.xiladd (mgr.34457) 1517 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:24 gibba004 bash[30897]: cluster 2021-03-10T20:38:23.217247+0000 mgr.gibba009.xiladd (mgr.34457) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:24 gibba004 bash[31878]: cluster 2021-03-10T20:38:23.217247+0000 mgr.gibba009.xiladd (mgr.34457) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:24 gibba009 bash[26136]: cluster 2021-03-10T20:38:23.217247+0000 mgr.gibba009.xiladd (mgr.34457) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:26 gibba004 bash[30897]: cluster 2021-03-10T20:38:25.219035+0000 mgr.gibba009.xiladd (mgr.34457) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:26 gibba004 bash[31878]: cluster 2021-03-10T20:38:25.219035+0000 mgr.gibba009.xiladd (mgr.34457) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:26 gibba009 bash[26136]: cluster 2021-03-10T20:38:25.219035+0000 mgr.gibba009.xiladd (mgr.34457) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:28 gibba004 bash[30897]: cluster 2021-03-10T20:38:27.220681+0000 mgr.gibba009.xiladd (mgr.34457) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:28 gibba004 bash[31878]: cluster 2021-03-10T20:38:27.220681+0000 mgr.gibba009.xiladd (mgr.34457) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:28 gibba009 bash[26136]: cluster 2021-03-10T20:38:27.220681+0000 mgr.gibba009.xiladd (mgr.34457) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:30 gibba004 bash[30897]: cluster 2021-03-10T20:38:29.221870+0000 mgr.gibba009.xiladd (mgr.34457) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:30 gibba004 bash[31878]: cluster 2021-03-10T20:38:29.221870+0000 mgr.gibba009.xiladd (mgr.34457) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:30 gibba009 bash[26136]: cluster 2021-03-10T20:38:29.221870+0000 mgr.gibba009.xiladd (mgr.34457) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:31.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:31 gibba004 bash[30897]: cephadm 2021-03-10T20:38:30.455495+0000 mgr.gibba009.xiladd (mgr.34457) 1522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:31.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:31 gibba004 bash[31878]: cephadm 2021-03-10T20:38:30.455495+0000 mgr.gibba009.xiladd (mgr.34457) 1522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:31.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:31 gibba009 bash[26136]: cephadm 2021-03-10T20:38:30.455495+0000 mgr.gibba009.xiladd (mgr.34457) 1522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:32.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:32 gibba004 bash[30897]: cluster 2021-03-10T20:38:31.223595+0000 mgr.gibba009.xiladd (mgr.34457) 1523 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:32.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:32 gibba004 bash[31878]: cluster 2021-03-10T20:38:31.223595+0000 mgr.gibba009.xiladd (mgr.34457) 1523 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:32 gibba009 bash[26136]: cluster 2021-03-10T20:38:31.223595+0000 mgr.gibba009.xiladd (mgr.34457) 1523 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:33.846 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:38:34.073 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:38:34.073 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (27m) 3m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:38:34.074 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (32m) 2m ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:38:34.074 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (27m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:38:34.074 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:38:34.074 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:38:34.075 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:38:34.075 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:38:34.075 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:38:34.075 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:38:34.076 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:38:34.076 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:38:34.076 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:38:34.076 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:38:34.076 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:38:34.077 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:38:34.077 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:38:34.077 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:38:34.077 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (22m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:38:34.078 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:38:34.078 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:34.078 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:34.324 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:38:34.324 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:38:34.324 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:34.325 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:34.325 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:38:34.325 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:34.325 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:34.326 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:38:34.326 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:38:34.326 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:38:34.326 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:38:34.326 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:38:34.327 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:38:34.327 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:38:34.327 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:38:34.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:34 gibba004 bash[30897]: cluster 2021-03-10T20:38:33.225111+0000 mgr.gibba009.xiladd (mgr.34457) 1524 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:34.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:34 gibba004 bash[31878]: cluster 2021-03-10T20:38:33.225111+0000 mgr.gibba009.xiladd (mgr.34457) 1524 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:34.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:34 gibba009 bash[26136]: cluster 2021-03-10T20:38:33.225111+0000 mgr.gibba009.xiladd (mgr.34457) 1524 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:35.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[30897]: audit 2021-03-10T20:38:33.835462+0000 mgr.gibba009.xiladd (mgr.34457) 1525 : audit [DBG] from='client.55063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[30897]: audit 2021-03-10T20:38:34.058952+0000 mgr.gibba009.xiladd (mgr.34457) 1526 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[30897]: audit 2021-03-10T20:38:34.323946+0000 mon.c (mon.1) 489 : audit [DBG] from='client.? 172.21.2.104:0/36912398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:35.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[31878]: audit 2021-03-10T20:38:33.835462+0000 mgr.gibba009.xiladd (mgr.34457) 1525 : audit [DBG] from='client.55063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[31878]: audit 2021-03-10T20:38:34.058952+0000 mgr.gibba009.xiladd (mgr.34457) 1526 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:35 gibba004 bash[31878]: audit 2021-03-10T20:38:34.323946+0000 mon.c (mon.1) 489 : audit [DBG] from='client.? 172.21.2.104:0/36912398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:35.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:35 gibba009 bash[26136]: audit 2021-03-10T20:38:33.835462+0000 mgr.gibba009.xiladd (mgr.34457) 1525 : audit [DBG] from='client.55063 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:35 gibba009 bash[26136]: audit 2021-03-10T20:38:34.058952+0000 mgr.gibba009.xiladd (mgr.34457) 1526 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:35.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:35 gibba009 bash[26136]: audit 2021-03-10T20:38:34.323946+0000 mon.c (mon.1) 489 : audit [DBG] from='client.? 172.21.2.104:0/36912398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:36.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:36 gibba004 bash[30897]: cluster 2021-03-10T20:38:35.226873+0000 mgr.gibba009.xiladd (mgr.34457) 1527 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:36.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:36 gibba004 bash[31878]: cluster 2021-03-10T20:38:35.226873+0000 mgr.gibba009.xiladd (mgr.34457) 1527 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:36.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:36 gibba009 bash[26136]: cluster 2021-03-10T20:38:35.226873+0000 mgr.gibba009.xiladd (mgr.34457) 1527 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:38 gibba009 bash[26136]: cluster 2021-03-10T20:38:37.228354+0000 mgr.gibba009.xiladd (mgr.34457) 1528 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:38 gibba004 bash[30897]: cluster 2021-03-10T20:38:37.228354+0000 mgr.gibba009.xiladd (mgr.34457) 1528 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:38 gibba004 bash[31878]: cluster 2021-03-10T20:38:37.228354+0000 mgr.gibba009.xiladd (mgr.34457) 1528 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: cluster 2021-03-10T20:38:39.229814+0000 mgr.gibba009.xiladd (mgr.34457) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.718527+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.718966+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.719292+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.719616+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.720460+0000 mon.c (mon.1) 493 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.720513+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.721371+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.722075+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.727425+0000 mon.c (mon.1) 494 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.728163+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.729113+0000 mon.c (mon.1) 495 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[30897]: audit 2021-03-10T20:38:39.730051+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: cluster 2021-03-10T20:38:39.229814+0000 mgr.gibba009.xiladd (mgr.34457) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.718527+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.718966+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.719292+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.719616+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.720460+0000 mon.c (mon.1) 493 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.720513+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.721371+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.722075+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.727425+0000 mon.c (mon.1) 494 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.728163+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.729113+0000 mon.c (mon.1) 495 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:40 gibba004 bash[31878]: audit 2021-03-10T20:38:39.730051+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: cluster 2021-03-10T20:38:39.229814+0000 mgr.gibba009.xiladd (mgr.34457) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.718527+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.718966+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.719292+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:38:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.719616+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.720460+0000 mon.c (mon.1) 493 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.720513+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.721371+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:38:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.722075+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.727425+0000 mon.c (mon.1) 494 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.728163+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.729113+0000 mon.c (mon.1) 495 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:40 gibba009 bash[26136]: audit 2021-03-10T20:38:39.730051+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:42.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:42 gibba004 bash[30897]: cluster 2021-03-10T20:38:41.231370+0000 mgr.gibba009.xiladd (mgr.34457) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:42 gibba004 bash[31878]: cluster 2021-03-10T20:38:41.231370+0000 mgr.gibba009.xiladd (mgr.34457) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:42 gibba009 bash[26136]: cluster 2021-03-10T20:38:41.231370+0000 mgr.gibba009.xiladd (mgr.34457) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:44.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:44 gibba004 bash[30897]: cluster 2021-03-10T20:38:43.232804+0000 mgr.gibba009.xiladd (mgr.34457) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:44.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:44 gibba004 bash[31878]: cluster 2021-03-10T20:38:43.232804+0000 mgr.gibba009.xiladd (mgr.34457) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:44.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:44 gibba009 bash[26136]: cluster 2021-03-10T20:38:43.232804+0000 mgr.gibba009.xiladd (mgr.34457) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:46 gibba009 bash[26136]: cluster 2021-03-10T20:38:45.234261+0000 mgr.gibba009.xiladd (mgr.34457) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:46 gibba009 bash[26136]: cephadm 2021-03-10T20:38:45.471635+0000 mgr.gibba009.xiladd (mgr.34457) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:46.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:46 gibba004 bash[30897]: cluster 2021-03-10T20:38:45.234261+0000 mgr.gibba009.xiladd (mgr.34457) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:46 gibba004 bash[30897]: cephadm 2021-03-10T20:38:45.471635+0000 mgr.gibba009.xiladd (mgr.34457) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:46.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:46 gibba004 bash[31878]: cluster 2021-03-10T20:38:45.234261+0000 mgr.gibba009.xiladd (mgr.34457) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:46 gibba004 bash[31878]: cephadm 2021-03-10T20:38:45.471635+0000 mgr.gibba009.xiladd (mgr.34457) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:38:48.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:48 gibba009 bash[26136]: cluster 2021-03-10T20:38:47.235853+0000 mgr.gibba009.xiladd (mgr.34457) 1534 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:48 gibba004 bash[30897]: cluster 2021-03-10T20:38:47.235853+0000 mgr.gibba009.xiladd (mgr.34457) 1534 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:48 gibba004 bash[31878]: cluster 2021-03-10T20:38:47.235853+0000 mgr.gibba009.xiladd (mgr.34457) 1534 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:50 gibba004 bash[30897]: cluster 2021-03-10T20:38:49.236303+0000 mgr.gibba009.xiladd (mgr.34457) 1535 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:50 gibba004 bash[31878]: cluster 2021-03-10T20:38:49.236303+0000 mgr.gibba009.xiladd (mgr.34457) 1535 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:50 gibba009 bash[26136]: cluster 2021-03-10T20:38:49.236303+0000 mgr.gibba009.xiladd (mgr.34457) 1535 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:52 gibba004 bash[30897]: cluster 2021-03-10T20:38:51.238040+0000 mgr.gibba009.xiladd (mgr.34457) 1536 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:52 gibba004 bash[31878]: cluster 2021-03-10T20:38:51.238040+0000 mgr.gibba009.xiladd (mgr.34457) 1536 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:52 gibba009 bash[26136]: cluster 2021-03-10T20:38:51.238040+0000 mgr.gibba009.xiladd (mgr.34457) 1536 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:54 gibba004 bash[30897]: cluster 2021-03-10T20:38:53.239586+0000 mgr.gibba009.xiladd (mgr.34457) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:54 gibba004 bash[31878]: cluster 2021-03-10T20:38:53.239586+0000 mgr.gibba009.xiladd (mgr.34457) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:54 gibba009 bash[26136]: cluster 2021-03-10T20:38:53.239586+0000 mgr.gibba009.xiladd (mgr.34457) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:56 gibba009 bash[26136]: cluster 2021-03-10T20:38:55.241435+0000 mgr.gibba009.xiladd (mgr.34457) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:56 gibba004 bash[30897]: cluster 2021-03-10T20:38:55.241435+0000 mgr.gibba009.xiladd (mgr.34457) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:56 gibba004 bash[31878]: cluster 2021-03-10T20:38:55.241435+0000 mgr.gibba009.xiladd (mgr.34457) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:38:58 gibba009 bash[26136]: cluster 2021-03-10T20:38:57.243086+0000 mgr.gibba009.xiladd (mgr.34457) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:38:58 gibba004 bash[30897]: cluster 2021-03-10T20:38:57.243086+0000 mgr.gibba009.xiladd (mgr.34457) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:38:58 gibba004 bash[31878]: cluster 2021-03-10T20:38:57.243086+0000 mgr.gibba009.xiladd (mgr.34457) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:00.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:00 gibba004 bash[30897]: cluster 2021-03-10T20:38:59.244396+0000 mgr.gibba009.xiladd (mgr.34457) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:00.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:00 gibba004 bash[31878]: cluster 2021-03-10T20:38:59.244396+0000 mgr.gibba009.xiladd (mgr.34457) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:00.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:00 gibba009 bash[26136]: cluster 2021-03-10T20:38:59.244396+0000 mgr.gibba009.xiladd (mgr.34457) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:01.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:01 gibba004 bash[31878]: cephadm 2021-03-10T20:39:00.478367+0000 mgr.gibba009.xiladd (mgr.34457) 1541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:01.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:01 gibba004 bash[30897]: cephadm 2021-03-10T20:39:00.478367+0000 mgr.gibba009.xiladd (mgr.34457) 1541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:01.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:01 gibba009 bash[26136]: cephadm 2021-03-10T20:39:00.478367+0000 mgr.gibba009.xiladd (mgr.34457) 1541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:02.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:02 gibba004 bash[30897]: cluster 2021-03-10T20:39:01.245974+0000 mgr.gibba009.xiladd (mgr.34457) 1542 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:02.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:02 gibba004 bash[31878]: cluster 2021-03-10T20:39:01.245974+0000 mgr.gibba009.xiladd (mgr.34457) 1542 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:02.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:02 gibba009 bash[26136]: cluster 2021-03-10T20:39:01.245974+0000 mgr.gibba009.xiladd (mgr.34457) 1542 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:04 gibba004 bash[30897]: cluster 2021-03-10T20:39:03.247475+0000 mgr.gibba009.xiladd (mgr.34457) 1543 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:04 gibba004 bash[31878]: cluster 2021-03-10T20:39:03.247475+0000 mgr.gibba009.xiladd (mgr.34457) 1543 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.565 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:39:04.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:04 gibba009 bash[26136]: cluster 2021-03-10T20:39:03.247475+0000 mgr.gibba009.xiladd (mgr.34457) 1543 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.825 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:39:04.825 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (27m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:39:04.826 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (33m) 2m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:39:04.826 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:39:04.826 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:39:04.826 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:39:04.827 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:39:04.827 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (27m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:39:04.827 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:39:04.827 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:39:04.827 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:39:04.828 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:39:04.828 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:39:04.828 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:39:04.828 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:39:04.829 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:39:04.829 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:39:04.829 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:39:04.829 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:39:04.829 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:39:04.830 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:04.830 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:05.080 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:39:05.080 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:39:05.080 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:05.080 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:05.081 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:39:05.081 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:05.081 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:05.081 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:39:05.081 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:39:05.082 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:05.082 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:39:05.082 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:39:05.082 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:39:05.083 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:39:05.083 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:39:05.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:05 gibba004 bash[30897]: audit 2021-03-10T20:39:05.079716+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.104:0/487304052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:05.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:05 gibba004 bash[31878]: audit 2021-03-10T20:39:05.079716+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.104:0/487304052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:05.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:05 gibba009 bash[26136]: audit 2021-03-10T20:39:05.079716+0000 mon.a (mon.0) 779 : audit [DBG] from='client.? 172.21.2.104:0/487304052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:06.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[30897]: audit 2021-03-10T20:39:04.555670+0000 mgr.gibba009.xiladd (mgr.34457) 1544 : audit [DBG] from='client.55081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[30897]: audit 2021-03-10T20:39:04.780967+0000 mgr.gibba009.xiladd (mgr.34457) 1545 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[30897]: cluster 2021-03-10T20:39:05.249284+0000 mgr.gibba009.xiladd (mgr.34457) 1546 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:06.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[31878]: audit 2021-03-10T20:39:04.555670+0000 mgr.gibba009.xiladd (mgr.34457) 1544 : audit [DBG] from='client.55081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[31878]: audit 2021-03-10T20:39:04.780967+0000 mgr.gibba009.xiladd (mgr.34457) 1545 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:06 gibba004 bash[31878]: cluster 2021-03-10T20:39:05.249284+0000 mgr.gibba009.xiladd (mgr.34457) 1546 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:06.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:06 gibba009 bash[26136]: audit 2021-03-10T20:39:04.555670+0000 mgr.gibba009.xiladd (mgr.34457) 1544 : audit [DBG] from='client.55081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:06 gibba009 bash[26136]: audit 2021-03-10T20:39:04.780967+0000 mgr.gibba009.xiladd (mgr.34457) 1545 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:06.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:06 gibba009 bash[26136]: cluster 2021-03-10T20:39:05.249284+0000 mgr.gibba009.xiladd (mgr.34457) 1546 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:08 gibba004 bash[30897]: cluster 2021-03-10T20:39:07.250652+0000 mgr.gibba009.xiladd (mgr.34457) 1547 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:08 gibba004 bash[31878]: cluster 2021-03-10T20:39:07.250652+0000 mgr.gibba009.xiladd (mgr.34457) 1547 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:08 gibba009 bash[26136]: cluster 2021-03-10T20:39:07.250652+0000 mgr.gibba009.xiladd (mgr.34457) 1547 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:10 gibba004 bash[30897]: cluster 2021-03-10T20:39:09.251864+0000 mgr.gibba009.xiladd (mgr.34457) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:10 gibba004 bash[31878]: cluster 2021-03-10T20:39:09.251864+0000 mgr.gibba009.xiladd (mgr.34457) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:10 gibba009 bash[26136]: cluster 2021-03-10T20:39:09.251864+0000 mgr.gibba009.xiladd (mgr.34457) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:12 gibba009 bash[26136]: cluster 2021-03-10T20:39:11.253640+0000 mgr.gibba009.xiladd (mgr.34457) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:12 gibba004 bash[30897]: cluster 2021-03-10T20:39:11.253640+0000 mgr.gibba009.xiladd (mgr.34457) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:12 gibba004 bash[31878]: cluster 2021-03-10T20:39:11.253640+0000 mgr.gibba009.xiladd (mgr.34457) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:14.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:14 gibba009 bash[26136]: cluster 2021-03-10T20:39:13.254934+0000 mgr.gibba009.xiladd (mgr.34457) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:14.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:14 gibba004 bash[30897]: cluster 2021-03-10T20:39:13.254934+0000 mgr.gibba009.xiladd (mgr.34457) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:14 gibba004 bash[31878]: cluster 2021-03-10T20:39:13.254934+0000 mgr.gibba009.xiladd (mgr.34457) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: cluster 2021-03-10T20:39:15.256744+0000 mgr.gibba009.xiladd (mgr.34457) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.496528+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.501457+0000 mgr.gibba009.xiladd (mgr.34457) 1552 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:39:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.503017+0000 mgr.gibba009.xiladd (mgr.34457) 1553 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:39:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.708560+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:39:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.712700+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.714492+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.715766+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.717042+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.720144+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:16 gibba009 bash[26136]: audit 2021-03-10T20:39:15.721778+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: cluster 2021-03-10T20:39:15.256744+0000 mgr.gibba009.xiladd (mgr.34457) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.496528+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.501457+0000 mgr.gibba009.xiladd (mgr.34457) 1552 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:39:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.503017+0000 mgr.gibba009.xiladd (mgr.34457) 1553 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:39:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.708560+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:39:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.712700+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.714492+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.715766+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.717042+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.720144+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[30897]: audit 2021-03-10T20:39:15.721778+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: cluster 2021-03-10T20:39:15.256744+0000 mgr.gibba009.xiladd (mgr.34457) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.496528+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.501457+0000 mgr.gibba009.xiladd (mgr.34457) 1552 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:39:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.503017+0000 mgr.gibba009.xiladd (mgr.34457) 1553 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:39:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.708560+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:39:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.712700+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.714492+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.715766+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.717042+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.720144+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:16 gibba004 bash[31878]: audit 2021-03-10T20:39:15.721778+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.710521+0000 mgr.gibba009.xiladd (mgr.34457) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.712548+0000 mgr.gibba009.xiladd (mgr.34457) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.713895+0000 mgr.gibba009.xiladd (mgr.34457) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.713951+0000 mgr.gibba009.xiladd (mgr.34457) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.715254+0000 mgr.gibba009.xiladd (mgr.34457) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.715294+0000 mgr.gibba009.xiladd (mgr.34457) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.716515+0000 mgr.gibba009.xiladd (mgr.34457) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.718212+0000 mgr.gibba009.xiladd (mgr.34457) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.718253+0000 mgr.gibba009.xiladd (mgr.34457) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.719683+0000 mgr.gibba009.xiladd (mgr.34457) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.720033+0000 mgr.gibba009.xiladd (mgr.34457) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.721236+0000 mgr.gibba009.xiladd (mgr.34457) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.721278+0000 mgr.gibba009.xiladd (mgr.34457) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[30897]: cephadm 2021-03-10T20:39:15.721412+0000 mgr.gibba009.xiladd (mgr.34457) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.710521+0000 mgr.gibba009.xiladd (mgr.34457) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.712548+0000 mgr.gibba009.xiladd (mgr.34457) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.713895+0000 mgr.gibba009.xiladd (mgr.34457) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.713951+0000 mgr.gibba009.xiladd (mgr.34457) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:17.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.715254+0000 mgr.gibba009.xiladd (mgr.34457) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:17.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.715294+0000 mgr.gibba009.xiladd (mgr.34457) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:17.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.716515+0000 mgr.gibba009.xiladd (mgr.34457) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:17.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.718212+0000 mgr.gibba009.xiladd (mgr.34457) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:17.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.718253+0000 mgr.gibba009.xiladd (mgr.34457) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:17.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.719683+0000 mgr.gibba009.xiladd (mgr.34457) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:17.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.720033+0000 mgr.gibba009.xiladd (mgr.34457) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:17.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.721236+0000 mgr.gibba009.xiladd (mgr.34457) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:17.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.721278+0000 mgr.gibba009.xiladd (mgr.34457) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:17.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:17 gibba004 bash[31878]: cephadm 2021-03-10T20:39:15.721412+0000 mgr.gibba009.xiladd (mgr.34457) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.710521+0000 mgr.gibba009.xiladd (mgr.34457) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.712548+0000 mgr.gibba009.xiladd (mgr.34457) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.713895+0000 mgr.gibba009.xiladd (mgr.34457) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.713951+0000 mgr.gibba009.xiladd (mgr.34457) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.715254+0000 mgr.gibba009.xiladd (mgr.34457) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.715294+0000 mgr.gibba009.xiladd (mgr.34457) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:17.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.716515+0000 mgr.gibba009.xiladd (mgr.34457) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:17.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.718212+0000 mgr.gibba009.xiladd (mgr.34457) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:17.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.718253+0000 mgr.gibba009.xiladd (mgr.34457) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:17.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.719683+0000 mgr.gibba009.xiladd (mgr.34457) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:17.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.720033+0000 mgr.gibba009.xiladd (mgr.34457) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:17.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.721236+0000 mgr.gibba009.xiladd (mgr.34457) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:17.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.721278+0000 mgr.gibba009.xiladd (mgr.34457) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:17.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:17 gibba009 bash[26136]: cephadm 2021-03-10T20:39:15.721412+0000 mgr.gibba009.xiladd (mgr.34457) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:18.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:18 gibba004 bash[30897]: cluster 2021-03-10T20:39:17.258297+0000 mgr.gibba009.xiladd (mgr.34457) 1568 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:18.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:18 gibba004 bash[31878]: cluster 2021-03-10T20:39:17.258297+0000 mgr.gibba009.xiladd (mgr.34457) 1568 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:18 gibba009 bash[26136]: cluster 2021-03-10T20:39:17.258297+0000 mgr.gibba009.xiladd (mgr.34457) 1568 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:20 gibba004 bash[30897]: cluster 2021-03-10T20:39:19.258764+0000 mgr.gibba009.xiladd (mgr.34457) 1569 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:20 gibba004 bash[31878]: cluster 2021-03-10T20:39:19.258764+0000 mgr.gibba009.xiladd (mgr.34457) 1569 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:20 gibba009 bash[26136]: cluster 2021-03-10T20:39:19.258764+0000 mgr.gibba009.xiladd (mgr.34457) 1569 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:22 gibba009 bash[26136]: cluster 2021-03-10T20:39:21.260507+0000 mgr.gibba009.xiladd (mgr.34457) 1570 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:22 gibba004 bash[30897]: cluster 2021-03-10T20:39:21.260507+0000 mgr.gibba009.xiladd (mgr.34457) 1570 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:22 gibba004 bash[31878]: cluster 2021-03-10T20:39:21.260507+0000 mgr.gibba009.xiladd (mgr.34457) 1570 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:24 gibba009 bash[26136]: cluster 2021-03-10T20:39:23.262064+0000 mgr.gibba009.xiladd (mgr.34457) 1571 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:24 gibba004 bash[31878]: cluster 2021-03-10T20:39:23.262064+0000 mgr.gibba009.xiladd (mgr.34457) 1571 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:24 gibba004 bash[30897]: cluster 2021-03-10T20:39:23.262064+0000 mgr.gibba009.xiladd (mgr.34457) 1571 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:26 gibba004 bash[31878]: cluster 2021-03-10T20:39:25.263708+0000 mgr.gibba009.xiladd (mgr.34457) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:26 gibba004 bash[30897]: cluster 2021-03-10T20:39:25.263708+0000 mgr.gibba009.xiladd (mgr.34457) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:26 gibba009 bash[26136]: cluster 2021-03-10T20:39:25.263708+0000 mgr.gibba009.xiladd (mgr.34457) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:28 gibba004 bash[30897]: cluster 2021-03-10T20:39:27.265370+0000 mgr.gibba009.xiladd (mgr.34457) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:28 gibba004 bash[31878]: cluster 2021-03-10T20:39:27.265370+0000 mgr.gibba009.xiladd (mgr.34457) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:28 gibba009 bash[26136]: cluster 2021-03-10T20:39:27.265370+0000 mgr.gibba009.xiladd (mgr.34457) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:30 gibba004 bash[30897]: cluster 2021-03-10T20:39:29.266570+0000 mgr.gibba009.xiladd (mgr.34457) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:30 gibba004 bash[31878]: cluster 2021-03-10T20:39:29.266570+0000 mgr.gibba009.xiladd (mgr.34457) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:30 gibba009 bash[26136]: cluster 2021-03-10T20:39:29.266570+0000 mgr.gibba009.xiladd (mgr.34457) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:32 gibba009 bash[26136]: cephadm 2021-03-10T20:39:30.729624+0000 mgr.gibba009.xiladd (mgr.34457) 1575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:32.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:32 gibba009 bash[26136]: cluster 2021-03-10T20:39:31.268437+0000 mgr.gibba009.xiladd (mgr.34457) 1576 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:32 gibba004 bash[30897]: cephadm 2021-03-10T20:39:30.729624+0000 mgr.gibba009.xiladd (mgr.34457) 1575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:32 gibba004 bash[30897]: cluster 2021-03-10T20:39:31.268437+0000 mgr.gibba009.xiladd (mgr.34457) 1576 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:32.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:32 gibba004 bash[31878]: cephadm 2021-03-10T20:39:30.729624+0000 mgr.gibba009.xiladd (mgr.34457) 1575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:32.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:32 gibba004 bash[31878]: cluster 2021-03-10T20:39:31.268437+0000 mgr.gibba009.xiladd (mgr.34457) 1576 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:34.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:34 gibba004 bash[30897]: cluster 2021-03-10T20:39:33.269943+0000 mgr.gibba009.xiladd (mgr.34457) 1577 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:34 gibba004 bash[31878]: cluster 2021-03-10T20:39:33.269943+0000 mgr.gibba009.xiladd (mgr.34457) 1577 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:34 gibba009 bash[26136]: cluster 2021-03-10T20:39:33.269943+0000 mgr.gibba009.xiladd (mgr.34457) 1577 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:35.324 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:39:35.551 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:39:35.552 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (28m) 4m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:39:35.552 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (33m) 3m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:39:35.552 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (28m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:39:35.553 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:39:35.553 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:39:35.553 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:39:35.554 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:39:35.554 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:39:35.554 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:39:35.554 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:39:35.555 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:39:35.555 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:39:35.555 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:39:35.555 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:39:35.556 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:39:35.557 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:39:35.557 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:39:35.558 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (23m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:39:35.558 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:39:35.558 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:35.562 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:35.802 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:39:35.802 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:39:35.802 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:35.803 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:35.803 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:39:35.803 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:35.803 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:35.804 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:39:35.804 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:39:35.804 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:39:35.804 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:39:35.805 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:39:35.805 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:39:35.805 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:39:35.805 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:39:36.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[30897]: cluster 2021-03-10T20:39:35.271574+0000 mgr.gibba009.xiladd (mgr.34457) 1578 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:37.305 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[30897]: audit 2021-03-10T20:39:35.314240+0000 mgr.gibba009.xiladd (mgr.34457) 1579 : audit [DBG] from='client.55099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.306 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[30897]: audit 2021-03-10T20:39:35.537470+0000 mgr.gibba009.xiladd (mgr.34457) 1580 : audit [DBG] from='client.45126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.306 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[30897]: audit 2021-03-10T20:39:35.801711+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.104:0/2706903853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:37.306 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[31878]: cluster 2021-03-10T20:39:35.271574+0000 mgr.gibba009.xiladd (mgr.34457) 1578 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:37.307 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[31878]: audit 2021-03-10T20:39:35.314240+0000 mgr.gibba009.xiladd (mgr.34457) 1579 : audit [DBG] from='client.55099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.307 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[31878]: audit 2021-03-10T20:39:35.537470+0000 mgr.gibba009.xiladd (mgr.34457) 1580 : audit [DBG] from='client.45126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.307 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:36 gibba004 bash[31878]: audit 2021-03-10T20:39:35.801711+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.104:0/2706903853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:37.308 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:36 gibba009 bash[26136]: cluster 2021-03-10T20:39:35.271574+0000 mgr.gibba009.xiladd (mgr.34457) 1578 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:37.308 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:36 gibba009 bash[26136]: audit 2021-03-10T20:39:35.314240+0000 mgr.gibba009.xiladd (mgr.34457) 1579 : audit [DBG] from='client.55099 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.308 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:36 gibba009 bash[26136]: audit 2021-03-10T20:39:35.537470+0000 mgr.gibba009.xiladd (mgr.34457) 1580 : audit [DBG] from='client.45126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:37.308 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:36 gibba009 bash[26136]: audit 2021-03-10T20:39:35.801711+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.104:0/2706903853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:38.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:38 gibba004 bash[30897]: cluster 2021-03-10T20:39:37.273309+0000 mgr.gibba009.xiladd (mgr.34457) 1581 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:38.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:38 gibba004 bash[31878]: cluster 2021-03-10T20:39:37.273309+0000 mgr.gibba009.xiladd (mgr.34457) 1581 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:38.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:38 gibba009 bash[26136]: cluster 2021-03-10T20:39:37.273309+0000 mgr.gibba009.xiladd (mgr.34457) 1581 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: cluster 2021-03-10T20:39:39.273838+0000 mgr.gibba009.xiladd (mgr.34457) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.735650+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.736841+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.737857+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.738551+0000 mon.c (mon.1) 505 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.738838+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.739232+0000 mon.c (mon.1) 506 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.740023+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.740684+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.740687+0000 mon.c (mon.1) 508 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.742172+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.743242+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[30897]: audit 2021-03-10T20:39:39.743888+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: cluster 2021-03-10T20:39:39.273838+0000 mgr.gibba009.xiladd (mgr.34457) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.735650+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.736841+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.737857+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.738551+0000 mon.c (mon.1) 505 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.738838+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.739232+0000 mon.c (mon.1) 506 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.740023+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.740684+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.740687+0000 mon.c (mon.1) 508 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.742172+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.743242+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:40 gibba004 bash[31878]: audit 2021-03-10T20:39:39.743888+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: cluster 2021-03-10T20:39:39.273838+0000 mgr.gibba009.xiladd (mgr.34457) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.735650+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.736841+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.737857+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.738551+0000 mon.c (mon.1) 505 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.738838+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.739232+0000 mon.c (mon.1) 506 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.740023+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.740684+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:39:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.740687+0000 mon.c (mon.1) 508 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.742172+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.743242+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:40 gibba009 bash[26136]: audit 2021-03-10T20:39:39.743888+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:39:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:42 gibba004 bash[30897]: cluster 2021-03-10T20:39:41.275595+0000 mgr.gibba009.xiladd (mgr.34457) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:42 gibba004 bash[31878]: cluster 2021-03-10T20:39:41.275595+0000 mgr.gibba009.xiladd (mgr.34457) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:42 gibba009 bash[26136]: cluster 2021-03-10T20:39:41.275595+0000 mgr.gibba009.xiladd (mgr.34457) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:44.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:44 gibba004 bash[30897]: cluster 2021-03-10T20:39:43.277128+0000 mgr.gibba009.xiladd (mgr.34457) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:44 gibba004 bash[31878]: cluster 2021-03-10T20:39:43.277128+0000 mgr.gibba009.xiladd (mgr.34457) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:44 gibba009 bash[26136]: cluster 2021-03-10T20:39:43.277128+0000 mgr.gibba009.xiladd (mgr.34457) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:46 gibba004 bash[30897]: cluster 2021-03-10T20:39:45.278935+0000 mgr.gibba009.xiladd (mgr.34457) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:46 gibba004 bash[31878]: cluster 2021-03-10T20:39:45.278935+0000 mgr.gibba009.xiladd (mgr.34457) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:46 gibba009 bash[26136]: cluster 2021-03-10T20:39:45.278935+0000 mgr.gibba009.xiladd (mgr.34457) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:47.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:47 gibba004 bash[30897]: cephadm 2021-03-10T20:39:45.745664+0000 mgr.gibba009.xiladd (mgr.34457) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:47 gibba004 bash[31878]: cephadm 2021-03-10T20:39:45.745664+0000 mgr.gibba009.xiladd (mgr.34457) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:47.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:47 gibba009 bash[26136]: cephadm 2021-03-10T20:39:45.745664+0000 mgr.gibba009.xiladd (mgr.34457) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:39:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:48 gibba004 bash[30897]: cluster 2021-03-10T20:39:47.280561+0000 mgr.gibba009.xiladd (mgr.34457) 1587 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:48 gibba004 bash[31878]: cluster 2021-03-10T20:39:47.280561+0000 mgr.gibba009.xiladd (mgr.34457) 1587 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:48 gibba009 bash[26136]: cluster 2021-03-10T20:39:47.280561+0000 mgr.gibba009.xiladd (mgr.34457) 1587 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:50 gibba004 bash[30897]: cluster 2021-03-10T20:39:49.281864+0000 mgr.gibba009.xiladd (mgr.34457) 1588 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:50 gibba004 bash[31878]: cluster 2021-03-10T20:39:49.281864+0000 mgr.gibba009.xiladd (mgr.34457) 1588 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:50 gibba009 bash[26136]: cluster 2021-03-10T20:39:49.281864+0000 mgr.gibba009.xiladd (mgr.34457) 1588 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:52 gibba004 bash[30897]: cluster 2021-03-10T20:39:51.283693+0000 mgr.gibba009.xiladd (mgr.34457) 1589 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:52 gibba004 bash[31878]: cluster 2021-03-10T20:39:51.283693+0000 mgr.gibba009.xiladd (mgr.34457) 1589 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:52 gibba009 bash[26136]: cluster 2021-03-10T20:39:51.283693+0000 mgr.gibba009.xiladd (mgr.34457) 1589 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:54 gibba004 bash[30897]: cluster 2021-03-10T20:39:53.285276+0000 mgr.gibba009.xiladd (mgr.34457) 1590 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:54 gibba004 bash[31878]: cluster 2021-03-10T20:39:53.285276+0000 mgr.gibba009.xiladd (mgr.34457) 1590 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:54 gibba009 bash[26136]: cluster 2021-03-10T20:39:53.285276+0000 mgr.gibba009.xiladd (mgr.34457) 1590 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:56 gibba004 bash[30897]: cluster 2021-03-10T20:39:55.286908+0000 mgr.gibba009.xiladd (mgr.34457) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:56 gibba004 bash[31878]: cluster 2021-03-10T20:39:55.286908+0000 mgr.gibba009.xiladd (mgr.34457) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:56 gibba009 bash[26136]: cluster 2021-03-10T20:39:55.286908+0000 mgr.gibba009.xiladd (mgr.34457) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:39:58 gibba004 bash[30897]: cluster 2021-03-10T20:39:57.288476+0000 mgr.gibba009.xiladd (mgr.34457) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:39:58 gibba004 bash[31878]: cluster 2021-03-10T20:39:57.288476+0000 mgr.gibba009.xiladd (mgr.34457) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:39:58 gibba009 bash[26136]: cluster 2021-03-10T20:39:57.288476+0000 mgr.gibba009.xiladd (mgr.34457) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.270 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:00 gibba004 bash[30897]: debug 2021-03-10T20:39:59.996+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:00 gibba004 bash[30897]: cluster 2021-03-10T20:39:59.289740+0000 mgr.gibba009.xiladd (mgr.34457) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:00 gibba004 bash[30897]: cluster 2021-03-10T20:40:00.000202+0000 mon.a (mon.0) 788 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:00 gibba004 bash[31878]: cluster 2021-03-10T20:39:59.289740+0000 mgr.gibba009.xiladd (mgr.34457) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.564 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:00 gibba004 bash[31878]: cluster 2021-03-10T20:40:00.000202+0000 mon.a (mon.0) 788 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:00 gibba009 bash[26136]: cluster 2021-03-10T20:39:59.289740+0000 mgr.gibba009.xiladd (mgr.34457) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:00 gibba009 bash[26136]: cluster 2021-03-10T20:40:00.000202+0000 mon.a (mon.0) 788 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:02 gibba004 bash[30897]: cephadm 2021-03-10T20:40:00.761678+0000 mgr.gibba009.xiladd (mgr.34457) 1594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:02 gibba004 bash[30897]: cluster 2021-03-10T20:40:01.291449+0000 mgr.gibba009.xiladd (mgr.34457) 1595 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:02 gibba004 bash[31878]: cephadm 2021-03-10T20:40:00.761678+0000 mgr.gibba009.xiladd (mgr.34457) 1594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:02 gibba004 bash[31878]: cluster 2021-03-10T20:40:01.291449+0000 mgr.gibba009.xiladd (mgr.34457) 1595 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:02 gibba009 bash[26136]: cephadm 2021-03-10T20:40:00.761678+0000 mgr.gibba009.xiladd (mgr.34457) 1594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:02 gibba009 bash[26136]: cluster 2021-03-10T20:40:01.291449+0000 mgr.gibba009.xiladd (mgr.34457) 1595 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:04 gibba004 bash[30897]: cluster 2021-03-10T20:40:03.292975+0000 mgr.gibba009.xiladd (mgr.34457) 1596 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:04 gibba004 bash[31878]: cluster 2021-03-10T20:40:03.292975+0000 mgr.gibba009.xiladd (mgr.34457) 1596 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:04 gibba009 bash[26136]: cluster 2021-03-10T20:40:03.292975+0000 mgr.gibba009.xiladd (mgr.34457) 1596 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.045 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:40:06.273 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:40:06.273 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (29m) 5m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:40:06.274 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (34m) 3m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:40:06.274 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:40:06.275 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:40:06.275 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (28m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:40:06.276 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (28m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:40:06.276 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (28m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:40:06.276 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:40:06.277 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (34m) 5m ago 34m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:40:06.277 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:40:06.278 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:40:06.278 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:40:06.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:40:06.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:40:06.280 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:40:06.280 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:40:06.280 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:40:06.281 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:40:06.281 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:40:06.282 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:06.282 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:06.525 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:40:06.526 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:40:06.526 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:06.526 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:06.527 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:40:06.527 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:06.527 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:06.527 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:40:06.527 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:40:06.528 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:06.528 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:40:06.528 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:40:06.528 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:40:06.529 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:40:06.529 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:40:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:06 gibba004 bash[30897]: cluster 2021-03-10T20:40:05.294785+0000 mgr.gibba009.xiladd (mgr.34457) 1597 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:06 gibba004 bash[31878]: cluster 2021-03-10T20:40:05.294785+0000 mgr.gibba009.xiladd (mgr.34457) 1597 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:06 gibba009 bash[26136]: cluster 2021-03-10T20:40:05.294785+0000 mgr.gibba009.xiladd (mgr.34457) 1597 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[30897]: audit 2021-03-10T20:40:06.034761+0000 mgr.gibba009.xiladd (mgr.34457) 1598 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[30897]: audit 2021-03-10T20:40:06.258882+0000 mgr.gibba009.xiladd (mgr.34457) 1599 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[30897]: audit 2021-03-10T20:40:06.525283+0000 mon.c (mon.1) 509 : audit [DBG] from='client.? 172.21.2.104:0/3069297479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[31878]: audit 2021-03-10T20:40:06.034761+0000 mgr.gibba009.xiladd (mgr.34457) 1598 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[31878]: audit 2021-03-10T20:40:06.258882+0000 mgr.gibba009.xiladd (mgr.34457) 1599 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:07 gibba004 bash[31878]: audit 2021-03-10T20:40:06.525283+0000 mon.c (mon.1) 509 : audit [DBG] from='client.? 172.21.2.104:0/3069297479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:07.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:07 gibba009 bash[26136]: audit 2021-03-10T20:40:06.034761+0000 mgr.gibba009.xiladd (mgr.34457) 1598 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:07 gibba009 bash[26136]: audit 2021-03-10T20:40:06.258882+0000 mgr.gibba009.xiladd (mgr.34457) 1599 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:07.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:07 gibba009 bash[26136]: audit 2021-03-10T20:40:06.525283+0000 mon.c (mon.1) 509 : audit [DBG] from='client.? 172.21.2.104:0/3069297479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:08.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:08 gibba004 bash[30897]: cluster 2021-03-10T20:40:07.296376+0000 mgr.gibba009.xiladd (mgr.34457) 1600 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:08.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:08 gibba004 bash[31878]: cluster 2021-03-10T20:40:07.296376+0000 mgr.gibba009.xiladd (mgr.34457) 1600 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:08 gibba009 bash[26136]: cluster 2021-03-10T20:40:07.296376+0000 mgr.gibba009.xiladd (mgr.34457) 1600 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:10 gibba004 bash[30897]: cluster 2021-03-10T20:40:09.297679+0000 mgr.gibba009.xiladd (mgr.34457) 1601 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:10 gibba004 bash[31878]: cluster 2021-03-10T20:40:09.297679+0000 mgr.gibba009.xiladd (mgr.34457) 1601 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:10 gibba009 bash[26136]: cluster 2021-03-10T20:40:09.297679+0000 mgr.gibba009.xiladd (mgr.34457) 1601 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:12 gibba004 bash[30897]: cluster 2021-03-10T20:40:11.299473+0000 mgr.gibba009.xiladd (mgr.34457) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:12 gibba004 bash[31878]: cluster 2021-03-10T20:40:11.299473+0000 mgr.gibba009.xiladd (mgr.34457) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:12 gibba009 bash[26136]: cluster 2021-03-10T20:40:11.299473+0000 mgr.gibba009.xiladd (mgr.34457) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:14.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:14 gibba004 bash[30897]: cluster 2021-03-10T20:40:13.300773+0000 mgr.gibba009.xiladd (mgr.34457) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:14 gibba004 bash[31878]: cluster 2021-03-10T20:40:13.300773+0000 mgr.gibba009.xiladd (mgr.34457) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:14 gibba009 bash[26136]: cluster 2021-03-10T20:40:13.300773+0000 mgr.gibba009.xiladd (mgr.34457) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: cluster 2021-03-10T20:40:15.302431+0000 mgr.gibba009.xiladd (mgr.34457) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:15.774123+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.001495+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:40:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.005352+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.006782+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.008320+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.010062+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.012571+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[30897]: audit 2021-03-10T20:40:16.014023+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: cluster 2021-03-10T20:40:15.302431+0000 mgr.gibba009.xiladd (mgr.34457) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:15.774123+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.001495+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:40:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.005352+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.006782+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.008320+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.010062+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.012571+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:16 gibba004 bash[31878]: audit 2021-03-10T20:40:16.014023+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: cluster 2021-03-10T20:40:15.302431+0000 mgr.gibba009.xiladd (mgr.34457) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:15.774123+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.001495+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:40:16.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.005352+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.006782+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.008320+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.010062+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.012571+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:16.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:16 gibba009 bash[26136]: audit 2021-03-10T20:40:16.014023+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:15.778370+0000 mgr.gibba009.xiladd (mgr.34457) 1605 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:40:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:15.780194+0000 mgr.gibba009.xiladd (mgr.34457) 1606 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:40:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.003432+0000 mgr.gibba009.xiladd (mgr.34457) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.005068+0000 mgr.gibba009.xiladd (mgr.34457) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.006424+0000 mgr.gibba009.xiladd (mgr.34457) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.006459+0000 mgr.gibba009.xiladd (mgr.34457) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.008392+0000 mgr.gibba009.xiladd (mgr.34457) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.008430+0000 mgr.gibba009.xiladd (mgr.34457) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.009622+0000 mgr.gibba009.xiladd (mgr.34457) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.010932+0000 mgr.gibba009.xiladd (mgr.34457) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.010966+0000 mgr.gibba009.xiladd (mgr.34457) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.012022+0000 mgr.gibba009.xiladd (mgr.34457) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.012351+0000 mgr.gibba009.xiladd (mgr.34457) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.013703+0000 mgr.gibba009.xiladd (mgr.34457) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.013741+0000 mgr.gibba009.xiladd (mgr.34457) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[30897]: cephadm 2021-03-10T20:40:16.013870+0000 mgr.gibba009.xiladd (mgr.34457) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:15.778370+0000 mgr.gibba009.xiladd (mgr.34457) 1605 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:40:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:15.780194+0000 mgr.gibba009.xiladd (mgr.34457) 1606 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:40:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.003432+0000 mgr.gibba009.xiladd (mgr.34457) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.005068+0000 mgr.gibba009.xiladd (mgr.34457) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.006424+0000 mgr.gibba009.xiladd (mgr.34457) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.006459+0000 mgr.gibba009.xiladd (mgr.34457) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.008392+0000 mgr.gibba009.xiladd (mgr.34457) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.008430+0000 mgr.gibba009.xiladd (mgr.34457) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.009622+0000 mgr.gibba009.xiladd (mgr.34457) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.010932+0000 mgr.gibba009.xiladd (mgr.34457) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.010966+0000 mgr.gibba009.xiladd (mgr.34457) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.012022+0000 mgr.gibba009.xiladd (mgr.34457) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.012351+0000 mgr.gibba009.xiladd (mgr.34457) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.013703+0000 mgr.gibba009.xiladd (mgr.34457) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:17.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.013741+0000 mgr.gibba009.xiladd (mgr.34457) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:17.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:17 gibba004 bash[31878]: cephadm 2021-03-10T20:40:16.013870+0000 mgr.gibba009.xiladd (mgr.34457) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:15.778370+0000 mgr.gibba009.xiladd (mgr.34457) 1605 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:40:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:15.780194+0000 mgr.gibba009.xiladd (mgr.34457) 1606 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:40:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.003432+0000 mgr.gibba009.xiladd (mgr.34457) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.005068+0000 mgr.gibba009.xiladd (mgr.34457) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.006424+0000 mgr.gibba009.xiladd (mgr.34457) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.006459+0000 mgr.gibba009.xiladd (mgr.34457) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.008392+0000 mgr.gibba009.xiladd (mgr.34457) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.008430+0000 mgr.gibba009.xiladd (mgr.34457) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.009622+0000 mgr.gibba009.xiladd (mgr.34457) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.010932+0000 mgr.gibba009.xiladd (mgr.34457) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.010966+0000 mgr.gibba009.xiladd (mgr.34457) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.012022+0000 mgr.gibba009.xiladd (mgr.34457) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.012351+0000 mgr.gibba009.xiladd (mgr.34457) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.013703+0000 mgr.gibba009.xiladd (mgr.34457) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.013741+0000 mgr.gibba009.xiladd (mgr.34457) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:17.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:17 gibba009 bash[26136]: cephadm 2021-03-10T20:40:16.013870+0000 mgr.gibba009.xiladd (mgr.34457) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:18.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:18 gibba004 bash[30897]: cluster 2021-03-10T20:40:17.304045+0000 mgr.gibba009.xiladd (mgr.34457) 1621 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:18.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:18 gibba004 bash[31878]: cluster 2021-03-10T20:40:17.304045+0000 mgr.gibba009.xiladd (mgr.34457) 1621 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:18 gibba009 bash[26136]: cluster 2021-03-10T20:40:17.304045+0000 mgr.gibba009.xiladd (mgr.34457) 1621 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:20 gibba004 bash[30897]: cluster 2021-03-10T20:40:19.305271+0000 mgr.gibba009.xiladd (mgr.34457) 1622 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:20 gibba004 bash[31878]: cluster 2021-03-10T20:40:19.305271+0000 mgr.gibba009.xiladd (mgr.34457) 1622 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:20 gibba009 bash[26136]: cluster 2021-03-10T20:40:19.305271+0000 mgr.gibba009.xiladd (mgr.34457) 1622 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:22 gibba004 bash[30897]: cluster 2021-03-10T20:40:21.307051+0000 mgr.gibba009.xiladd (mgr.34457) 1623 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:22 gibba004 bash[31878]: cluster 2021-03-10T20:40:21.307051+0000 mgr.gibba009.xiladd (mgr.34457) 1623 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:22 gibba009 bash[26136]: cluster 2021-03-10T20:40:21.307051+0000 mgr.gibba009.xiladd (mgr.34457) 1623 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:24 gibba004 bash[30897]: cluster 2021-03-10T20:40:23.308456+0000 mgr.gibba009.xiladd (mgr.34457) 1624 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:24 gibba004 bash[31878]: cluster 2021-03-10T20:40:23.308456+0000 mgr.gibba009.xiladd (mgr.34457) 1624 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:24 gibba009 bash[26136]: cluster 2021-03-10T20:40:23.308456+0000 mgr.gibba009.xiladd (mgr.34457) 1624 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:26 gibba004 bash[30897]: cluster 2021-03-10T20:40:25.310181+0000 mgr.gibba009.xiladd (mgr.34457) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:26 gibba004 bash[31878]: cluster 2021-03-10T20:40:25.310181+0000 mgr.gibba009.xiladd (mgr.34457) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:26 gibba009 bash[26136]: cluster 2021-03-10T20:40:25.310181+0000 mgr.gibba009.xiladd (mgr.34457) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:28 gibba004 bash[30897]: cluster 2021-03-10T20:40:27.311684+0000 mgr.gibba009.xiladd (mgr.34457) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:28 gibba004 bash[31878]: cluster 2021-03-10T20:40:27.311684+0000 mgr.gibba009.xiladd (mgr.34457) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:28 gibba009 bash[26136]: cluster 2021-03-10T20:40:27.311684+0000 mgr.gibba009.xiladd (mgr.34457) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:30.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:30 gibba004 bash[30897]: cluster 2021-03-10T20:40:29.313028+0000 mgr.gibba009.xiladd (mgr.34457) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:30.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:30 gibba004 bash[31878]: cluster 2021-03-10T20:40:29.313028+0000 mgr.gibba009.xiladd (mgr.34457) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:30 gibba009 bash[26136]: cluster 2021-03-10T20:40:29.313028+0000 mgr.gibba009.xiladd (mgr.34457) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:32 gibba004 bash[30897]: cephadm 2021-03-10T20:40:31.019558+0000 mgr.gibba009.xiladd (mgr.34457) 1628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:32 gibba004 bash[30897]: cluster 2021-03-10T20:40:31.314630+0000 mgr.gibba009.xiladd (mgr.34457) 1629 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:32 gibba004 bash[31878]: cephadm 2021-03-10T20:40:31.019558+0000 mgr.gibba009.xiladd (mgr.34457) 1628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:32.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:32 gibba004 bash[31878]: cluster 2021-03-10T20:40:31.314630+0000 mgr.gibba009.xiladd (mgr.34457) 1629 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:32 gibba009 bash[26136]: cephadm 2021-03-10T20:40:31.019558+0000 mgr.gibba009.xiladd (mgr.34457) 1628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:32.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:32 gibba009 bash[26136]: cluster 2021-03-10T20:40:31.314630+0000 mgr.gibba009.xiladd (mgr.34457) 1629 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:34.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:34 gibba004 bash[30897]: cluster 2021-03-10T20:40:33.316142+0000 mgr.gibba009.xiladd (mgr.34457) 1630 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:34 gibba004 bash[31878]: cluster 2021-03-10T20:40:33.316142+0000 mgr.gibba009.xiladd (mgr.34457) 1630 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:34 gibba009 bash[26136]: cluster 2021-03-10T20:40:33.316142+0000 mgr.gibba009.xiladd (mgr.34457) 1630 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.771 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:40:36.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:36 gibba004 bash[30897]: cluster 2021-03-10T20:40:35.317877+0000 mgr.gibba009.xiladd (mgr.34457) 1631 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:36 gibba004 bash[31878]: cluster 2021-03-10T20:40:35.317877+0000 mgr.gibba009.xiladd (mgr.34457) 1631 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:36 gibba009 bash[26136]: cluster 2021-03-10T20:40:35.317877+0000 mgr.gibba009.xiladd (mgr.34457) 1631 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:37.032 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:40:37.032 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (29m) 5m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:40:37.033 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (34m) 4m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:40:37.033 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (29m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:40:37.033 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:40:37.033 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:40:37.033 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:40:37.034 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:40:37.034 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:40:37.034 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:40:37.034 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:40:37.035 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:40:37.035 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:40:37.035 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:40:37.035 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:40:37.036 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:40:37.036 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:40:37.036 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:40:37.036 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (24m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:40:37.036 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:40:37.037 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:37.037 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:37.283 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:40:37.283 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:40:37.283 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:37.283 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:37.284 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:40:37.284 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:37.284 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:37.284 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:40:37.285 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:40:37.285 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:40:37.285 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:40:37.285 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:40:37.285 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:40:37.286 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:40:37.286 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:40:37.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:37 gibba004 bash[30897]: audit 2021-03-10T20:40:37.282557+0000 mon.a (mon.0) 790 : audit [DBG] from='client.? 172.21.2.104:0/1964360640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:37.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:37 gibba004 bash[31878]: audit 2021-03-10T20:40:37.282557+0000 mon.a (mon.0) 790 : audit [DBG] from='client.? 172.21.2.104:0/1964360640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:37.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:37 gibba009 bash[26136]: audit 2021-03-10T20:40:37.282557+0000 mon.a (mon.0) 790 : audit [DBG] from='client.? 172.21.2.104:0/1964360640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:38.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[30897]: audit 2021-03-10T20:40:36.761500+0000 mgr.gibba009.xiladd (mgr.34457) 1632 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[30897]: audit 2021-03-10T20:40:36.988809+0000 mgr.gibba009.xiladd (mgr.34457) 1633 : audit [DBG] from='client.45162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[30897]: cluster 2021-03-10T20:40:37.319439+0000 mgr.gibba009.xiladd (mgr.34457) 1634 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:38.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[31878]: audit 2021-03-10T20:40:36.761500+0000 mgr.gibba009.xiladd (mgr.34457) 1632 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[31878]: audit 2021-03-10T20:40:36.988809+0000 mgr.gibba009.xiladd (mgr.34457) 1633 : audit [DBG] from='client.45162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:38 gibba004 bash[31878]: cluster 2021-03-10T20:40:37.319439+0000 mgr.gibba009.xiladd (mgr.34457) 1634 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:38.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:38 gibba009 bash[26136]: audit 2021-03-10T20:40:36.761500+0000 mgr.gibba009.xiladd (mgr.34457) 1632 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:38 gibba009 bash[26136]: audit 2021-03-10T20:40:36.988809+0000 mgr.gibba009.xiladd (mgr.34457) 1633 : audit [DBG] from='client.45162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:38.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:38 gibba009 bash[26136]: cluster 2021-03-10T20:40:37.319439+0000 mgr.gibba009.xiladd (mgr.34457) 1634 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: cluster 2021-03-10T20:40:39.320007+0000 mgr.gibba009.xiladd (mgr.34457) 1635 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.744886+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.745546+0000 mon.c (mon.1) 518 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.746104+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.746270+0000 mon.c (mon.1) 519 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.746993+0000 mon.c (mon.1) 520 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.747804+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.748476+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.748615+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.749066+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.749292+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.749534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[30897]: audit 2021-03-10T20:40:39.749711+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: cluster 2021-03-10T20:40:39.320007+0000 mgr.gibba009.xiladd (mgr.34457) 1635 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.744886+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.745546+0000 mon.c (mon.1) 518 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.746104+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.746270+0000 mon.c (mon.1) 519 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.746993+0000 mon.c (mon.1) 520 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.747804+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.748476+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.748615+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.749066+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.749292+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.749534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:40 gibba004 bash[31878]: audit 2021-03-10T20:40:39.749711+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: cluster 2021-03-10T20:40:39.320007+0000 mgr.gibba009.xiladd (mgr.34457) 1635 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.744886+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.745546+0000 mon.c (mon.1) 518 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.746104+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.746270+0000 mon.c (mon.1) 519 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.746993+0000 mon.c (mon.1) 520 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.747804+0000 mon.c (mon.1) 521 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.748476+0000 mon.c (mon.1) 522 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.748615+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.749066+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:40:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.749292+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:40:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.749534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:40:40.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:40 gibba009 bash[26136]: audit 2021-03-10T20:40:39.749711+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:40:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:42 gibba004 bash[30897]: cluster 2021-03-10T20:40:41.321606+0000 mgr.gibba009.xiladd (mgr.34457) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:42 gibba004 bash[31878]: cluster 2021-03-10T20:40:41.321606+0000 mgr.gibba009.xiladd (mgr.34457) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:42 gibba009 bash[26136]: cluster 2021-03-10T20:40:41.321606+0000 mgr.gibba009.xiladd (mgr.34457) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:44.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:44 gibba004 bash[30897]: cluster 2021-03-10T20:40:43.322877+0000 mgr.gibba009.xiladd (mgr.34457) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:44 gibba004 bash[31878]: cluster 2021-03-10T20:40:43.322877+0000 mgr.gibba009.xiladd (mgr.34457) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:44 gibba009 bash[26136]: cluster 2021-03-10T20:40:43.322877+0000 mgr.gibba009.xiladd (mgr.34457) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:46 gibba004 bash[30897]: cluster 2021-03-10T20:40:45.324540+0000 mgr.gibba009.xiladd (mgr.34457) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:46 gibba004 bash[31878]: cluster 2021-03-10T20:40:45.324540+0000 mgr.gibba009.xiladd (mgr.34457) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:46 gibba009 bash[26136]: cluster 2021-03-10T20:40:45.324540+0000 mgr.gibba009.xiladd (mgr.34457) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:47.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:47 gibba004 bash[30897]: cephadm 2021-03-10T20:40:46.035496+0000 mgr.gibba009.xiladd (mgr.34457) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:47 gibba004 bash[31878]: cephadm 2021-03-10T20:40:46.035496+0000 mgr.gibba009.xiladd (mgr.34457) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:47.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:47 gibba009 bash[26136]: cephadm 2021-03-10T20:40:46.035496+0000 mgr.gibba009.xiladd (mgr.34457) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:40:48.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:48 gibba004 bash[30897]: cluster 2021-03-10T20:40:47.325905+0000 mgr.gibba009.xiladd (mgr.34457) 1640 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:48 gibba004 bash[31878]: cluster 2021-03-10T20:40:47.325905+0000 mgr.gibba009.xiladd (mgr.34457) 1640 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:48 gibba009 bash[26136]: cluster 2021-03-10T20:40:47.325905+0000 mgr.gibba009.xiladd (mgr.34457) 1640 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:50 gibba004 bash[30897]: cluster 2021-03-10T20:40:49.326448+0000 mgr.gibba009.xiladd (mgr.34457) 1641 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:50 gibba004 bash[31878]: cluster 2021-03-10T20:40:49.326448+0000 mgr.gibba009.xiladd (mgr.34457) 1641 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:50 gibba009 bash[26136]: cluster 2021-03-10T20:40:49.326448+0000 mgr.gibba009.xiladd (mgr.34457) 1641 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:52 gibba004 bash[30897]: cluster 2021-03-10T20:40:51.328065+0000 mgr.gibba009.xiladd (mgr.34457) 1642 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:52 gibba004 bash[31878]: cluster 2021-03-10T20:40:51.328065+0000 mgr.gibba009.xiladd (mgr.34457) 1642 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:52 gibba009 bash[26136]: cluster 2021-03-10T20:40:51.328065+0000 mgr.gibba009.xiladd (mgr.34457) 1642 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:54 gibba004 bash[30897]: cluster 2021-03-10T20:40:53.329586+0000 mgr.gibba009.xiladd (mgr.34457) 1643 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:54 gibba004 bash[31878]: cluster 2021-03-10T20:40:53.329586+0000 mgr.gibba009.xiladd (mgr.34457) 1643 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:54 gibba009 bash[26136]: cluster 2021-03-10T20:40:53.329586+0000 mgr.gibba009.xiladd (mgr.34457) 1643 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:56 gibba004 bash[30897]: cluster 2021-03-10T20:40:55.331197+0000 mgr.gibba009.xiladd (mgr.34457) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:56 gibba004 bash[31878]: cluster 2021-03-10T20:40:55.331197+0000 mgr.gibba009.xiladd (mgr.34457) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:56 gibba009 bash[26136]: cluster 2021-03-10T20:40:55.331197+0000 mgr.gibba009.xiladd (mgr.34457) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:40:58 gibba004 bash[30897]: cluster 2021-03-10T20:40:57.332725+0000 mgr.gibba009.xiladd (mgr.34457) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:40:58 gibba004 bash[31878]: cluster 2021-03-10T20:40:57.332725+0000 mgr.gibba009.xiladd (mgr.34457) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:40:58 gibba009 bash[26136]: cluster 2021-03-10T20:40:57.332725+0000 mgr.gibba009.xiladd (mgr.34457) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:00 gibba004 bash[30897]: cluster 2021-03-10T20:40:59.333973+0000 mgr.gibba009.xiladd (mgr.34457) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:00 gibba004 bash[31878]: cluster 2021-03-10T20:40:59.333973+0000 mgr.gibba009.xiladd (mgr.34457) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:00 gibba009 bash[26136]: cluster 2021-03-10T20:40:59.333973+0000 mgr.gibba009.xiladd (mgr.34457) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:02 gibba004 bash[30897]: cephadm 2021-03-10T20:41:01.051276+0000 mgr.gibba009.xiladd (mgr.34457) 1647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:02 gibba004 bash[30897]: cluster 2021-03-10T20:41:01.335802+0000 mgr.gibba009.xiladd (mgr.34457) 1648 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:02 gibba004 bash[31878]: cephadm 2021-03-10T20:41:01.051276+0000 mgr.gibba009.xiladd (mgr.34457) 1647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:02.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:02 gibba004 bash[31878]: cluster 2021-03-10T20:41:01.335802+0000 mgr.gibba009.xiladd (mgr.34457) 1648 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:02 gibba009 bash[26136]: cephadm 2021-03-10T20:41:01.051276+0000 mgr.gibba009.xiladd (mgr.34457) 1647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:02 gibba009 bash[26136]: cluster 2021-03-10T20:41:01.335802+0000 mgr.gibba009.xiladd (mgr.34457) 1648 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:04.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:04 gibba004 bash[30897]: cluster 2021-03-10T20:41:03.337356+0000 mgr.gibba009.xiladd (mgr.34457) 1649 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:04.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:04 gibba004 bash[31878]: cluster 2021-03-10T20:41:03.337356+0000 mgr.gibba009.xiladd (mgr.34457) 1649 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:04 gibba009 bash[26136]: cluster 2021-03-10T20:41:03.337356+0000 mgr.gibba009.xiladd (mgr.34457) 1649 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:06 gibba004 bash[30897]: cluster 2021-03-10T20:41:05.338968+0000 mgr.gibba009.xiladd (mgr.34457) 1650 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:06 gibba004 bash[31878]: cluster 2021-03-10T20:41:05.338968+0000 mgr.gibba009.xiladd (mgr.34457) 1650 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:06 gibba009 bash[26136]: cluster 2021-03-10T20:41:05.338968+0000 mgr.gibba009.xiladd (mgr.34457) 1650 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:07.528 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:41:07.758 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:41:07.758 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (30m) 6m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:41:07.758 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (35m) 4m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:41:07.759 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:41:07.759 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:41:07.759 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (29m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:41:07.759 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (29m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:41:07.760 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (29m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:41:07.760 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:41:07.760 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (35m) 6m ago 35m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:41:07.760 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:41:07.761 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:41:07.761 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:41:07.762 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:41:07.762 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:41:07.762 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:41:07.763 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:41:07.763 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:41:07.763 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:41:07.763 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:41:07.764 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:07.764 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:08.005 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:41:08.005 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:41:08.005 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:08.005 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:08.006 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:41:08.006 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:08.006 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:08.006 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:41:08.007 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:41:08.007 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:08.007 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:41:08.007 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:41:08.008 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:41:08.008 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:41:08.008 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:41:08.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[30897]: cluster 2021-03-10T20:41:07.340573+0000 mgr.gibba009.xiladd (mgr.34457) 1651 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[30897]: audit 2021-03-10T20:41:07.518337+0000 mgr.gibba009.xiladd (mgr.34457) 1652 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:08.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[30897]: audit 2021-03-10T20:41:08.004183+0000 mon.a (mon.0) 797 : audit [DBG] from='client.? 172.21.2.104:0/2299240904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:08.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[31878]: cluster 2021-03-10T20:41:07.340573+0000 mgr.gibba009.xiladd (mgr.34457) 1651 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[31878]: audit 2021-03-10T20:41:07.518337+0000 mgr.gibba009.xiladd (mgr.34457) 1652 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:08.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:08 gibba004 bash[31878]: audit 2021-03-10T20:41:08.004183+0000 mon.a (mon.0) 797 : audit [DBG] from='client.? 172.21.2.104:0/2299240904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:08 gibba009 bash[26136]: cluster 2021-03-10T20:41:07.340573+0000 mgr.gibba009.xiladd (mgr.34457) 1651 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:08 gibba009 bash[26136]: audit 2021-03-10T20:41:07.518337+0000 mgr.gibba009.xiladd (mgr.34457) 1652 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:08.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:08 gibba009 bash[26136]: audit 2021-03-10T20:41:08.004183+0000 mon.a (mon.0) 797 : audit [DBG] from='client.? 172.21.2.104:0/2299240904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:09.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:09 gibba004 bash[30897]: audit 2021-03-10T20:41:07.744113+0000 mgr.gibba009.xiladd (mgr.34457) 1653 : audit [DBG] from='client.55159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:09.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:09 gibba004 bash[31878]: audit 2021-03-10T20:41:07.744113+0000 mgr.gibba009.xiladd (mgr.34457) 1653 : audit [DBG] from='client.55159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:09.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:09 gibba009 bash[26136]: audit 2021-03-10T20:41:07.744113+0000 mgr.gibba009.xiladd (mgr.34457) 1653 : audit [DBG] from='client.55159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:10 gibba004 bash[30897]: cluster 2021-03-10T20:41:09.341871+0000 mgr.gibba009.xiladd (mgr.34457) 1654 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:10 gibba004 bash[31878]: cluster 2021-03-10T20:41:09.341871+0000 mgr.gibba009.xiladd (mgr.34457) 1654 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:10 gibba009 bash[26136]: cluster 2021-03-10T20:41:09.341871+0000 mgr.gibba009.xiladd (mgr.34457) 1654 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:12 gibba004 bash[30897]: cluster 2021-03-10T20:41:11.343612+0000 mgr.gibba009.xiladd (mgr.34457) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:12 gibba004 bash[31878]: cluster 2021-03-10T20:41:11.343612+0000 mgr.gibba009.xiladd (mgr.34457) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:12 gibba009 bash[26136]: cluster 2021-03-10T20:41:11.343612+0000 mgr.gibba009.xiladd (mgr.34457) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:14.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:14 gibba004 bash[30897]: cluster 2021-03-10T20:41:13.345087+0000 mgr.gibba009.xiladd (mgr.34457) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:14 gibba004 bash[31878]: cluster 2021-03-10T20:41:13.345087+0000 mgr.gibba009.xiladd (mgr.34457) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:14 gibba009 bash[26136]: cluster 2021-03-10T20:41:13.345087+0000 mgr.gibba009.xiladd (mgr.34457) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: cluster 2021-03-10T20:41:15.346687+0000 mgr.gibba009.xiladd (mgr.34457) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.057807+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.293230+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:41:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.297561+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.298948+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.300587+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.302321+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.308299+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:16 gibba009 bash[26136]: audit 2021-03-10T20:41:16.313508+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: cluster 2021-03-10T20:41:15.346687+0000 mgr.gibba009.xiladd (mgr.34457) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.057807+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.293230+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:41:16.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.297561+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.298948+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.300587+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.302321+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.308299+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[30897]: audit 2021-03-10T20:41:16.313508+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: cluster 2021-03-10T20:41:15.346687+0000 mgr.gibba009.xiladd (mgr.34457) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.057807+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.293230+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:41:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.297561+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.298948+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.300587+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.302321+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.308299+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:16.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:16 gibba004 bash[31878]: audit 2021-03-10T20:41:16.313508+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.062870+0000 mgr.gibba009.xiladd (mgr.34457) 1658 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:41:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.064273+0000 mgr.gibba009.xiladd (mgr.34457) 1659 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:41:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.295553+0000 mgr.gibba009.xiladd (mgr.34457) 1660 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.297504+0000 mgr.gibba009.xiladd (mgr.34457) 1661 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.298945+0000 mgr.gibba009.xiladd (mgr.34457) 1662 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.298989+0000 mgr.gibba009.xiladd (mgr.34457) 1663 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.300664+0000 mgr.gibba009.xiladd (mgr.34457) 1664 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.300742+0000 mgr.gibba009.xiladd (mgr.34457) 1665 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.302067+0000 mgr.gibba009.xiladd (mgr.34457) 1666 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.305040+0000 mgr.gibba009.xiladd (mgr.34457) 1667 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.305267+0000 mgr.gibba009.xiladd (mgr.34457) 1668 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.309285+0000 mgr.gibba009.xiladd (mgr.34457) 1669 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.311363+0000 mgr.gibba009.xiladd (mgr.34457) 1670 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.314801+0000 mgr.gibba009.xiladd (mgr.34457) 1671 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:17.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.315307+0000 mgr.gibba009.xiladd (mgr.34457) 1672 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:17.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[30897]: cephadm 2021-03-10T20:41:16.316204+0000 mgr.gibba009.xiladd (mgr.34457) 1673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.062870+0000 mgr.gibba009.xiladd (mgr.34457) 1658 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:41:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.064273+0000 mgr.gibba009.xiladd (mgr.34457) 1659 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:41:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.295553+0000 mgr.gibba009.xiladd (mgr.34457) 1660 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.297504+0000 mgr.gibba009.xiladd (mgr.34457) 1661 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.298945+0000 mgr.gibba009.xiladd (mgr.34457) 1662 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.298989+0000 mgr.gibba009.xiladd (mgr.34457) 1663 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:17.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.300664+0000 mgr.gibba009.xiladd (mgr.34457) 1664 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.300742+0000 mgr.gibba009.xiladd (mgr.34457) 1665 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.302067+0000 mgr.gibba009.xiladd (mgr.34457) 1666 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.305040+0000 mgr.gibba009.xiladd (mgr.34457) 1667 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:17.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.305267+0000 mgr.gibba009.xiladd (mgr.34457) 1668 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.309285+0000 mgr.gibba009.xiladd (mgr.34457) 1669 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.311363+0000 mgr.gibba009.xiladd (mgr.34457) 1670 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:17.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.314801+0000 mgr.gibba009.xiladd (mgr.34457) 1671 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.315307+0000 mgr.gibba009.xiladd (mgr.34457) 1672 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:17.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:17 gibba004 bash[31878]: cephadm 2021-03-10T20:41:16.316204+0000 mgr.gibba009.xiladd (mgr.34457) 1673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.062870+0000 mgr.gibba009.xiladd (mgr.34457) 1658 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:41:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.064273+0000 mgr.gibba009.xiladd (mgr.34457) 1659 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:41:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.295553+0000 mgr.gibba009.xiladd (mgr.34457) 1660 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.297504+0000 mgr.gibba009.xiladd (mgr.34457) 1661 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.298945+0000 mgr.gibba009.xiladd (mgr.34457) 1662 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.298989+0000 mgr.gibba009.xiladd (mgr.34457) 1663 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.300664+0000 mgr.gibba009.xiladd (mgr.34457) 1664 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.300742+0000 mgr.gibba009.xiladd (mgr.34457) 1665 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.302067+0000 mgr.gibba009.xiladd (mgr.34457) 1666 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.305040+0000 mgr.gibba009.xiladd (mgr.34457) 1667 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.305267+0000 mgr.gibba009.xiladd (mgr.34457) 1668 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:17.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.309285+0000 mgr.gibba009.xiladd (mgr.34457) 1669 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.311363+0000 mgr.gibba009.xiladd (mgr.34457) 1670 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.314801+0000 mgr.gibba009.xiladd (mgr.34457) 1671 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.315307+0000 mgr.gibba009.xiladd (mgr.34457) 1672 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:17.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:17 gibba009 bash[26136]: cephadm 2021-03-10T20:41:16.316204+0000 mgr.gibba009.xiladd (mgr.34457) 1673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:18.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:18 gibba004 bash[30897]: cluster 2021-03-10T20:41:17.348192+0000 mgr.gibba009.xiladd (mgr.34457) 1674 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:18.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:18 gibba004 bash[31878]: cluster 2021-03-10T20:41:17.348192+0000 mgr.gibba009.xiladd (mgr.34457) 1674 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:18 gibba009 bash[26136]: cluster 2021-03-10T20:41:17.348192+0000 mgr.gibba009.xiladd (mgr.34457) 1674 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.562 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:20 gibba004 bash[30897]: cluster 2021-03-10T20:41:19.348930+0000 mgr.gibba009.xiladd (mgr.34457) 1675 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.563 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:20 gibba004 bash[31878]: cluster 2021-03-10T20:41:19.348930+0000 mgr.gibba009.xiladd (mgr.34457) 1675 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:20 gibba009 bash[26136]: cluster 2021-03-10T20:41:19.348930+0000 mgr.gibba009.xiladd (mgr.34457) 1675 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:22 gibba004 bash[30897]: cluster 2021-03-10T20:41:21.350710+0000 mgr.gibba009.xiladd (mgr.34457) 1676 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:22 gibba004 bash[31878]: cluster 2021-03-10T20:41:21.350710+0000 mgr.gibba009.xiladd (mgr.34457) 1676 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:22 gibba009 bash[26136]: cluster 2021-03-10T20:41:21.350710+0000 mgr.gibba009.xiladd (mgr.34457) 1676 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:24 gibba004 bash[30897]: cluster 2021-03-10T20:41:23.352158+0000 mgr.gibba009.xiladd (mgr.34457) 1677 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:24 gibba004 bash[31878]: cluster 2021-03-10T20:41:23.352158+0000 mgr.gibba009.xiladd (mgr.34457) 1677 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:24 gibba009 bash[26136]: cluster 2021-03-10T20:41:23.352158+0000 mgr.gibba009.xiladd (mgr.34457) 1677 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:26.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:26 gibba004 bash[30897]: cluster 2021-03-10T20:41:25.353859+0000 mgr.gibba009.xiladd (mgr.34457) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:26 gibba004 bash[31878]: cluster 2021-03-10T20:41:25.353859+0000 mgr.gibba009.xiladd (mgr.34457) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:26.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:26 gibba009 bash[26136]: cluster 2021-03-10T20:41:25.353859+0000 mgr.gibba009.xiladd (mgr.34457) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:28 gibba004 bash[30897]: cluster 2021-03-10T20:41:27.355367+0000 mgr.gibba009.xiladd (mgr.34457) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:28 gibba004 bash[31878]: cluster 2021-03-10T20:41:27.355367+0000 mgr.gibba009.xiladd (mgr.34457) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:28 gibba009 bash[26136]: cluster 2021-03-10T20:41:27.355367+0000 mgr.gibba009.xiladd (mgr.34457) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:30.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:30 gibba009 bash[26136]: cluster 2021-03-10T20:41:29.356629+0000 mgr.gibba009.xiladd (mgr.34457) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:30 gibba004 bash[30897]: cluster 2021-03-10T20:41:29.356629+0000 mgr.gibba009.xiladd (mgr.34457) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:30 gibba004 bash[31878]: cluster 2021-03-10T20:41:29.356629+0000 mgr.gibba009.xiladd (mgr.34457) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:32 gibba004 bash[30897]: cephadm 2021-03-10T20:41:31.322812+0000 mgr.gibba009.xiladd (mgr.34457) 1681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:32 gibba004 bash[30897]: cluster 2021-03-10T20:41:31.358252+0000 mgr.gibba009.xiladd (mgr.34457) 1682 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:32 gibba004 bash[31878]: cephadm 2021-03-10T20:41:31.322812+0000 mgr.gibba009.xiladd (mgr.34457) 1681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:32.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:32 gibba004 bash[31878]: cluster 2021-03-10T20:41:31.358252+0000 mgr.gibba009.xiladd (mgr.34457) 1682 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:32 gibba009 bash[26136]: cephadm 2021-03-10T20:41:31.322812+0000 mgr.gibba009.xiladd (mgr.34457) 1681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:32 gibba009 bash[26136]: cluster 2021-03-10T20:41:31.358252+0000 mgr.gibba009.xiladd (mgr.34457) 1682 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:34.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:34 gibba004 bash[30897]: cluster 2021-03-10T20:41:33.359716+0000 mgr.gibba009.xiladd (mgr.34457) 1683 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:34 gibba004 bash[31878]: cluster 2021-03-10T20:41:33.359716+0000 mgr.gibba009.xiladd (mgr.34457) 1683 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:34 gibba009 bash[26136]: cluster 2021-03-10T20:41:33.359716+0000 mgr.gibba009.xiladd (mgr.34457) 1683 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:36 gibba004 bash[30897]: cluster 2021-03-10T20:41:35.361549+0000 mgr.gibba009.xiladd (mgr.34457) 1684 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:36 gibba004 bash[31878]: cluster 2021-03-10T20:41:35.361549+0000 mgr.gibba009.xiladd (mgr.34457) 1684 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:36 gibba009 bash[26136]: cluster 2021-03-10T20:41:35.361549+0000 mgr.gibba009.xiladd (mgr.34457) 1684 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.248 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:41:38.471 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:41:38.471 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (30m) 6m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:41:38.472 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (35m) 5m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:41:38.472 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (30m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:41:38.472 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:41:38.472 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:41:38.473 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:41:38.473 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:41:38.473 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:41:38.473 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:41:38.474 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:41:38.474 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:41:38.474 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:41:38.474 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:41:38.475 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:41:38.475 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:41:38.475 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:41:38.475 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:41:38.475 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (25m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:41:38.476 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:41:38.476 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:38.476 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:38.725 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:41:38.725 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:41:38.725 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:38.725 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:38.726 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:41:38.726 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:38.726 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:38.727 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:41:38.727 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:41:38.727 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:41:38.727 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:41:38.728 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:41:38.728 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:41:38.728 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:41:38.728 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:41:38.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:38 gibba004 bash[30897]: cluster 2021-03-10T20:41:37.362910+0000 mgr.gibba009.xiladd (mgr.34457) 1685 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:38 gibba004 bash[31878]: cluster 2021-03-10T20:41:37.362910+0000 mgr.gibba009.xiladd (mgr.34457) 1685 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:38 gibba009 bash[26136]: cluster 2021-03-10T20:41:37.362910+0000 mgr.gibba009.xiladd (mgr.34457) 1685 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:39.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[30897]: audit 2021-03-10T20:41:38.238268+0000 mgr.gibba009.xiladd (mgr.34457) 1686 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[30897]: audit 2021-03-10T20:41:38.460972+0000 mgr.gibba009.xiladd (mgr.34457) 1687 : audit [DBG] from='client.45198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[30897]: audit 2021-03-10T20:41:38.724486+0000 mon.c (mon.1) 530 : audit [DBG] from='client.? 172.21.2.104:0/285430716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[31878]: audit 2021-03-10T20:41:38.238268+0000 mgr.gibba009.xiladd (mgr.34457) 1686 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[31878]: audit 2021-03-10T20:41:38.460972+0000 mgr.gibba009.xiladd (mgr.34457) 1687 : audit [DBG] from='client.45198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:39 gibba004 bash[31878]: audit 2021-03-10T20:41:38.724486+0000 mon.c (mon.1) 530 : audit [DBG] from='client.? 172.21.2.104:0/285430716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:39 gibba009 bash[26136]: audit 2021-03-10T20:41:38.238268+0000 mgr.gibba009.xiladd (mgr.34457) 1686 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:39 gibba009 bash[26136]: audit 2021-03-10T20:41:38.460972+0000 mgr.gibba009.xiladd (mgr.34457) 1687 : audit [DBG] from='client.45198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:39.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:39 gibba009 bash[26136]: audit 2021-03-10T20:41:38.724486+0000 mon.c (mon.1) 530 : audit [DBG] from='client.? 172.21.2.104:0/285430716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: cluster 2021-03-10T20:41:39.364224+0000 mgr.gibba009.xiladd (mgr.34457) 1688 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.763061+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.763762+0000 mon.c (mon.1) 532 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.764200+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.765461+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.773287+0000 mon.c (mon.1) 533 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.773999+0000 mon.c (mon.1) 534 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.774384+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.774770+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.775579+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.775628+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.776782+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[30897]: audit 2021-03-10T20:41:39.777579+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: cluster 2021-03-10T20:41:39.364224+0000 mgr.gibba009.xiladd (mgr.34457) 1688 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.763061+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.763762+0000 mon.c (mon.1) 532 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.764200+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.765461+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.773287+0000 mon.c (mon.1) 533 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.773999+0000 mon.c (mon.1) 534 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.774384+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.774770+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.775579+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.775628+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.776782+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:40 gibba004 bash[31878]: audit 2021-03-10T20:41:39.777579+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: cluster 2021-03-10T20:41:39.364224+0000 mgr.gibba009.xiladd (mgr.34457) 1688 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.763061+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.763762+0000 mon.c (mon.1) 532 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.764200+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.765461+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.773287+0000 mon.c (mon.1) 533 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.773999+0000 mon.c (mon.1) 534 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.774384+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:41:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.774770+0000 mon.c (mon.1) 535 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.775579+0000 mon.c (mon.1) 536 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.775628+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.776782+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:41:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:40 gibba009 bash[26136]: audit 2021-03-10T20:41:39.777579+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:41:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:42 gibba004 bash[30897]: cluster 2021-03-10T20:41:41.366059+0000 mgr.gibba009.xiladd (mgr.34457) 1689 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:42 gibba004 bash[31878]: cluster 2021-03-10T20:41:41.366059+0000 mgr.gibba009.xiladd (mgr.34457) 1689 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:42 gibba009 bash[26136]: cluster 2021-03-10T20:41:41.366059+0000 mgr.gibba009.xiladd (mgr.34457) 1689 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:44 gibba004 bash[30897]: cluster 2021-03-10T20:41:43.367443+0000 mgr.gibba009.xiladd (mgr.34457) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:44 gibba004 bash[31878]: cluster 2021-03-10T20:41:43.367443+0000 mgr.gibba009.xiladd (mgr.34457) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:44 gibba009 bash[26136]: cluster 2021-03-10T20:41:43.367443+0000 mgr.gibba009.xiladd (mgr.34457) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:46 gibba004 bash[30897]: cluster 2021-03-10T20:41:45.369131+0000 mgr.gibba009.xiladd (mgr.34457) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:46 gibba004 bash[31878]: cluster 2021-03-10T20:41:45.369131+0000 mgr.gibba009.xiladd (mgr.34457) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:46 gibba009 bash[26136]: cluster 2021-03-10T20:41:45.369131+0000 mgr.gibba009.xiladd (mgr.34457) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:47.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:47 gibba004 bash[30897]: cephadm 2021-03-10T20:41:46.337761+0000 mgr.gibba009.xiladd (mgr.34457) 1692 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:47.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:47 gibba004 bash[31878]: cephadm 2021-03-10T20:41:46.337761+0000 mgr.gibba009.xiladd (mgr.34457) 1692 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:47.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:47 gibba009 bash[26136]: cephadm 2021-03-10T20:41:46.337761+0000 mgr.gibba009.xiladd (mgr.34457) 1692 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:41:48.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:48 gibba004 bash[30897]: cluster 2021-03-10T20:41:47.370501+0000 mgr.gibba009.xiladd (mgr.34457) 1693 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:48 gibba004 bash[31878]: cluster 2021-03-10T20:41:47.370501+0000 mgr.gibba009.xiladd (mgr.34457) 1693 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:48 gibba009 bash[26136]: cluster 2021-03-10T20:41:47.370501+0000 mgr.gibba009.xiladd (mgr.34457) 1693 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:50 gibba009 bash[26136]: cluster 2021-03-10T20:41:49.371749+0000 mgr.gibba009.xiladd (mgr.34457) 1694 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:50 gibba004 bash[30897]: cluster 2021-03-10T20:41:49.371749+0000 mgr.gibba009.xiladd (mgr.34457) 1694 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:50 gibba004 bash[31878]: cluster 2021-03-10T20:41:49.371749+0000 mgr.gibba009.xiladd (mgr.34457) 1694 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:52 gibba004 bash[30897]: cluster 2021-03-10T20:41:51.373710+0000 mgr.gibba009.xiladd (mgr.34457) 1695 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:52 gibba004 bash[31878]: cluster 2021-03-10T20:41:51.373710+0000 mgr.gibba009.xiladd (mgr.34457) 1695 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:52 gibba009 bash[26136]: cluster 2021-03-10T20:41:51.373710+0000 mgr.gibba009.xiladd (mgr.34457) 1695 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:54 gibba004 bash[30897]: cluster 2021-03-10T20:41:53.375222+0000 mgr.gibba009.xiladd (mgr.34457) 1696 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:54 gibba004 bash[31878]: cluster 2021-03-10T20:41:53.375222+0000 mgr.gibba009.xiladd (mgr.34457) 1696 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:54 gibba009 bash[26136]: cluster 2021-03-10T20:41:53.375222+0000 mgr.gibba009.xiladd (mgr.34457) 1696 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:56 gibba004 bash[30897]: cluster 2021-03-10T20:41:55.376749+0000 mgr.gibba009.xiladd (mgr.34457) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:56 gibba004 bash[31878]: cluster 2021-03-10T20:41:55.376749+0000 mgr.gibba009.xiladd (mgr.34457) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:56 gibba009 bash[26136]: cluster 2021-03-10T20:41:55.376749+0000 mgr.gibba009.xiladd (mgr.34457) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:41:58 gibba004 bash[30897]: cluster 2021-03-10T20:41:57.378063+0000 mgr.gibba009.xiladd (mgr.34457) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:41:58 gibba004 bash[31878]: cluster 2021-03-10T20:41:57.378063+0000 mgr.gibba009.xiladd (mgr.34457) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:41:58 gibba009 bash[26136]: cluster 2021-03-10T20:41:57.378063+0000 mgr.gibba009.xiladd (mgr.34457) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:00.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:00 gibba009 bash[26136]: cluster 2021-03-10T20:41:59.379396+0000 mgr.gibba009.xiladd (mgr.34457) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:00 gibba004 bash[30897]: cluster 2021-03-10T20:41:59.379396+0000 mgr.gibba009.xiladd (mgr.34457) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:00 gibba004 bash[31878]: cluster 2021-03-10T20:41:59.379396+0000 mgr.gibba009.xiladd (mgr.34457) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:02 gibba004 bash[30897]: cephadm 2021-03-10T20:42:01.353483+0000 mgr.gibba009.xiladd (mgr.34457) 1700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:02.993 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:02 gibba004 bash[30897]: cluster 2021-03-10T20:42:01.381177+0000 mgr.gibba009.xiladd (mgr.34457) 1701 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.993 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:02 gibba004 bash[31878]: cephadm 2021-03-10T20:42:01.353483+0000 mgr.gibba009.xiladd (mgr.34457) 1700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:02.994 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:02 gibba004 bash[31878]: cluster 2021-03-10T20:42:01.381177+0000 mgr.gibba009.xiladd (mgr.34457) 1701 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.994 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:02 gibba009 bash[26136]: cephadm 2021-03-10T20:42:01.353483+0000 mgr.gibba009.xiladd (mgr.34457) 1700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:02.995 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:02 gibba009 bash[26136]: cluster 2021-03-10T20:42:01.381177+0000 mgr.gibba009.xiladd (mgr.34457) 1701 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:04.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:04 gibba004 bash[30897]: cluster 2021-03-10T20:42:03.382688+0000 mgr.gibba009.xiladd (mgr.34457) 1702 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:04.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:04 gibba004 bash[31878]: cluster 2021-03-10T20:42:03.382688+0000 mgr.gibba009.xiladd (mgr.34457) 1702 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:04 gibba009 bash[26136]: cluster 2021-03-10T20:42:03.382688+0000 mgr.gibba009.xiladd (mgr.34457) 1702 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:06 gibba004 bash[30897]: cluster 2021-03-10T20:42:05.384350+0000 mgr.gibba009.xiladd (mgr.34457) 1703 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:06 gibba004 bash[31878]: cluster 2021-03-10T20:42:05.384350+0000 mgr.gibba009.xiladd (mgr.34457) 1703 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:06 gibba009 bash[26136]: cluster 2021-03-10T20:42:05.384350+0000 mgr.gibba009.xiladd (mgr.34457) 1703 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:08 gibba004 bash[30897]: cluster 2021-03-10T20:42:07.385944+0000 mgr.gibba009.xiladd (mgr.34457) 1704 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:08 gibba004 bash[31878]: cluster 2021-03-10T20:42:07.385944+0000 mgr.gibba009.xiladd (mgr.34457) 1704 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:08 gibba009 bash[26136]: cluster 2021-03-10T20:42:07.385944+0000 mgr.gibba009.xiladd (mgr.34457) 1704 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.966 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:42:09.195 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:42:09.195 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:42:09.196 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (36m) 5m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:42:09.196 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:42:09.196 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:42:09.196 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:42:09.197 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:42:09.197 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (30m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:42:09.197 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:42:09.197 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (36m) 7m ago 36m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:42:09.197 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:42:09.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:42:09.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:42:09.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:42:09.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:42:09.199 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:42:09.199 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:42:09.199 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:42:09.200 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:42:09.200 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:42:09.201 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:09.201 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:09.442 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:42:09.442 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:42:09.443 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:09.443 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:09.443 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:42:09.443 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:09.444 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:09.444 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:42:09.444 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:42:09.444 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:09.445 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:42:09.445 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:42:09.445 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:42:09.445 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:42:09.445 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:42:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[30897]: audit 2021-03-10T20:42:08.956371+0000 mgr.gibba009.xiladd (mgr.34457) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[30897]: audit 2021-03-10T20:42:09.180986+0000 mgr.gibba009.xiladd (mgr.34457) 1706 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[30897]: cluster 2021-03-10T20:42:09.387241+0000 mgr.gibba009.xiladd (mgr.34457) 1707 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[30897]: audit 2021-03-10T20:42:09.442354+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.104:0/754748567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[31878]: audit 2021-03-10T20:42:08.956371+0000 mgr.gibba009.xiladd (mgr.34457) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[31878]: audit 2021-03-10T20:42:09.180986+0000 mgr.gibba009.xiladd (mgr.34457) 1706 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[31878]: cluster 2021-03-10T20:42:09.387241+0000 mgr.gibba009.xiladd (mgr.34457) 1707 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:10 gibba004 bash[31878]: audit 2021-03-10T20:42:09.442354+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.104:0/754748567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:10 gibba009 bash[26136]: audit 2021-03-10T20:42:08.956371+0000 mgr.gibba009.xiladd (mgr.34457) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:10 gibba009 bash[26136]: audit 2021-03-10T20:42:09.180986+0000 mgr.gibba009.xiladd (mgr.34457) 1706 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:10 gibba009 bash[26136]: cluster 2021-03-10T20:42:09.387241+0000 mgr.gibba009.xiladd (mgr.34457) 1707 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:10 gibba009 bash[26136]: audit 2021-03-10T20:42:09.442354+0000 mon.a (mon.0) 805 : audit [DBG] from='client.? 172.21.2.104:0/754748567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:12.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:12 gibba004 bash[30897]: cluster 2021-03-10T20:42:11.388843+0000 mgr.gibba009.xiladd (mgr.34457) 1708 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:12 gibba004 bash[31878]: cluster 2021-03-10T20:42:11.388843+0000 mgr.gibba009.xiladd (mgr.34457) 1708 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:12.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:12 gibba009 bash[26136]: cluster 2021-03-10T20:42:11.388843+0000 mgr.gibba009.xiladd (mgr.34457) 1708 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:14.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:14 gibba004 bash[30897]: cluster 2021-03-10T20:42:13.390116+0000 mgr.gibba009.xiladd (mgr.34457) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:14 gibba004 bash[31878]: cluster 2021-03-10T20:42:13.390116+0000 mgr.gibba009.xiladd (mgr.34457) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:14 gibba009 bash[26136]: cluster 2021-03-10T20:42:13.390116+0000 mgr.gibba009.xiladd (mgr.34457) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.808 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:16 gibba009 bash[26136]: cluster 2021-03-10T20:42:15.391846+0000 mgr.gibba009.xiladd (mgr.34457) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.809 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:16 gibba009 bash[26136]: audit 2021-03-10T20:42:16.362323+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:16.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:16 gibba004 bash[30897]: cluster 2021-03-10T20:42:15.391846+0000 mgr.gibba009.xiladd (mgr.34457) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:16 gibba004 bash[30897]: audit 2021-03-10T20:42:16.362323+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:16.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:16 gibba004 bash[31878]: cluster 2021-03-10T20:42:15.391846+0000 mgr.gibba009.xiladd (mgr.34457) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:16 gibba004 bash[31878]: audit 2021-03-10T20:42:16.362323+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.558763+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.558837+0000 mgr.gibba009.xiladd (mgr.34457) 1711 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:42:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.561651+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.561761+0000 mgr.gibba009.xiladd (mgr.34457) 1712 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:42:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.795738+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.799677+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.800932+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.802099+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.803353+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.806096+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:17 gibba009 bash[26136]: audit 2021-03-10T20:42:16.807458+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.558763+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.558837+0000 mgr.gibba009.xiladd (mgr.34457) 1711 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:42:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.561651+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.561761+0000 mgr.gibba009.xiladd (mgr.34457) 1712 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:42:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.795738+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.799677+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:18.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.800932+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.802099+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.803353+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.806096+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[30897]: audit 2021-03-10T20:42:16.807458+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.558763+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.558837+0000 mgr.gibba009.xiladd (mgr.34457) 1711 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:42:18.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.561651+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.561761+0000 mgr.gibba009.xiladd (mgr.34457) 1712 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:42:18.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.795738+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:42:18.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.799677+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:18.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.800932+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.802099+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.803353+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.806096+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:17 gibba004 bash[31878]: audit 2021-03-10T20:42:16.807458+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.797927+0000 mgr.gibba009.xiladd (mgr.34457) 1713 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.799586+0000 mgr.gibba009.xiladd (mgr.34457) 1714 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.800670+0000 mgr.gibba009.xiladd (mgr.34457) 1715 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.800792+0000 mgr.gibba009.xiladd (mgr.34457) 1716 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.801929+0000 mgr.gibba009.xiladd (mgr.34457) 1717 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.801967+0000 mgr.gibba009.xiladd (mgr.34457) 1718 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.803180+0000 mgr.gibba009.xiladd (mgr.34457) 1719 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.804534+0000 mgr.gibba009.xiladd (mgr.34457) 1720 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.804589+0000 mgr.gibba009.xiladd (mgr.34457) 1721 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.805840+0000 mgr.gibba009.xiladd (mgr.34457) 1722 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.806210+0000 mgr.gibba009.xiladd (mgr.34457) 1723 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:18.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.807105+0000 mgr.gibba009.xiladd (mgr.34457) 1724 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:18.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.807205+0000 mgr.gibba009.xiladd (mgr.34457) 1725 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:18.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cephadm 2021-03-10T20:42:16.807359+0000 mgr.gibba009.xiladd (mgr.34457) 1726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:18.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:18 gibba009 bash[26136]: cluster 2021-03-10T20:42:17.393249+0000 mgr.gibba009.xiladd (mgr.34457) 1727 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.797927+0000 mgr.gibba009.xiladd (mgr.34457) 1713 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.799586+0000 mgr.gibba009.xiladd (mgr.34457) 1714 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.800670+0000 mgr.gibba009.xiladd (mgr.34457) 1715 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.800792+0000 mgr.gibba009.xiladd (mgr.34457) 1716 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.801929+0000 mgr.gibba009.xiladd (mgr.34457) 1717 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.801967+0000 mgr.gibba009.xiladd (mgr.34457) 1718 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.803180+0000 mgr.gibba009.xiladd (mgr.34457) 1719 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.804534+0000 mgr.gibba009.xiladd (mgr.34457) 1720 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.804589+0000 mgr.gibba009.xiladd (mgr.34457) 1721 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.805840+0000 mgr.gibba009.xiladd (mgr.34457) 1722 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.806210+0000 mgr.gibba009.xiladd (mgr.34457) 1723 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:19.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.807105+0000 mgr.gibba009.xiladd (mgr.34457) 1724 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:19.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.807205+0000 mgr.gibba009.xiladd (mgr.34457) 1725 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:19.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cephadm 2021-03-10T20:42:16.807359+0000 mgr.gibba009.xiladd (mgr.34457) 1726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:19.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[30897]: cluster 2021-03-10T20:42:17.393249+0000 mgr.gibba009.xiladd (mgr.34457) 1727 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.797927+0000 mgr.gibba009.xiladd (mgr.34457) 1713 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.799586+0000 mgr.gibba009.xiladd (mgr.34457) 1714 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.800670+0000 mgr.gibba009.xiladd (mgr.34457) 1715 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.800792+0000 mgr.gibba009.xiladd (mgr.34457) 1716 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.801929+0000 mgr.gibba009.xiladd (mgr.34457) 1717 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.801967+0000 mgr.gibba009.xiladd (mgr.34457) 1718 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.803180+0000 mgr.gibba009.xiladd (mgr.34457) 1719 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.804534+0000 mgr.gibba009.xiladd (mgr.34457) 1720 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.804589+0000 mgr.gibba009.xiladd (mgr.34457) 1721 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.805840+0000 mgr.gibba009.xiladd (mgr.34457) 1722 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.806210+0000 mgr.gibba009.xiladd (mgr.34457) 1723 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.807105+0000 mgr.gibba009.xiladd (mgr.34457) 1724 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.807205+0000 mgr.gibba009.xiladd (mgr.34457) 1725 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:19.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cephadm 2021-03-10T20:42:16.807359+0000 mgr.gibba009.xiladd (mgr.34457) 1726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:19.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:18 gibba004 bash[31878]: cluster 2021-03-10T20:42:17.393249+0000 mgr.gibba009.xiladd (mgr.34457) 1727 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:20 gibba004 bash[30897]: cluster 2021-03-10T20:42:19.394492+0000 mgr.gibba009.xiladd (mgr.34457) 1728 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:20 gibba004 bash[31878]: cluster 2021-03-10T20:42:19.394492+0000 mgr.gibba009.xiladd (mgr.34457) 1728 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:20 gibba009 bash[26136]: cluster 2021-03-10T20:42:19.394492+0000 mgr.gibba009.xiladd (mgr.34457) 1728 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:22 gibba004 bash[30897]: cluster 2021-03-10T20:42:21.396323+0000 mgr.gibba009.xiladd (mgr.34457) 1729 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:22 gibba004 bash[31878]: cluster 2021-03-10T20:42:21.396323+0000 mgr.gibba009.xiladd (mgr.34457) 1729 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:22 gibba009 bash[26136]: cluster 2021-03-10T20:42:21.396323+0000 mgr.gibba009.xiladd (mgr.34457) 1729 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:24 gibba004 bash[30897]: cluster 2021-03-10T20:42:23.397753+0000 mgr.gibba009.xiladd (mgr.34457) 1730 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:24 gibba004 bash[31878]: cluster 2021-03-10T20:42:23.397753+0000 mgr.gibba009.xiladd (mgr.34457) 1730 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:24 gibba009 bash[26136]: cluster 2021-03-10T20:42:23.397753+0000 mgr.gibba009.xiladd (mgr.34457) 1730 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:26 gibba004 bash[30897]: cluster 2021-03-10T20:42:25.399266+0000 mgr.gibba009.xiladd (mgr.34457) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:26 gibba004 bash[31878]: cluster 2021-03-10T20:42:25.399266+0000 mgr.gibba009.xiladd (mgr.34457) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:26 gibba009 bash[26136]: cluster 2021-03-10T20:42:25.399266+0000 mgr.gibba009.xiladd (mgr.34457) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:28 gibba004 bash[30897]: cluster 2021-03-10T20:42:27.400826+0000 mgr.gibba009.xiladd (mgr.34457) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:28 gibba004 bash[31878]: cluster 2021-03-10T20:42:27.400826+0000 mgr.gibba009.xiladd (mgr.34457) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:28 gibba009 bash[26136]: cluster 2021-03-10T20:42:27.400826+0000 mgr.gibba009.xiladd (mgr.34457) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:30 gibba004 bash[30897]: cluster 2021-03-10T20:42:29.402114+0000 mgr.gibba009.xiladd (mgr.34457) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:30 gibba004 bash[31878]: cluster 2021-03-10T20:42:29.402114+0000 mgr.gibba009.xiladd (mgr.34457) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:30 gibba009 bash[26136]: cluster 2021-03-10T20:42:29.402114+0000 mgr.gibba009.xiladd (mgr.34457) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:32 gibba004 bash[30897]: cluster 2021-03-10T20:42:31.403744+0000 mgr.gibba009.xiladd (mgr.34457) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:32 gibba004 bash[31878]: cluster 2021-03-10T20:42:31.403744+0000 mgr.gibba009.xiladd (mgr.34457) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:32 gibba009 bash[26136]: cluster 2021-03-10T20:42:31.403744+0000 mgr.gibba009.xiladd (mgr.34457) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:33.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:33 gibba004 bash[30897]: cephadm 2021-03-10T20:42:31.818103+0000 mgr.gibba009.xiladd (mgr.34457) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:33 gibba004 bash[31878]: cephadm 2021-03-10T20:42:31.818103+0000 mgr.gibba009.xiladd (mgr.34457) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:33 gibba009 bash[26136]: cephadm 2021-03-10T20:42:31.818103+0000 mgr.gibba009.xiladd (mgr.34457) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:34.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:34 gibba004 bash[30897]: cluster 2021-03-10T20:42:33.405306+0000 mgr.gibba009.xiladd (mgr.34457) 1736 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:34 gibba004 bash[31878]: cluster 2021-03-10T20:42:33.405306+0000 mgr.gibba009.xiladd (mgr.34457) 1736 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:34 gibba009 bash[26136]: cluster 2021-03-10T20:42:33.405306+0000 mgr.gibba009.xiladd (mgr.34457) 1736 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:36.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:36 gibba004 bash[30897]: cluster 2021-03-10T20:42:35.407036+0000 mgr.gibba009.xiladd (mgr.34457) 1737 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:36.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:36 gibba004 bash[31878]: cluster 2021-03-10T20:42:35.407036+0000 mgr.gibba009.xiladd (mgr.34457) 1737 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:36.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:36 gibba009 bash[26136]: cluster 2021-03-10T20:42:35.407036+0000 mgr.gibba009.xiladd (mgr.34457) 1737 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:38 gibba004 bash[30897]: cluster 2021-03-10T20:42:37.408717+0000 mgr.gibba009.xiladd (mgr.34457) 1738 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:38 gibba004 bash[31878]: cluster 2021-03-10T20:42:37.408717+0000 mgr.gibba009.xiladd (mgr.34457) 1738 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:38 gibba009 bash[26136]: cluster 2021-03-10T20:42:37.408717+0000 mgr.gibba009.xiladd (mgr.34457) 1738 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:39.685 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:42:39.916 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:42:39.917 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:42:39.917 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (36m) 6m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:42:39.917 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:42:39.918 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:42:39.918 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:42:39.918 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:42:39.919 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:42:39.919 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:42:39.919 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:42:39.920 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:42:39.920 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:42:39.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:42:39.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:42:39.921 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:42:39.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:42:39.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:42:39.922 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:42:39.923 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (26m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:42:39.923 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:42:39.924 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:39.924 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:40.165 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:42:40.165 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:42:40.166 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:40.166 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:40.166 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:42:40.166 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:40.167 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:40.167 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:42:40.167 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:42:40.167 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:42:40.168 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:42:40.168 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:42:40.168 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:42:40.168 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:42:40.168 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:42:40.353 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: cluster 2021-03-10T20:42:39.410003+0000 mgr.gibba009.xiladd (mgr.34457) 1739 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.353 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.768214+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.354 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.768518+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.354 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.771458+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.354 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.771724+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.354 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779066+0000 mon.c (mon.1) 546 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.355 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779259+0000 mon.c (mon.1) 547 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.355 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779431+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.355 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779462+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.355 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779579+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.356 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779709+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.356 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.779866+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.356 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:39.780051+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.356 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[30897]: audit 2021-03-10T20:42:40.165256+0000 mon.c (mon.1) 550 : audit [DBG] from='client.? 172.21.2.104:0/2481333093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:40.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: cluster 2021-03-10T20:42:39.410003+0000 mgr.gibba009.xiladd (mgr.34457) 1739 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.768214+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.768518+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.771458+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.771724+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779066+0000 mon.c (mon.1) 546 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779259+0000 mon.c (mon.1) 547 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779431+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779462+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779579+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779709+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.779866+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:39.780051+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:40 gibba004 bash[31878]: audit 2021-03-10T20:42:40.165256+0000 mon.c (mon.1) 550 : audit [DBG] from='client.? 172.21.2.104:0/2481333093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: cluster 2021-03-10T20:42:39.410003+0000 mgr.gibba009.xiladd (mgr.34457) 1739 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.768214+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.768518+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.771458+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.771724+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779066+0000 mon.c (mon.1) 546 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779259+0000 mon.c (mon.1) 547 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779431+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779462+0000 mon.c (mon.1) 548 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779579+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:42:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779709+0000 mon.c (mon.1) 549 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.779866+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:39.780051+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:42:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:40 gibba009 bash[26136]: audit 2021-03-10T20:42:40.165256+0000 mon.c (mon.1) 550 : audit [DBG] from='client.? 172.21.2.104:0/2481333093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:41.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:41 gibba004 bash[30897]: audit 2021-03-10T20:42:39.675339+0000 mgr.gibba009.xiladd (mgr.34457) 1740 : audit [DBG] from='client.55207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:41 gibba004 bash[30897]: audit 2021-03-10T20:42:39.902281+0000 mgr.gibba009.xiladd (mgr.34457) 1741 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:41 gibba004 bash[31878]: audit 2021-03-10T20:42:39.675339+0000 mgr.gibba009.xiladd (mgr.34457) 1740 : audit [DBG] from='client.55207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:41 gibba004 bash[31878]: audit 2021-03-10T20:42:39.902281+0000 mgr.gibba009.xiladd (mgr.34457) 1741 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:41 gibba009 bash[26136]: audit 2021-03-10T20:42:39.675339+0000 mgr.gibba009.xiladd (mgr.34457) 1740 : audit [DBG] from='client.55207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:41 gibba009 bash[26136]: audit 2021-03-10T20:42:39.902281+0000 mgr.gibba009.xiladd (mgr.34457) 1741 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:42 gibba004 bash[30897]: cluster 2021-03-10T20:42:41.411055+0000 mgr.gibba009.xiladd (mgr.34457) 1742 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:42.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:42 gibba004 bash[31878]: cluster 2021-03-10T20:42:41.411055+0000 mgr.gibba009.xiladd (mgr.34457) 1742 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:42 gibba009 bash[26136]: cluster 2021-03-10T20:42:41.411055+0000 mgr.gibba009.xiladd (mgr.34457) 1742 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:44 gibba004 bash[30897]: cluster 2021-03-10T20:42:43.412220+0000 mgr.gibba009.xiladd (mgr.34457) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:44 gibba004 bash[31878]: cluster 2021-03-10T20:42:43.412220+0000 mgr.gibba009.xiladd (mgr.34457) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:44 gibba009 bash[26136]: cluster 2021-03-10T20:42:43.412220+0000 mgr.gibba009.xiladd (mgr.34457) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:46 gibba004 bash[30897]: cluster 2021-03-10T20:42:45.414030+0000 mgr.gibba009.xiladd (mgr.34457) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:46 gibba004 bash[31878]: cluster 2021-03-10T20:42:45.414030+0000 mgr.gibba009.xiladd (mgr.34457) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.835 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:46 gibba009 bash[26136]: cluster 2021-03-10T20:42:45.414030+0000 mgr.gibba009.xiladd (mgr.34457) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:48 gibba004 bash[30897]: cephadm 2021-03-10T20:42:46.833908+0000 mgr.gibba009.xiladd (mgr.34457) 1745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:48 gibba004 bash[30897]: cluster 2021-03-10T20:42:47.415658+0000 mgr.gibba009.xiladd (mgr.34457) 1746 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:48 gibba004 bash[31878]: cephadm 2021-03-10T20:42:46.833908+0000 mgr.gibba009.xiladd (mgr.34457) 1745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:48 gibba004 bash[31878]: cluster 2021-03-10T20:42:47.415658+0000 mgr.gibba009.xiladd (mgr.34457) 1746 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:48 gibba009 bash[26136]: cephadm 2021-03-10T20:42:46.833908+0000 mgr.gibba009.xiladd (mgr.34457) 1745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:42:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:48 gibba009 bash[26136]: cluster 2021-03-10T20:42:47.415658+0000 mgr.gibba009.xiladd (mgr.34457) 1746 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:50 gibba004 bash[30897]: cluster 2021-03-10T20:42:49.416946+0000 mgr.gibba009.xiladd (mgr.34457) 1747 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:50 gibba004 bash[31878]: cluster 2021-03-10T20:42:49.416946+0000 mgr.gibba009.xiladd (mgr.34457) 1747 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:50 gibba009 bash[26136]: cluster 2021-03-10T20:42:49.416946+0000 mgr.gibba009.xiladd (mgr.34457) 1747 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:52 gibba004 bash[30897]: cluster 2021-03-10T20:42:51.418852+0000 mgr.gibba009.xiladd (mgr.34457) 1748 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:52 gibba004 bash[31878]: cluster 2021-03-10T20:42:51.418852+0000 mgr.gibba009.xiladd (mgr.34457) 1748 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:52 gibba009 bash[26136]: cluster 2021-03-10T20:42:51.418852+0000 mgr.gibba009.xiladd (mgr.34457) 1748 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:54 gibba004 bash[30897]: cluster 2021-03-10T20:42:53.420275+0000 mgr.gibba009.xiladd (mgr.34457) 1749 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:54 gibba004 bash[31878]: cluster 2021-03-10T20:42:53.420275+0000 mgr.gibba009.xiladd (mgr.34457) 1749 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:54 gibba009 bash[26136]: cluster 2021-03-10T20:42:53.420275+0000 mgr.gibba009.xiladd (mgr.34457) 1749 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:56 gibba004 bash[30897]: cluster 2021-03-10T20:42:55.422057+0000 mgr.gibba009.xiladd (mgr.34457) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:56 gibba004 bash[31878]: cluster 2021-03-10T20:42:55.422057+0000 mgr.gibba009.xiladd (mgr.34457) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:56 gibba009 bash[26136]: cluster 2021-03-10T20:42:55.422057+0000 mgr.gibba009.xiladd (mgr.34457) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:42:58 gibba004 bash[30897]: cluster 2021-03-10T20:42:57.423456+0000 mgr.gibba009.xiladd (mgr.34457) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:42:58 gibba004 bash[31878]: cluster 2021-03-10T20:42:57.423456+0000 mgr.gibba009.xiladd (mgr.34457) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:42:58 gibba009 bash[26136]: cluster 2021-03-10T20:42:57.423456+0000 mgr.gibba009.xiladd (mgr.34457) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:00 gibba004 bash[30897]: cluster 2021-03-10T20:42:59.424739+0000 mgr.gibba009.xiladd (mgr.34457) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:00 gibba004 bash[31878]: cluster 2021-03-10T20:42:59.424739+0000 mgr.gibba009.xiladd (mgr.34457) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:00 gibba009 bash[26136]: cluster 2021-03-10T20:42:59.424739+0000 mgr.gibba009.xiladd (mgr.34457) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:02 gibba004 bash[30897]: cluster 2021-03-10T20:43:01.426315+0000 mgr.gibba009.xiladd (mgr.34457) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:02 gibba004 bash[31878]: cluster 2021-03-10T20:43:01.426315+0000 mgr.gibba009.xiladd (mgr.34457) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:02 gibba009 bash[26136]: cluster 2021-03-10T20:43:01.426315+0000 mgr.gibba009.xiladd (mgr.34457) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:03 gibba004 bash[30897]: cephadm 2021-03-10T20:43:01.849697+0000 mgr.gibba009.xiladd (mgr.34457) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:03.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:03 gibba004 bash[31878]: cephadm 2021-03-10T20:43:01.849697+0000 mgr.gibba009.xiladd (mgr.34457) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:03.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:03 gibba009 bash[26136]: cephadm 2021-03-10T20:43:01.849697+0000 mgr.gibba009.xiladd (mgr.34457) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:04.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:04 gibba004 bash[30897]: cluster 2021-03-10T20:43:03.427842+0000 mgr.gibba009.xiladd (mgr.34457) 1755 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:04.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:04 gibba004 bash[31878]: cluster 2021-03-10T20:43:03.427842+0000 mgr.gibba009.xiladd (mgr.34457) 1755 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:04 gibba009 bash[26136]: cluster 2021-03-10T20:43:03.427842+0000 mgr.gibba009.xiladd (mgr.34457) 1755 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:06.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:06 gibba004 bash[30897]: cluster 2021-03-10T20:43:05.429526+0000 mgr.gibba009.xiladd (mgr.34457) 1756 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:06.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:06 gibba004 bash[31878]: cluster 2021-03-10T20:43:05.429526+0000 mgr.gibba009.xiladd (mgr.34457) 1756 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:06.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:06 gibba009 bash[26136]: cluster 2021-03-10T20:43:05.429526+0000 mgr.gibba009.xiladd (mgr.34457) 1756 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:08 gibba004 bash[30897]: cluster 2021-03-10T20:43:07.431149+0000 mgr.gibba009.xiladd (mgr.34457) 1757 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:08 gibba004 bash[31878]: cluster 2021-03-10T20:43:07.431149+0000 mgr.gibba009.xiladd (mgr.34457) 1757 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:08 gibba009 bash[26136]: cluster 2021-03-10T20:43:07.431149+0000 mgr.gibba009.xiladd (mgr.34457) 1757 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.406 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:43:10.630 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:43:10.630 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (32m) 8m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:43:10.631 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:43:10.631 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (32m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:43:10.631 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (32m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:43:10.631 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:43:10.631 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:43:10.632 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:43:10.632 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:43:10.632 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (37m) 8m ago 37m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:43:10.632 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:43:10.633 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:43:10.633 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:43:10.633 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:43:10.633 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:43:10.633 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:43:10.634 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:43:10.634 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:43:10.634 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:43:10.634 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (37m) 7m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:43:10.635 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:10.635 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:10 gibba004 bash[30897]: cluster 2021-03-10T20:43:09.432427+0000 mgr.gibba009.xiladd (mgr.34457) 1758 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.812 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:10 gibba004 bash[31878]: cluster 2021-03-10T20:43:09.432427+0000 mgr.gibba009.xiladd (mgr.34457) 1758 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:10 gibba009 bash[26136]: cluster 2021-03-10T20:43:09.432427+0000 mgr.gibba009.xiladd (mgr.34457) 1758 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.877 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:43:10.878 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:43:10.878 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:10.878 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:10.879 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:43:10.879 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:10.879 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:10.879 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:43:10.879 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:43:10.880 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:10.880 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:43:10.880 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:43:10.881 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:43:10.881 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:43:10.881 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:43:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[30897]: audit 2021-03-10T20:43:10.396962+0000 mgr.gibba009.xiladd (mgr.34457) 1759 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[30897]: audit 2021-03-10T20:43:10.618055+0000 mgr.gibba009.xiladd (mgr.34457) 1760 : audit [DBG] from='client.45252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[30897]: audit 2021-03-10T20:43:10.877444+0000 mon.a (mon.0) 815 : audit [DBG] from='client.? 172.21.2.104:0/2661500187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[31878]: audit 2021-03-10T20:43:10.396962+0000 mgr.gibba009.xiladd (mgr.34457) 1759 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[31878]: audit 2021-03-10T20:43:10.618055+0000 mgr.gibba009.xiladd (mgr.34457) 1760 : audit [DBG] from='client.45252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:11 gibba004 bash[31878]: audit 2021-03-10T20:43:10.877444+0000 mon.a (mon.0) 815 : audit [DBG] from='client.? 172.21.2.104:0/2661500187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:11 gibba009 bash[26136]: audit 2021-03-10T20:43:10.396962+0000 mgr.gibba009.xiladd (mgr.34457) 1759 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:11 gibba009 bash[26136]: audit 2021-03-10T20:43:10.618055+0000 mgr.gibba009.xiladd (mgr.34457) 1760 : audit [DBG] from='client.45252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:11 gibba009 bash[26136]: audit 2021-03-10T20:43:10.877444+0000 mon.a (mon.0) 815 : audit [DBG] from='client.? 172.21.2.104:0/2661500187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:12.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:12 gibba004 bash[30897]: cluster 2021-03-10T20:43:11.433455+0000 mgr.gibba009.xiladd (mgr.34457) 1761 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:12 gibba004 bash[31878]: cluster 2021-03-10T20:43:11.433455+0000 mgr.gibba009.xiladd (mgr.34457) 1761 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:12 gibba009 bash[26136]: cluster 2021-03-10T20:43:11.433455+0000 mgr.gibba009.xiladd (mgr.34457) 1761 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:14.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:14 gibba004 bash[30897]: cluster 2021-03-10T20:43:13.434785+0000 mgr.gibba009.xiladd (mgr.34457) 1762 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:14.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:14 gibba004 bash[31878]: cluster 2021-03-10T20:43:13.434785+0000 mgr.gibba009.xiladd (mgr.34457) 1762 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:14.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:14 gibba009 bash[26136]: cluster 2021-03-10T20:43:13.434785+0000 mgr.gibba009.xiladd (mgr.34457) 1762 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:16 gibba004 bash[30897]: cluster 2021-03-10T20:43:15.436300+0000 mgr.gibba009.xiladd (mgr.34457) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:16 gibba004 bash[31878]: cluster 2021-03-10T20:43:15.436300+0000 mgr.gibba009.xiladd (mgr.34457) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:16 gibba009 bash[26136]: cluster 2021-03-10T20:43:15.436300+0000 mgr.gibba009.xiladd (mgr.34457) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:16.867281+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.097330+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:43:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.100911+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.102251+0000 mon.c (mon.1) 553 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.103656+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.105876+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.112451+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[30897]: audit 2021-03-10T20:43:17.115244+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:16.867281+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.097330+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:43:17.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.100911+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.102251+0000 mon.c (mon.1) 553 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.103656+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.105876+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.112451+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:17 gibba004 bash[31878]: audit 2021-03-10T20:43:17.115244+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:16.867281+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.097330+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:43:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.100911+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.102251+0000 mon.c (mon.1) 553 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.103656+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.105876+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.112451+0000 mon.c (mon.1) 556 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:17 gibba009 bash[26136]: audit 2021-03-10T20:43:17.115244+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:18.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:16.871590+0000 mgr.gibba009.xiladd (mgr.34457) 1764 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:43:18.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:16.873188+0000 mgr.gibba009.xiladd (mgr.34457) 1765 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:43:18.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.099260+0000 mgr.gibba009.xiladd (mgr.34457) 1766 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:18.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.100810+0000 mgr.gibba009.xiladd (mgr.34457) 1767 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:18.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.102068+0000 mgr.gibba009.xiladd (mgr.34457) 1768 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:18.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.102106+0000 mgr.gibba009.xiladd (mgr.34457) 1769 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:18.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.104285+0000 mgr.gibba009.xiladd (mgr.34457) 1770 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:18.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.104324+0000 mgr.gibba009.xiladd (mgr.34457) 1771 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:18.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.106937+0000 mgr.gibba009.xiladd (mgr.34457) 1772 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:18.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.110630+0000 mgr.gibba009.xiladd (mgr.34457) 1773 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:18.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.110665+0000 mgr.gibba009.xiladd (mgr.34457) 1774 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:18.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.113341+0000 mgr.gibba009.xiladd (mgr.34457) 1775 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:18.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.113657+0000 mgr.gibba009.xiladd (mgr.34457) 1776 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:18.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.116221+0000 mgr.gibba009.xiladd (mgr.34457) 1777 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:18.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.116260+0000 mgr.gibba009.xiladd (mgr.34457) 1778 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:18.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cephadm 2021-03-10T20:43:17.116466+0000 mgr.gibba009.xiladd (mgr.34457) 1779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:18.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[30897]: cluster 2021-03-10T20:43:17.437772+0000 mgr.gibba009.xiladd (mgr.34457) 1780 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:18.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:16.871590+0000 mgr.gibba009.xiladd (mgr.34457) 1764 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:43:18.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:16.873188+0000 mgr.gibba009.xiladd (mgr.34457) 1765 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:43:18.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.099260+0000 mgr.gibba009.xiladd (mgr.34457) 1766 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:18.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.100810+0000 mgr.gibba009.xiladd (mgr.34457) 1767 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:18.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.102068+0000 mgr.gibba009.xiladd (mgr.34457) 1768 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:18.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.102106+0000 mgr.gibba009.xiladd (mgr.34457) 1769 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:18.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.104285+0000 mgr.gibba009.xiladd (mgr.34457) 1770 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:18.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.104324+0000 mgr.gibba009.xiladd (mgr.34457) 1771 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:18.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.106937+0000 mgr.gibba009.xiladd (mgr.34457) 1772 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:18.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.110630+0000 mgr.gibba009.xiladd (mgr.34457) 1773 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:18.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.110665+0000 mgr.gibba009.xiladd (mgr.34457) 1774 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:18.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.113341+0000 mgr.gibba009.xiladd (mgr.34457) 1775 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:18.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.113657+0000 mgr.gibba009.xiladd (mgr.34457) 1776 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:18.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.116221+0000 mgr.gibba009.xiladd (mgr.34457) 1777 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:18.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.116260+0000 mgr.gibba009.xiladd (mgr.34457) 1778 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:18.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cephadm 2021-03-10T20:43:17.116466+0000 mgr.gibba009.xiladd (mgr.34457) 1779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:18.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:18 gibba004 bash[31878]: cluster 2021-03-10T20:43:17.437772+0000 mgr.gibba009.xiladd (mgr.34457) 1780 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:16.871590+0000 mgr.gibba009.xiladd (mgr.34457) 1764 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:43:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:16.873188+0000 mgr.gibba009.xiladd (mgr.34457) 1765 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:43:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.099260+0000 mgr.gibba009.xiladd (mgr.34457) 1766 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.100810+0000 mgr.gibba009.xiladd (mgr.34457) 1767 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.102068+0000 mgr.gibba009.xiladd (mgr.34457) 1768 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.102106+0000 mgr.gibba009.xiladd (mgr.34457) 1769 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.104285+0000 mgr.gibba009.xiladd (mgr.34457) 1770 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.104324+0000 mgr.gibba009.xiladd (mgr.34457) 1771 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.106937+0000 mgr.gibba009.xiladd (mgr.34457) 1772 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.110630+0000 mgr.gibba009.xiladd (mgr.34457) 1773 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.110665+0000 mgr.gibba009.xiladd (mgr.34457) 1774 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.113341+0000 mgr.gibba009.xiladd (mgr.34457) 1775 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.113657+0000 mgr.gibba009.xiladd (mgr.34457) 1776 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.116221+0000 mgr.gibba009.xiladd (mgr.34457) 1777 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.116260+0000 mgr.gibba009.xiladd (mgr.34457) 1778 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cephadm 2021-03-10T20:43:17.116466+0000 mgr.gibba009.xiladd (mgr.34457) 1779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:18 gibba009 bash[26136]: cluster 2021-03-10T20:43:17.437772+0000 mgr.gibba009.xiladd (mgr.34457) 1780 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:20 gibba004 bash[30897]: cluster 2021-03-10T20:43:19.439077+0000 mgr.gibba009.xiladd (mgr.34457) 1781 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:20 gibba004 bash[31878]: cluster 2021-03-10T20:43:19.439077+0000 mgr.gibba009.xiladd (mgr.34457) 1781 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:20 gibba009 bash[26136]: cluster 2021-03-10T20:43:19.439077+0000 mgr.gibba009.xiladd (mgr.34457) 1781 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:22 gibba004 bash[30897]: cluster 2021-03-10T20:43:21.440964+0000 mgr.gibba009.xiladd (mgr.34457) 1782 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:22 gibba004 bash[31878]: cluster 2021-03-10T20:43:21.440964+0000 mgr.gibba009.xiladd (mgr.34457) 1782 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:22 gibba009 bash[26136]: cluster 2021-03-10T20:43:21.440964+0000 mgr.gibba009.xiladd (mgr.34457) 1782 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:24 gibba004 bash[30897]: cluster 2021-03-10T20:43:23.442594+0000 mgr.gibba009.xiladd (mgr.34457) 1783 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:24 gibba004 bash[31878]: cluster 2021-03-10T20:43:23.442594+0000 mgr.gibba009.xiladd (mgr.34457) 1783 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:24 gibba009 bash[26136]: cluster 2021-03-10T20:43:23.442594+0000 mgr.gibba009.xiladd (mgr.34457) 1783 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:26.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:26 gibba004 bash[30897]: cluster 2021-03-10T20:43:25.444122+0000 mgr.gibba009.xiladd (mgr.34457) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:27.301 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:26 gibba004 bash[31878]: cluster 2021-03-10T20:43:25.444122+0000 mgr.gibba009.xiladd (mgr.34457) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:27.302 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:26 gibba009 bash[26136]: cluster 2021-03-10T20:43:25.444122+0000 mgr.gibba009.xiladd (mgr.34457) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:28 gibba004 bash[30897]: cluster 2021-03-10T20:43:27.445688+0000 mgr.gibba009.xiladd (mgr.34457) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:28 gibba004 bash[31878]: cluster 2021-03-10T20:43:27.445688+0000 mgr.gibba009.xiladd (mgr.34457) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:28 gibba009 bash[26136]: cluster 2021-03-10T20:43:27.445688+0000 mgr.gibba009.xiladd (mgr.34457) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:30 gibba004 bash[30897]: cluster 2021-03-10T20:43:29.447006+0000 mgr.gibba009.xiladd (mgr.34457) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:30 gibba004 bash[31878]: cluster 2021-03-10T20:43:29.447006+0000 mgr.gibba009.xiladd (mgr.34457) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:30 gibba009 bash[26136]: cluster 2021-03-10T20:43:29.447006+0000 mgr.gibba009.xiladd (mgr.34457) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:32 gibba004 bash[30897]: cluster 2021-03-10T20:43:31.448804+0000 mgr.gibba009.xiladd (mgr.34457) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:32 gibba004 bash[31878]: cluster 2021-03-10T20:43:31.448804+0000 mgr.gibba009.xiladd (mgr.34457) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:32 gibba009 bash[26136]: cluster 2021-03-10T20:43:31.448804+0000 mgr.gibba009.xiladd (mgr.34457) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:33.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:33 gibba004 bash[30897]: cephadm 2021-03-10T20:43:32.121392+0000 mgr.gibba009.xiladd (mgr.34457) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:33.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:33 gibba004 bash[31878]: cephadm 2021-03-10T20:43:32.121392+0000 mgr.gibba009.xiladd (mgr.34457) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:33 gibba009 bash[26136]: cephadm 2021-03-10T20:43:32.121392+0000 mgr.gibba009.xiladd (mgr.34457) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:34.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:34 gibba004 bash[30897]: cluster 2021-03-10T20:43:33.450527+0000 mgr.gibba009.xiladd (mgr.34457) 1789 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:34.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:34 gibba004 bash[31878]: cluster 2021-03-10T20:43:33.450527+0000 mgr.gibba009.xiladd (mgr.34457) 1789 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:34.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:34 gibba009 bash[26136]: cluster 2021-03-10T20:43:33.450527+0000 mgr.gibba009.xiladd (mgr.34457) 1789 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:36 gibba004 bash[30897]: cluster 2021-03-10T20:43:35.452054+0000 mgr.gibba009.xiladd (mgr.34457) 1790 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:36 gibba004 bash[31878]: cluster 2021-03-10T20:43:35.452054+0000 mgr.gibba009.xiladd (mgr.34457) 1790 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:36 gibba009 bash[26136]: cluster 2021-03-10T20:43:35.452054+0000 mgr.gibba009.xiladd (mgr.34457) 1790 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:38.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:38 gibba004 bash[30897]: cluster 2021-03-10T20:43:37.453519+0000 mgr.gibba009.xiladd (mgr.34457) 1791 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:38.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:38 gibba004 bash[31878]: cluster 2021-03-10T20:43:37.453519+0000 mgr.gibba009.xiladd (mgr.34457) 1791 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:38.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:38 gibba009 bash[26136]: cluster 2021-03-10T20:43:37.453519+0000 mgr.gibba009.xiladd (mgr.34457) 1791 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: cluster 2021-03-10T20:43:39.454765+0000 mgr.gibba009.xiladd (mgr.34457) 1792 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.776133+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.776754+0000 mon.c (mon.1) 559 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.777383+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.779191+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.782782+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.783503+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.783924+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.784213+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.784885+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.786058+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.787616+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[30897]: audit 2021-03-10T20:43:39.788839+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: cluster 2021-03-10T20:43:39.454765+0000 mgr.gibba009.xiladd (mgr.34457) 1792 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.776133+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.776754+0000 mon.c (mon.1) 559 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.777383+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.779191+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.782782+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.783503+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.783924+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.784213+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.784885+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.786058+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.787616+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:40 gibba004 bash[31878]: audit 2021-03-10T20:43:39.788839+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: cluster 2021-03-10T20:43:39.454765+0000 mgr.gibba009.xiladd (mgr.34457) 1792 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.776133+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.776754+0000 mon.c (mon.1) 559 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.777383+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.779191+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.782782+0000 mon.c (mon.1) 560 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.783503+0000 mon.c (mon.1) 561 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.783924+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:43:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.784213+0000 mon.c (mon.1) 562 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.784885+0000 mon.c (mon.1) 563 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.786058+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.787616+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:43:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:40 gibba009 bash[26136]: audit 2021-03-10T20:43:39.788839+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:43:41.123 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:43:41.350 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:43:41.351 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (32m) 8m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:43:41.351 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:43:41.351 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:43:41.351 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:43:41.352 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:43:41.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:43:41.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:43:41.352 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:43:41.353 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:43:41.353 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:43:41.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:43:41.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:43:41.353 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:43:41.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:43:41.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:43:41.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:43:41.354 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:43:41.355 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:43:41.355 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (37m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:43:41.355 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:41.355 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:41.597 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:43:41.597 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:43:41.598 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:41.598 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:41.598 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:43:41.598 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:41.599 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:41.599 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:43:41.599 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:43:41.599 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:43:41.600 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:43:41.600 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:43:41.600 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:43:41.600 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:43:41.600 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:43:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[30897]: audit 2021-03-10T20:43:41.113373+0000 mgr.gibba009.xiladd (mgr.34457) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[30897]: audit 2021-03-10T20:43:41.336788+0000 mgr.gibba009.xiladd (mgr.34457) 1794 : audit [DBG] from='client.45270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[30897]: cluster 2021-03-10T20:43:41.456632+0000 mgr.gibba009.xiladd (mgr.34457) 1795 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[30897]: audit 2021-03-10T20:43:41.597353+0000 mon.c (mon.1) 564 : audit [DBG] from='client.? 172.21.2.104:0/1300180427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:42.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[31878]: audit 2021-03-10T20:43:41.113373+0000 mgr.gibba009.xiladd (mgr.34457) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[31878]: audit 2021-03-10T20:43:41.336788+0000 mgr.gibba009.xiladd (mgr.34457) 1794 : audit [DBG] from='client.45270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[31878]: cluster 2021-03-10T20:43:41.456632+0000 mgr.gibba009.xiladd (mgr.34457) 1795 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:42 gibba004 bash[31878]: audit 2021-03-10T20:43:41.597353+0000 mon.c (mon.1) 564 : audit [DBG] from='client.? 172.21.2.104:0/1300180427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:42.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:42 gibba009 bash[26136]: audit 2021-03-10T20:43:41.113373+0000 mgr.gibba009.xiladd (mgr.34457) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:42 gibba009 bash[26136]: audit 2021-03-10T20:43:41.336788+0000 mgr.gibba009.xiladd (mgr.34457) 1794 : audit [DBG] from='client.45270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:42 gibba009 bash[26136]: cluster 2021-03-10T20:43:41.456632+0000 mgr.gibba009.xiladd (mgr.34457) 1795 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:42 gibba009 bash[26136]: audit 2021-03-10T20:43:41.597353+0000 mon.c (mon.1) 564 : audit [DBG] from='client.? 172.21.2.104:0/1300180427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:44.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:44 gibba004 bash[30897]: cluster 2021-03-10T20:43:43.458116+0000 mgr.gibba009.xiladd (mgr.34457) 1796 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:45.272 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:44 gibba004 bash[31878]: cluster 2021-03-10T20:43:43.458116+0000 mgr.gibba009.xiladd (mgr.34457) 1796 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:45.272 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:44 gibba009 bash[26136]: cluster 2021-03-10T20:43:43.458116+0000 mgr.gibba009.xiladd (mgr.34457) 1796 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:46 gibba004 bash[30897]: cluster 2021-03-10T20:43:45.459765+0000 mgr.gibba009.xiladd (mgr.34457) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:46 gibba004 bash[31878]: cluster 2021-03-10T20:43:45.459765+0000 mgr.gibba009.xiladd (mgr.34457) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:46 gibba009 bash[26136]: cluster 2021-03-10T20:43:45.459765+0000 mgr.gibba009.xiladd (mgr.34457) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:48 gibba004 bash[30897]: cephadm 2021-03-10T20:43:47.137498+0000 mgr.gibba009.xiladd (mgr.34457) 1798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:48.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:48 gibba004 bash[30897]: cluster 2021-03-10T20:43:47.461328+0000 mgr.gibba009.xiladd (mgr.34457) 1799 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:48 gibba004 bash[31878]: cephadm 2021-03-10T20:43:47.137498+0000 mgr.gibba009.xiladd (mgr.34457) 1798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:48.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:48 gibba004 bash[31878]: cluster 2021-03-10T20:43:47.461328+0000 mgr.gibba009.xiladd (mgr.34457) 1799 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:48 gibba009 bash[26136]: cephadm 2021-03-10T20:43:47.137498+0000 mgr.gibba009.xiladd (mgr.34457) 1798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:43:48.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:48 gibba009 bash[26136]: cluster 2021-03-10T20:43:47.461328+0000 mgr.gibba009.xiladd (mgr.34457) 1799 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:50 gibba004 bash[30897]: cluster 2021-03-10T20:43:49.462751+0000 mgr.gibba009.xiladd (mgr.34457) 1800 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:50 gibba004 bash[31878]: cluster 2021-03-10T20:43:49.462751+0000 mgr.gibba009.xiladd (mgr.34457) 1800 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:50 gibba009 bash[26136]: cluster 2021-03-10T20:43:49.462751+0000 mgr.gibba009.xiladd (mgr.34457) 1800 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:52 gibba004 bash[30897]: cluster 2021-03-10T20:43:51.464529+0000 mgr.gibba009.xiladd (mgr.34457) 1801 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:52 gibba004 bash[31878]: cluster 2021-03-10T20:43:51.464529+0000 mgr.gibba009.xiladd (mgr.34457) 1801 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:52 gibba009 bash[26136]: cluster 2021-03-10T20:43:51.464529+0000 mgr.gibba009.xiladd (mgr.34457) 1801 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:54 gibba004 bash[30897]: cluster 2021-03-10T20:43:53.465979+0000 mgr.gibba009.xiladd (mgr.34457) 1802 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:54 gibba004 bash[31878]: cluster 2021-03-10T20:43:53.465979+0000 mgr.gibba009.xiladd (mgr.34457) 1802 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:54 gibba009 bash[26136]: cluster 2021-03-10T20:43:53.465979+0000 mgr.gibba009.xiladd (mgr.34457) 1802 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:56 gibba004 bash[30897]: cluster 2021-03-10T20:43:55.467620+0000 mgr.gibba009.xiladd (mgr.34457) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:56 gibba004 bash[31878]: cluster 2021-03-10T20:43:55.467620+0000 mgr.gibba009.xiladd (mgr.34457) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:56 gibba009 bash[26136]: cluster 2021-03-10T20:43:55.467620+0000 mgr.gibba009.xiladd (mgr.34457) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:43:58 gibba004 bash[30897]: cluster 2021-03-10T20:43:57.469291+0000 mgr.gibba009.xiladd (mgr.34457) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:43:58 gibba004 bash[31878]: cluster 2021-03-10T20:43:57.469291+0000 mgr.gibba009.xiladd (mgr.34457) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:43:58 gibba009 bash[26136]: cluster 2021-03-10T20:43:57.469291+0000 mgr.gibba009.xiladd (mgr.34457) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:00 gibba004 bash[30897]: cluster 2021-03-10T20:43:59.470553+0000 mgr.gibba009.xiladd (mgr.34457) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:00 gibba004 bash[31878]: cluster 2021-03-10T20:43:59.470553+0000 mgr.gibba009.xiladd (mgr.34457) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:00 gibba009 bash[26136]: cluster 2021-03-10T20:43:59.470553+0000 mgr.gibba009.xiladd (mgr.34457) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:02 gibba004 bash[30897]: cluster 2021-03-10T20:44:01.472315+0000 mgr.gibba009.xiladd (mgr.34457) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:02 gibba004 bash[31878]: cluster 2021-03-10T20:44:01.472315+0000 mgr.gibba009.xiladd (mgr.34457) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:02 gibba009 bash[26136]: cluster 2021-03-10T20:44:01.472315+0000 mgr.gibba009.xiladd (mgr.34457) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:03.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:03 gibba004 bash[30897]: cephadm 2021-03-10T20:44:02.153561+0000 mgr.gibba009.xiladd (mgr.34457) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:03.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:03 gibba004 bash[31878]: cephadm 2021-03-10T20:44:02.153561+0000 mgr.gibba009.xiladd (mgr.34457) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:03.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:03 gibba009 bash[26136]: cephadm 2021-03-10T20:44:02.153561+0000 mgr.gibba009.xiladd (mgr.34457) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:04.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:04 gibba004 bash[30897]: cluster 2021-03-10T20:44:03.474007+0000 mgr.gibba009.xiladd (mgr.34457) 1808 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:04.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:04 gibba004 bash[31878]: cluster 2021-03-10T20:44:03.474007+0000 mgr.gibba009.xiladd (mgr.34457) 1808 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:04.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:04 gibba009 bash[26136]: cluster 2021-03-10T20:44:03.474007+0000 mgr.gibba009.xiladd (mgr.34457) 1808 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:06 gibba004 bash[30897]: cluster 2021-03-10T20:44:05.475638+0000 mgr.gibba009.xiladd (mgr.34457) 1809 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:06 gibba004 bash[31878]: cluster 2021-03-10T20:44:05.475638+0000 mgr.gibba009.xiladd (mgr.34457) 1809 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:06 gibba009 bash[26136]: cluster 2021-03-10T20:44:05.475638+0000 mgr.gibba009.xiladd (mgr.34457) 1809 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:08.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:08 gibba009 bash[26136]: cluster 2021-03-10T20:44:07.477451+0000 mgr.gibba009.xiladd (mgr.34457) 1810 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:09.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:08 gibba004 bash[30897]: cluster 2021-03-10T20:44:07.477451+0000 mgr.gibba009.xiladd (mgr.34457) 1810 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:08 gibba004 bash[31878]: cluster 2021-03-10T20:44:07.477451+0000 mgr.gibba009.xiladd (mgr.34457) 1810 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:10 gibba004 bash[30897]: cluster 2021-03-10T20:44:09.478973+0000 mgr.gibba009.xiladd (mgr.34457) 1811 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:10 gibba004 bash[31878]: cluster 2021-03-10T20:44:09.478973+0000 mgr.gibba009.xiladd (mgr.34457) 1811 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:10 gibba009 bash[26136]: cluster 2021-03-10T20:44:09.478973+0000 mgr.gibba009.xiladd (mgr.34457) 1811 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:11.844 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:44:12.104 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:44:12.104 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (33m) 9m ago 38m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:44:12.105 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:44:12.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (33m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:44:12.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (33m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:44:12.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:44:12.105 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:44:12.106 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:44:12.106 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:44:12.106 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (38m) 9m ago 38m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:44:12.106 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:44:12.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:44:12.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:44:12.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:44:12.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:44:12.108 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:44:12.108 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:44:12.108 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:44:12.108 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:44:12.108 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (38m) 8m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:44:12.109 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:12.109 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:12.367 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:44:12.367 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:44:12.367 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:12.368 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:12.368 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:44:12.368 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:12.368 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:12.369 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:44:12.369 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:44:12.369 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:12.370 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:44:12.370 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:44:12.370 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:44:12.371 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:44:12.371 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:44:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:12 gibba004 bash[30897]: cluster 2021-03-10T20:44:11.480914+0000 mgr.gibba009.xiladd (mgr.34457) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:12 gibba004 bash[30897]: audit 2021-03-10T20:44:12.366750+0000 mon.a (mon.0) 823 : audit [DBG] from='client.? 172.21.2.104:0/1211682360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:12 gibba004 bash[31878]: cluster 2021-03-10T20:44:11.480914+0000 mgr.gibba009.xiladd (mgr.34457) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:12 gibba004 bash[31878]: audit 2021-03-10T20:44:12.366750+0000 mon.a (mon.0) 823 : audit [DBG] from='client.? 172.21.2.104:0/1211682360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:12 gibba009 bash[26136]: cluster 2021-03-10T20:44:11.480914+0000 mgr.gibba009.xiladd (mgr.34457) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:12 gibba009 bash[26136]: audit 2021-03-10T20:44:12.366750+0000 mon.a (mon.0) 823 : audit [DBG] from='client.? 172.21.2.104:0/1211682360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:13.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:13 gibba004 bash[30897]: audit 2021-03-10T20:44:11.835078+0000 mgr.gibba009.xiladd (mgr.34457) 1813 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:13.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:13 gibba004 bash[30897]: audit 2021-03-10T20:44:12.061205+0000 mgr.gibba009.xiladd (mgr.34457) 1814 : audit [DBG] from='client.45288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:13.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:13 gibba004 bash[31878]: audit 2021-03-10T20:44:11.835078+0000 mgr.gibba009.xiladd (mgr.34457) 1813 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:13.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:13 gibba004 bash[31878]: audit 2021-03-10T20:44:12.061205+0000 mgr.gibba009.xiladd (mgr.34457) 1814 : audit [DBG] from='client.45288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:13.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:13 gibba009 bash[26136]: audit 2021-03-10T20:44:11.835078+0000 mgr.gibba009.xiladd (mgr.34457) 1813 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:13.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:13 gibba009 bash[26136]: audit 2021-03-10T20:44:12.061205+0000 mgr.gibba009.xiladd (mgr.34457) 1814 : audit [DBG] from='client.45288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:14.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:14 gibba009 bash[26136]: cluster 2021-03-10T20:44:13.482591+0000 mgr.gibba009.xiladd (mgr.34457) 1815 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:15.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:14 gibba004 bash[30897]: cluster 2021-03-10T20:44:13.482591+0000 mgr.gibba009.xiladd (mgr.34457) 1815 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:15.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:14 gibba004 bash[31878]: cluster 2021-03-10T20:44:13.482591+0000 mgr.gibba009.xiladd (mgr.34457) 1815 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:16.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:16 gibba009 bash[26136]: cluster 2021-03-10T20:44:15.484082+0000 mgr.gibba009.xiladd (mgr.34457) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:16 gibba004 bash[30897]: cluster 2021-03-10T20:44:15.484082+0000 mgr.gibba009.xiladd (mgr.34457) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:17.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:16 gibba004 bash[31878]: cluster 2021-03-10T20:44:15.484082+0000 mgr.gibba009.xiladd (mgr.34457) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.171276+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:17.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.388618+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:44:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.392591+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.393762+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.395397+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:17.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.396520+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.399645+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:17.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:17 gibba009 bash[26136]: audit 2021-03-10T20:44:17.400995+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.171276+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.388618+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:44:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.392591+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.393762+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.395397+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.396520+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.399645+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[30897]: audit 2021-03-10T20:44:17.400995+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.171276+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.388618+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:44:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.392591+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.393762+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.395397+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.396520+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.399645+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:17 gibba004 bash[31878]: audit 2021-03-10T20:44:17.400995+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:18.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.175476+0000 mgr.gibba009.xiladd (mgr.34457) 1817 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:44:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.177277+0000 mgr.gibba009.xiladd (mgr.34457) 1818 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:44:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.390916+0000 mgr.gibba009.xiladd (mgr.34457) 1819 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.392500+0000 mgr.gibba009.xiladd (mgr.34457) 1820 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:18.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.393845+0000 mgr.gibba009.xiladd (mgr.34457) 1821 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.393883+0000 mgr.gibba009.xiladd (mgr.34457) 1822 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.395089+0000 mgr.gibba009.xiladd (mgr.34457) 1823 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.395125+0000 mgr.gibba009.xiladd (mgr.34457) 1824 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.396403+0000 mgr.gibba009.xiladd (mgr.34457) 1825 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:18.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.398215+0000 mgr.gibba009.xiladd (mgr.34457) 1826 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.398254+0000 mgr.gibba009.xiladd (mgr.34457) 1827 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.399376+0000 mgr.gibba009.xiladd (mgr.34457) 1828 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.399786+0000 mgr.gibba009.xiladd (mgr.34457) 1829 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.400881+0000 mgr.gibba009.xiladd (mgr.34457) 1830 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:18.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.400921+0000 mgr.gibba009.xiladd (mgr.34457) 1831 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cephadm 2021-03-10T20:44:17.401139+0000 mgr.gibba009.xiladd (mgr.34457) 1832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:18.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:18 gibba009 bash[26136]: cluster 2021-03-10T20:44:17.485719+0000 mgr.gibba009.xiladd (mgr.34457) 1833 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.175476+0000 mgr.gibba009.xiladd (mgr.34457) 1817 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:44:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.177277+0000 mgr.gibba009.xiladd (mgr.34457) 1818 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:44:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.390916+0000 mgr.gibba009.xiladd (mgr.34457) 1819 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.392500+0000 mgr.gibba009.xiladd (mgr.34457) 1820 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.393845+0000 mgr.gibba009.xiladd (mgr.34457) 1821 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.393883+0000 mgr.gibba009.xiladd (mgr.34457) 1822 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.395089+0000 mgr.gibba009.xiladd (mgr.34457) 1823 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.395125+0000 mgr.gibba009.xiladd (mgr.34457) 1824 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.396403+0000 mgr.gibba009.xiladd (mgr.34457) 1825 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.398215+0000 mgr.gibba009.xiladd (mgr.34457) 1826 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.398254+0000 mgr.gibba009.xiladd (mgr.34457) 1827 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:19.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.399376+0000 mgr.gibba009.xiladd (mgr.34457) 1828 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.399786+0000 mgr.gibba009.xiladd (mgr.34457) 1829 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.400881+0000 mgr.gibba009.xiladd (mgr.34457) 1830 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.400921+0000 mgr.gibba009.xiladd (mgr.34457) 1831 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:19.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cephadm 2021-03-10T20:44:17.401139+0000 mgr.gibba009.xiladd (mgr.34457) 1832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:19.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[30897]: cluster 2021-03-10T20:44:17.485719+0000 mgr.gibba009.xiladd (mgr.34457) 1833 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:19.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.175476+0000 mgr.gibba009.xiladd (mgr.34457) 1817 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:44:19.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.177277+0000 mgr.gibba009.xiladd (mgr.34457) 1818 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:44:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.390916+0000 mgr.gibba009.xiladd (mgr.34457) 1819 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.392500+0000 mgr.gibba009.xiladd (mgr.34457) 1820 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.393845+0000 mgr.gibba009.xiladd (mgr.34457) 1821 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:19.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.393883+0000 mgr.gibba009.xiladd (mgr.34457) 1822 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.395089+0000 mgr.gibba009.xiladd (mgr.34457) 1823 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.395125+0000 mgr.gibba009.xiladd (mgr.34457) 1824 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.396403+0000 mgr.gibba009.xiladd (mgr.34457) 1825 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:19.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.398215+0000 mgr.gibba009.xiladd (mgr.34457) 1826 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.398254+0000 mgr.gibba009.xiladd (mgr.34457) 1827 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.399376+0000 mgr.gibba009.xiladd (mgr.34457) 1828 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.399786+0000 mgr.gibba009.xiladd (mgr.34457) 1829 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:19.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.400881+0000 mgr.gibba009.xiladd (mgr.34457) 1830 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:19.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.400921+0000 mgr.gibba009.xiladd (mgr.34457) 1831 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:19.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cephadm 2021-03-10T20:44:17.401139+0000 mgr.gibba009.xiladd (mgr.34457) 1832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:19.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:18 gibba004 bash[31878]: cluster 2021-03-10T20:44:17.485719+0000 mgr.gibba009.xiladd (mgr.34457) 1833 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:20 gibba004 bash[30897]: cluster 2021-03-10T20:44:19.486984+0000 mgr.gibba009.xiladd (mgr.34457) 1834 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:20 gibba004 bash[31878]: cluster 2021-03-10T20:44:19.486984+0000 mgr.gibba009.xiladd (mgr.34457) 1834 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:20 gibba009 bash[26136]: cluster 2021-03-10T20:44:19.486984+0000 mgr.gibba009.xiladd (mgr.34457) 1834 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:22.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:22 gibba004 bash[30897]: cluster 2021-03-10T20:44:21.488853+0000 mgr.gibba009.xiladd (mgr.34457) 1835 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:22 gibba004 bash[31878]: cluster 2021-03-10T20:44:21.488853+0000 mgr.gibba009.xiladd (mgr.34457) 1835 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:22 gibba009 bash[26136]: cluster 2021-03-10T20:44:21.488853+0000 mgr.gibba009.xiladd (mgr.34457) 1835 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:24.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:24 gibba009 bash[26136]: cluster 2021-03-10T20:44:23.490499+0000 mgr.gibba009.xiladd (mgr.34457) 1836 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:25.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:24 gibba004 bash[30897]: cluster 2021-03-10T20:44:23.490499+0000 mgr.gibba009.xiladd (mgr.34457) 1836 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:25.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:24 gibba004 bash[31878]: cluster 2021-03-10T20:44:23.490499+0000 mgr.gibba009.xiladd (mgr.34457) 1836 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:26.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:26 gibba009 bash[26136]: cluster 2021-03-10T20:44:25.491874+0000 mgr.gibba009.xiladd (mgr.34457) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:26 gibba004 bash[30897]: cluster 2021-03-10T20:44:25.491874+0000 mgr.gibba009.xiladd (mgr.34457) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:27.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:26 gibba004 bash[31878]: cluster 2021-03-10T20:44:25.491874+0000 mgr.gibba009.xiladd (mgr.34457) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:28.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:28 gibba009 bash[26136]: cluster 2021-03-10T20:44:27.493286+0000 mgr.gibba009.xiladd (mgr.34457) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:29.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:28 gibba004 bash[30897]: cluster 2021-03-10T20:44:27.493286+0000 mgr.gibba009.xiladd (mgr.34457) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:28 gibba004 bash[31878]: cluster 2021-03-10T20:44:27.493286+0000 mgr.gibba009.xiladd (mgr.34457) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:30 gibba004 bash[30897]: cluster 2021-03-10T20:44:29.494549+0000 mgr.gibba009.xiladd (mgr.34457) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:30 gibba004 bash[31878]: cluster 2021-03-10T20:44:29.494549+0000 mgr.gibba009.xiladd (mgr.34457) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:30 gibba009 bash[26136]: cluster 2021-03-10T20:44:29.494549+0000 mgr.gibba009.xiladd (mgr.34457) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:32 gibba004 bash[30897]: cluster 2021-03-10T20:44:31.496377+0000 mgr.gibba009.xiladd (mgr.34457) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:32 gibba004 bash[31878]: cluster 2021-03-10T20:44:31.496377+0000 mgr.gibba009.xiladd (mgr.34457) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:32 gibba009 bash[26136]: cluster 2021-03-10T20:44:31.496377+0000 mgr.gibba009.xiladd (mgr.34457) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:33.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:33 gibba009 bash[26136]: cephadm 2021-03-10T20:44:32.417270+0000 mgr.gibba009.xiladd (mgr.34457) 1841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:34.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:33 gibba004 bash[30897]: cephadm 2021-03-10T20:44:32.417270+0000 mgr.gibba009.xiladd (mgr.34457) 1841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:33 gibba004 bash[31878]: cephadm 2021-03-10T20:44:32.417270+0000 mgr.gibba009.xiladd (mgr.34457) 1841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:34.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:34 gibba009 bash[26136]: cluster 2021-03-10T20:44:33.498050+0000 mgr.gibba009.xiladd (mgr.34457) 1842 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:34 gibba004 bash[30897]: cluster 2021-03-10T20:44:33.498050+0000 mgr.gibba009.xiladd (mgr.34457) 1842 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:34 gibba004 bash[31878]: cluster 2021-03-10T20:44:33.498050+0000 mgr.gibba009.xiladd (mgr.34457) 1842 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:37.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:36 gibba004 bash[30897]: cluster 2021-03-10T20:44:35.499673+0000 mgr.gibba009.xiladd (mgr.34457) 1843 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:36 gibba004 bash[31878]: cluster 2021-03-10T20:44:35.499673+0000 mgr.gibba009.xiladd (mgr.34457) 1843 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:37.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:36 gibba009 bash[26136]: cluster 2021-03-10T20:44:35.499673+0000 mgr.gibba009.xiladd (mgr.34457) 1843 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:39.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:38 gibba004 bash[30897]: cluster 2021-03-10T20:44:37.501160+0000 mgr.gibba009.xiladd (mgr.34457) 1844 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:39.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:38 gibba004 bash[31878]: cluster 2021-03-10T20:44:37.501160+0000 mgr.gibba009.xiladd (mgr.34457) 1844 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:38 gibba009 bash[26136]: cluster 2021-03-10T20:44:37.501160+0000 mgr.gibba009.xiladd (mgr.34457) 1844 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: cluster 2021-03-10T20:44:39.502284+0000 mgr.gibba009.xiladd (mgr.34457) 1845 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.780759+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.781906+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.782565+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.783758+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.788414+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.789148+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.789664+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.790349+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.791772+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.791795+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.793581+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[30897]: audit 2021-03-10T20:44:39.794143+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: cluster 2021-03-10T20:44:39.502284+0000 mgr.gibba009.xiladd (mgr.34457) 1845 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.780759+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.781906+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.782565+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.783758+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.788414+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.789148+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.789664+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.790349+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.791772+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.791795+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.793581+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:40 gibba004 bash[31878]: audit 2021-03-10T20:44:39.794143+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: cluster 2021-03-10T20:44:39.502284+0000 mgr.gibba009.xiladd (mgr.34457) 1845 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.780759+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.781906+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.782565+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.783758+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.788414+0000 mon.c (mon.1) 574 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.789148+0000 mon.c (mon.1) 575 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.789664+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:44:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.790349+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.791772+0000 mon.c (mon.1) 577 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.791795+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.793581+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:44:40.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:40 gibba009 bash[26136]: audit 2021-03-10T20:44:39.794143+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:44:42.611 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:44:42.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:42 gibba009 bash[26136]: cluster 2021-03-10T20:44:41.503950+0000 mgr.gibba009.xiladd (mgr.34457) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:42.839 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:44:42.840 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (33m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:44:42.840 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:44:42.840 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:44:42.840 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:44:42.840 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:44:42.841 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:44:42.841 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:44:42.841 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:44:42.841 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:44:42.842 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:44:42.842 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:44:42.842 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:44:42.842 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:44:42.842 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:44:42.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:44:42.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:44:42.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:44:42.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:44:42.844 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (38m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:44:42.844 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:42.844 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:42 gibba004 bash[30897]: cluster 2021-03-10T20:44:41.503950+0000 mgr.gibba009.xiladd (mgr.34457) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:43.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:42 gibba004 bash[31878]: cluster 2021-03-10T20:44:41.503950+0000 mgr.gibba009.xiladd (mgr.34457) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:43.091 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:44:43.091 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:44:43.091 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:43.091 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:43.092 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:44:43.092 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:43.092 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:43.092 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:44:43.093 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:44:43.093 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:44:43.093 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:44:43.093 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:44:43.093 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:44:43.094 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:44:43.094 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:44:43.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:43 gibba009 bash[26136]: audit 2021-03-10T20:44:42.602164+0000 mgr.gibba009.xiladd (mgr.34457) 1847 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:43.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:43 gibba009 bash[26136]: audit 2021-03-10T20:44:43.090829+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.104:0/2393101080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:44.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:43 gibba004 bash[30897]: audit 2021-03-10T20:44:42.602164+0000 mgr.gibba009.xiladd (mgr.34457) 1847 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:43 gibba004 bash[30897]: audit 2021-03-10T20:44:43.090829+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.104:0/2393101080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:43 gibba004 bash[31878]: audit 2021-03-10T20:44:42.602164+0000 mgr.gibba009.xiladd (mgr.34457) 1847 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:43 gibba004 bash[31878]: audit 2021-03-10T20:44:43.090829+0000 mon.a (mon.0) 831 : audit [DBG] from='client.? 172.21.2.104:0/2393101080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:44 gibba009 bash[26136]: audit 2021-03-10T20:44:42.826182+0000 mgr.gibba009.xiladd (mgr.34457) 1848 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:44.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:44 gibba009 bash[26136]: cluster 2021-03-10T20:44:43.505556+0000 mgr.gibba009.xiladd (mgr.34457) 1849 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:44 gibba004 bash[30897]: audit 2021-03-10T20:44:42.826182+0000 mgr.gibba009.xiladd (mgr.34457) 1848 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:44 gibba004 bash[30897]: cluster 2021-03-10T20:44:43.505556+0000 mgr.gibba009.xiladd (mgr.34457) 1849 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:44 gibba004 bash[31878]: audit 2021-03-10T20:44:42.826182+0000 mgr.gibba009.xiladd (mgr.34457) 1848 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:44 gibba004 bash[31878]: cluster 2021-03-10T20:44:43.505556+0000 mgr.gibba009.xiladd (mgr.34457) 1849 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:46 gibba004 bash[30897]: cluster 2021-03-10T20:44:45.506944+0000 mgr.gibba009.xiladd (mgr.34457) 1850 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:46 gibba004 bash[31878]: cluster 2021-03-10T20:44:45.506944+0000 mgr.gibba009.xiladd (mgr.34457) 1850 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:46 gibba009 bash[26136]: cluster 2021-03-10T20:44:45.506944+0000 mgr.gibba009.xiladd (mgr.34457) 1850 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:48 gibba004 bash[30897]: cephadm 2021-03-10T20:44:47.433382+0000 mgr.gibba009.xiladd (mgr.34457) 1851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:48 gibba004 bash[30897]: cluster 2021-03-10T20:44:47.508571+0000 mgr.gibba009.xiladd (mgr.34457) 1852 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:49.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:48 gibba004 bash[31878]: cephadm 2021-03-10T20:44:47.433382+0000 mgr.gibba009.xiladd (mgr.34457) 1851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:48 gibba004 bash[31878]: cluster 2021-03-10T20:44:47.508571+0000 mgr.gibba009.xiladd (mgr.34457) 1852 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:49.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:48 gibba009 bash[26136]: cephadm 2021-03-10T20:44:47.433382+0000 mgr.gibba009.xiladd (mgr.34457) 1851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:44:49.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:48 gibba009 bash[26136]: cluster 2021-03-10T20:44:47.508571+0000 mgr.gibba009.xiladd (mgr.34457) 1852 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:50 gibba004 bash[30897]: cluster 2021-03-10T20:44:49.509747+0000 mgr.gibba009.xiladd (mgr.34457) 1853 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:50 gibba004 bash[31878]: cluster 2021-03-10T20:44:49.509747+0000 mgr.gibba009.xiladd (mgr.34457) 1853 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:50 gibba009 bash[26136]: cluster 2021-03-10T20:44:49.509747+0000 mgr.gibba009.xiladd (mgr.34457) 1853 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:52 gibba009 bash[26136]: cluster 2021-03-10T20:44:51.511480+0000 mgr.gibba009.xiladd (mgr.34457) 1854 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:53.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:52 gibba004 bash[30897]: cluster 2021-03-10T20:44:51.511480+0000 mgr.gibba009.xiladd (mgr.34457) 1854 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:53.807 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:52 gibba004 bash[31878]: cluster 2021-03-10T20:44:51.511480+0000 mgr.gibba009.xiladd (mgr.34457) 1854 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:54.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:54 gibba009 bash[26136]: cluster 2021-03-10T20:44:53.513338+0000 mgr.gibba009.xiladd (mgr.34457) 1855 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:54 gibba004 bash[30897]: cluster 2021-03-10T20:44:53.513338+0000 mgr.gibba009.xiladd (mgr.34457) 1855 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:54 gibba004 bash[31878]: cluster 2021-03-10T20:44:53.513338+0000 mgr.gibba009.xiladd (mgr.34457) 1855 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:57.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:56 gibba004 bash[30897]: cluster 2021-03-10T20:44:55.515199+0000 mgr.gibba009.xiladd (mgr.34457) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:57.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:56 gibba004 bash[31878]: cluster 2021-03-10T20:44:55.515199+0000 mgr.gibba009.xiladd (mgr.34457) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:56 gibba009 bash[26136]: cluster 2021-03-10T20:44:55.515199+0000 mgr.gibba009.xiladd (mgr.34457) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:44:58 gibba004 bash[30897]: cluster 2021-03-10T20:44:57.517082+0000 mgr.gibba009.xiladd (mgr.34457) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:44:58 gibba004 bash[31878]: cluster 2021-03-10T20:44:57.517082+0000 mgr.gibba009.xiladd (mgr.34457) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:59.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:44:58 gibba009 bash[26136]: cluster 2021-03-10T20:44:57.517082+0000 mgr.gibba009.xiladd (mgr.34457) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:00 gibba004 bash[30897]: cluster 2021-03-10T20:44:59.518240+0000 mgr.gibba009.xiladd (mgr.34457) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:00 gibba004 bash[31878]: cluster 2021-03-10T20:44:59.518240+0000 mgr.gibba009.xiladd (mgr.34457) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:00 gibba009 bash[26136]: cluster 2021-03-10T20:44:59.518240+0000 mgr.gibba009.xiladd (mgr.34457) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:02.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:02 gibba009 bash[26136]: cluster 2021-03-10T20:45:01.520086+0000 mgr.gibba009.xiladd (mgr.34457) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:03.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:02 gibba004 bash[30897]: cluster 2021-03-10T20:45:01.520086+0000 mgr.gibba009.xiladd (mgr.34457) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:03.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:02 gibba004 bash[31878]: cluster 2021-03-10T20:45:01.520086+0000 mgr.gibba009.xiladd (mgr.34457) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:04.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:03 gibba004 bash[30897]: cephadm 2021-03-10T20:45:02.449482+0000 mgr.gibba009.xiladd (mgr.34457) 1860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:03 gibba004 bash[31878]: cephadm 2021-03-10T20:45:02.449482+0000 mgr.gibba009.xiladd (mgr.34457) 1860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:04.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:03 gibba009 bash[26136]: cephadm 2021-03-10T20:45:02.449482+0000 mgr.gibba009.xiladd (mgr.34457) 1860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:04 gibba004 bash[30897]: cluster 2021-03-10T20:45:03.521796+0000 mgr.gibba009.xiladd (mgr.34457) 1861 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:04 gibba004 bash[31878]: cluster 2021-03-10T20:45:03.521796+0000 mgr.gibba009.xiladd (mgr.34457) 1861 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:04 gibba009 bash[26136]: cluster 2021-03-10T20:45:03.521796+0000 mgr.gibba009.xiladd (mgr.34457) 1861 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:06 gibba004 bash[30897]: cluster 2021-03-10T20:45:05.523388+0000 mgr.gibba009.xiladd (mgr.34457) 1862 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:07.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:06 gibba004 bash[31878]: cluster 2021-03-10T20:45:05.523388+0000 mgr.gibba009.xiladd (mgr.34457) 1862 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:07.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:06 gibba009 bash[26136]: cluster 2021-03-10T20:45:05.523388+0000 mgr.gibba009.xiladd (mgr.34457) 1862 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:09.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:08 gibba004 bash[30897]: cluster 2021-03-10T20:45:07.525191+0000 mgr.gibba009.xiladd (mgr.34457) 1863 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:08 gibba004 bash[31878]: cluster 2021-03-10T20:45:07.525191+0000 mgr.gibba009.xiladd (mgr.34457) 1863 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:09.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:08 gibba009 bash[26136]: cluster 2021-03-10T20:45:07.525191+0000 mgr.gibba009.xiladd (mgr.34457) 1863 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:10 gibba004 bash[30897]: cluster 2021-03-10T20:45:09.526340+0000 mgr.gibba009.xiladd (mgr.34457) 1864 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:10 gibba004 bash[31878]: cluster 2021-03-10T20:45:09.526340+0000 mgr.gibba009.xiladd (mgr.34457) 1864 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:10 gibba009 bash[26136]: cluster 2021-03-10T20:45:09.526340+0000 mgr.gibba009.xiladd (mgr.34457) 1864 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:13.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:12 gibba004 bash[30897]: cluster 2021-03-10T20:45:11.528233+0000 mgr.gibba009.xiladd (mgr.34457) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:13.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:12 gibba004 bash[31878]: cluster 2021-03-10T20:45:11.528233+0000 mgr.gibba009.xiladd (mgr.34457) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:13.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:12 gibba009 bash[26136]: cluster 2021-03-10T20:45:11.528233+0000 mgr.gibba009.xiladd (mgr.34457) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:13.333 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:45:13.561 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:45:13.562 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (34m) 10m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:45:13.562 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:45:13.562 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (34m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:45:13.563 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (34m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:45:13.563 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:45:13.563 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:45:13.563 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:45:13.563 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (33m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:45:13.564 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (39m) 10m ago 39m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:45:13.564 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:45:13.564 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:45:13.564 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:45:13.565 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:45:13.565 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:45:13.565 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:45:13.565 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:45:13.565 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:45:13.566 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:45:13.566 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (39m) 9m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:45:13.566 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:13.566 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:13.822 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:45:13.822 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:45:13.823 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:13.823 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:13.823 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:45:13.823 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:13.824 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:13.824 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:45:13.824 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:45:13.824 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:13.824 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:45:13.825 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:45:13.825 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:45:13.825 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:45:13.825 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:45:15.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[30897]: audit 2021-03-10T20:45:13.323102+0000 mgr.gibba009.xiladd (mgr.34457) 1866 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[30897]: cluster 2021-03-10T20:45:13.529979+0000 mgr.gibba009.xiladd (mgr.34457) 1867 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:15.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[30897]: audit 2021-03-10T20:45:13.547449+0000 mgr.gibba009.xiladd (mgr.34457) 1868 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[30897]: audit 2021-03-10T20:45:13.822068+0000 mon.c (mon.1) 578 : audit [DBG] from='client.? 172.21.2.104:0/1391895953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:15.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[31878]: audit 2021-03-10T20:45:13.323102+0000 mgr.gibba009.xiladd (mgr.34457) 1866 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[31878]: cluster 2021-03-10T20:45:13.529979+0000 mgr.gibba009.xiladd (mgr.34457) 1867 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:15.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[31878]: audit 2021-03-10T20:45:13.547449+0000 mgr.gibba009.xiladd (mgr.34457) 1868 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:14 gibba004 bash[31878]: audit 2021-03-10T20:45:13.822068+0000 mon.c (mon.1) 578 : audit [DBG] from='client.? 172.21.2.104:0/1391895953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:15.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:14 gibba009 bash[26136]: audit 2021-03-10T20:45:13.323102+0000 mgr.gibba009.xiladd (mgr.34457) 1866 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:14 gibba009 bash[26136]: cluster 2021-03-10T20:45:13.529979+0000 mgr.gibba009.xiladd (mgr.34457) 1867 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:15.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:14 gibba009 bash[26136]: audit 2021-03-10T20:45:13.547449+0000 mgr.gibba009.xiladd (mgr.34457) 1868 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:15.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:14 gibba009 bash[26136]: audit 2021-03-10T20:45:13.822068+0000 mon.c (mon.1) 578 : audit [DBG] from='client.? 172.21.2.104:0/1391895953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:16 gibba004 bash[30897]: cluster 2021-03-10T20:45:15.531618+0000 mgr.gibba009.xiladd (mgr.34457) 1869 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:17.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:16 gibba004 bash[31878]: cluster 2021-03-10T20:45:15.531618+0000 mgr.gibba009.xiladd (mgr.34457) 1869 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:17.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:16 gibba009 bash[26136]: cluster 2021-03-10T20:45:15.531618+0000 mgr.gibba009.xiladd (mgr.34457) 1869 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:17 gibba004 bash[30897]: audit 2021-03-10T20:45:17.467358+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:17 gibba004 bash[30897]: audit 2021-03-10T20:45:17.474149+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:45:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:17 gibba004 bash[31878]: audit 2021-03-10T20:45:17.467358+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:17 gibba004 bash[31878]: audit 2021-03-10T20:45:17.474149+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:45:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:17 gibba009 bash[26136]: audit 2021-03-10T20:45:17.467358+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:17 gibba009 bash[26136]: audit 2021-03-10T20:45:17.474149+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:45:19.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:18 gibba004 bash[30897]: cephadm 2021-03-10T20:45:17.472469+0000 mgr.gibba009.xiladd (mgr.34457) 1870 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:45:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:18 gibba004 bash[30897]: cluster 2021-03-10T20:45:17.532158+0000 mgr.gibba009.xiladd (mgr.34457) 1871 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:19.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:18 gibba004 bash[31878]: cephadm 2021-03-10T20:45:17.472469+0000 mgr.gibba009.xiladd (mgr.34457) 1870 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:45:19.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:18 gibba004 bash[31878]: cluster 2021-03-10T20:45:17.532158+0000 mgr.gibba009.xiladd (mgr.34457) 1871 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:19.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:18 gibba009 bash[26136]: cephadm 2021-03-10T20:45:17.472469+0000 mgr.gibba009.xiladd (mgr.34457) 1870 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:45:19.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:18 gibba009 bash[26136]: cluster 2021-03-10T20:45:17.532158+0000 mgr.gibba009.xiladd (mgr.34457) 1871 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:20 gibba004 bash[30897]: cluster 2021-03-10T20:45:19.533191+0000 mgr.gibba009.xiladd (mgr.34457) 1872 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:20 gibba004 bash[31878]: cluster 2021-03-10T20:45:19.533191+0000 mgr.gibba009.xiladd (mgr.34457) 1872 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:20 gibba009 bash[26136]: cluster 2021-03-10T20:45:19.533191+0000 mgr.gibba009.xiladd (mgr.34457) 1872 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:20.996417+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:20.996618+0000 mgr.gibba009.xiladd (mgr.34457) 1873 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:45:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.204910+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.210624+0000 mgr.gibba009.xiladd (mgr.34457) 1874 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.212675+0000 mgr.gibba009.xiladd (mgr.34457) 1875 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.212723+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.214181+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.214827+0000 mgr.gibba009.xiladd (mgr.34457) 1876 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.214870+0000 mgr.gibba009.xiladd (mgr.34457) 1877 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.216399+0000 mgr.gibba009.xiladd (mgr.34457) 1878 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.216440+0000 mgr.gibba009.xiladd (mgr.34457) 1879 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.216587+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.217793+0000 mgr.gibba009.xiladd (mgr.34457) 1880 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.217965+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.219929+0000 mgr.gibba009.xiladd (mgr.34457) 1881 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.219972+0000 mgr.gibba009.xiladd (mgr.34457) 1882 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.221395+0000 mgr.gibba009.xiladd (mgr.34457) 1883 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.221592+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.221843+0000 mgr.gibba009.xiladd (mgr.34457) 1884 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.223076+0000 mgr.gibba009.xiladd (mgr.34457) 1885 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.223125+0000 mgr.gibba009.xiladd (mgr.34457) 1886 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:20.996417+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:20.996618+0000 mgr.gibba009.xiladd (mgr.34457) 1873 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:45:22.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.204910+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.210624+0000 mgr.gibba009.xiladd (mgr.34457) 1874 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.212675+0000 mgr.gibba009.xiladd (mgr.34457) 1875 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.212723+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.214181+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.214827+0000 mgr.gibba009.xiladd (mgr.34457) 1876 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.214870+0000 mgr.gibba009.xiladd (mgr.34457) 1877 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.216399+0000 mgr.gibba009.xiladd (mgr.34457) 1878 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.216440+0000 mgr.gibba009.xiladd (mgr.34457) 1879 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.216587+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.217793+0000 mgr.gibba009.xiladd (mgr.34457) 1880 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.217965+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.219929+0000 mgr.gibba009.xiladd (mgr.34457) 1881 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.219972+0000 mgr.gibba009.xiladd (mgr.34457) 1882 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.221395+0000 mgr.gibba009.xiladd (mgr.34457) 1883 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.221592+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.221843+0000 mgr.gibba009.xiladd (mgr.34457) 1884 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.223076+0000 mgr.gibba009.xiladd (mgr.34457) 1885 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.223125+0000 mgr.gibba009.xiladd (mgr.34457) 1886 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: audit 2021-03-10T20:45:21.223260+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cephadm 2021-03-10T20:45:21.223287+0000 mgr.gibba009.xiladd (mgr.34457) 1887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:22.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[31878]: cluster 2021-03-10T20:45:21.535056+0000 mgr.gibba009.xiladd (mgr.34457) 1888 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: audit 2021-03-10T20:45:21.223260+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cephadm 2021-03-10T20:45:21.223287+0000 mgr.gibba009.xiladd (mgr.34457) 1887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:22.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:22 gibba004 bash[30897]: cluster 2021-03-10T20:45:21.535056+0000 mgr.gibba009.xiladd (mgr.34457) 1888 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:20.996417+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:20.996618+0000 mgr.gibba009.xiladd (mgr.34457) 1873 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:45:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.204910+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:45:22.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.210624+0000 mgr.gibba009.xiladd (mgr.34457) 1874 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.212675+0000 mgr.gibba009.xiladd (mgr.34457) 1875 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.212723+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.214181+0000 mon.c (mon.1) 582 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.214827+0000 mgr.gibba009.xiladd (mgr.34457) 1876 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.214870+0000 mgr.gibba009.xiladd (mgr.34457) 1877 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.216399+0000 mgr.gibba009.xiladd (mgr.34457) 1878 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.216440+0000 mgr.gibba009.xiladd (mgr.34457) 1879 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.216587+0000 mon.c (mon.1) 583 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.217793+0000 mgr.gibba009.xiladd (mgr.34457) 1880 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.217965+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.219929+0000 mgr.gibba009.xiladd (mgr.34457) 1881 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.219972+0000 mgr.gibba009.xiladd (mgr.34457) 1882 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.221395+0000 mgr.gibba009.xiladd (mgr.34457) 1883 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.221592+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.221843+0000 mgr.gibba009.xiladd (mgr.34457) 1884 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.223076+0000 mgr.gibba009.xiladd (mgr.34457) 1885 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.223125+0000 mgr.gibba009.xiladd (mgr.34457) 1886 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: audit 2021-03-10T20:45:21.223260+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cephadm 2021-03-10T20:45:21.223287+0000 mgr.gibba009.xiladd (mgr.34457) 1887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:22 gibba009 bash[26136]: cluster 2021-03-10T20:45:21.535056+0000 mgr.gibba009.xiladd (mgr.34457) 1888 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:25.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:24 gibba004 bash[30897]: cluster 2021-03-10T20:45:23.537025+0000 mgr.gibba009.xiladd (mgr.34457) 1889 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:25.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:24 gibba004 bash[31878]: cluster 2021-03-10T20:45:23.537025+0000 mgr.gibba009.xiladd (mgr.34457) 1889 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:25.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:24 gibba009 bash[26136]: cluster 2021-03-10T20:45:23.537025+0000 mgr.gibba009.xiladd (mgr.34457) 1889 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:27.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:26 gibba004 bash[30897]: cluster 2021-03-10T20:45:25.538719+0000 mgr.gibba009.xiladd (mgr.34457) 1890 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:26 gibba004 bash[31878]: cluster 2021-03-10T20:45:25.538719+0000 mgr.gibba009.xiladd (mgr.34457) 1890 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:27.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:26 gibba009 bash[26136]: cluster 2021-03-10T20:45:25.538719+0000 mgr.gibba009.xiladd (mgr.34457) 1890 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:29.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:28 gibba004 bash[30897]: cluster 2021-03-10T20:45:27.540460+0000 mgr.gibba009.xiladd (mgr.34457) 1891 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:28 gibba004 bash[31878]: cluster 2021-03-10T20:45:27.540460+0000 mgr.gibba009.xiladd (mgr.34457) 1891 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:28 gibba009 bash[26136]: cluster 2021-03-10T20:45:27.540460+0000 mgr.gibba009.xiladd (mgr.34457) 1891 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:30 gibba004 bash[30897]: cluster 2021-03-10T20:45:29.541874+0000 mgr.gibba009.xiladd (mgr.34457) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:30 gibba004 bash[31878]: cluster 2021-03-10T20:45:29.541874+0000 mgr.gibba009.xiladd (mgr.34457) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:30 gibba009 bash[26136]: cluster 2021-03-10T20:45:29.541874+0000 mgr.gibba009.xiladd (mgr.34457) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:33.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:32 gibba004 bash[30897]: cluster 2021-03-10T20:45:31.543591+0000 mgr.gibba009.xiladd (mgr.34457) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:33.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:32 gibba004 bash[31878]: cluster 2021-03-10T20:45:31.543591+0000 mgr.gibba009.xiladd (mgr.34457) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:33.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:32 gibba009 bash[26136]: cluster 2021-03-10T20:45:31.543591+0000 mgr.gibba009.xiladd (mgr.34457) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:34 gibba004 bash[30897]: cluster 2021-03-10T20:45:33.545183+0000 mgr.gibba009.xiladd (mgr.34457) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:34 gibba004 bash[31878]: cluster 2021-03-10T20:45:33.545183+0000 mgr.gibba009.xiladd (mgr.34457) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:35.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:34 gibba009 bash[26136]: cluster 2021-03-10T20:45:33.545183+0000 mgr.gibba009.xiladd (mgr.34457) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:36 gibba004 bash[30897]: cluster 2021-03-10T20:45:35.546956+0000 mgr.gibba009.xiladd (mgr.34457) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:36 gibba004 bash[31878]: cluster 2021-03-10T20:45:35.546956+0000 mgr.gibba009.xiladd (mgr.34457) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:36 gibba009 bash[26136]: cluster 2021-03-10T20:45:35.546956+0000 mgr.gibba009.xiladd (mgr.34457) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:37 gibba004 bash[30897]: cephadm 2021-03-10T20:45:36.239394+0000 mgr.gibba009.xiladd (mgr.34457) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:38.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:37 gibba004 bash[31878]: cephadm 2021-03-10T20:45:36.239394+0000 mgr.gibba009.xiladd (mgr.34457) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:38.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:37 gibba009 bash[26136]: cephadm 2021-03-10T20:45:36.239394+0000 mgr.gibba009.xiladd (mgr.34457) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:39.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:38 gibba004 bash[30897]: cluster 2021-03-10T20:45:37.548571+0000 mgr.gibba009.xiladd (mgr.34457) 1897 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:39.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:38 gibba004 bash[31878]: cluster 2021-03-10T20:45:37.548571+0000 mgr.gibba009.xiladd (mgr.34457) 1897 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:38 gibba009 bash[26136]: cluster 2021-03-10T20:45:37.548571+0000 mgr.gibba009.xiladd (mgr.34457) 1897 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: cluster 2021-03-10T20:45:39.549998+0000 mgr.gibba009.xiladd (mgr.34457) 1898 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.788085+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.788741+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.789234+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.790349+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.795520+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.796237+0000 mon.c (mon.1) 590 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.796658+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.796961+0000 mon.c (mon.1) 591 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.797788+0000 mon.c (mon.1) 592 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.798289+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.799308+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[30897]: audit 2021-03-10T20:45:39.800100+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: cluster 2021-03-10T20:45:39.549998+0000 mgr.gibba009.xiladd (mgr.34457) 1898 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.788085+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.788741+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.789234+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.790349+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.795520+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.796237+0000 mon.c (mon.1) 590 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.796658+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.796961+0000 mon.c (mon.1) 591 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.797788+0000 mon.c (mon.1) 592 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.798289+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.799308+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:40 gibba004 bash[31878]: audit 2021-03-10T20:45:39.800100+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: cluster 2021-03-10T20:45:39.549998+0000 mgr.gibba009.xiladd (mgr.34457) 1898 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.788085+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.788741+0000 mon.c (mon.1) 588 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.789234+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.790349+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.795520+0000 mon.c (mon.1) 589 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.796237+0000 mon.c (mon.1) 590 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.796658+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:45:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.796961+0000 mon.c (mon.1) 591 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.797788+0000 mon.c (mon.1) 592 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.798289+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:45:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.799308+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:45:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:40 gibba009 bash[26136]: audit 2021-03-10T20:45:39.800100+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:45:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:42 gibba004 bash[30897]: cluster 2021-03-10T20:45:41.551797+0000 mgr.gibba009.xiladd (mgr.34457) 1899 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:42 gibba004 bash[31878]: cluster 2021-03-10T20:45:41.551797+0000 mgr.gibba009.xiladd (mgr.34457) 1899 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:43.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:42 gibba009 bash[26136]: cluster 2021-03-10T20:45:41.551797+0000 mgr.gibba009.xiladd (mgr.34457) 1899 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:44.063 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:45:44.320 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:45:44.320 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (34m) 23s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:45:44.320 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:45:44.321 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:45:44.321 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:45:44.321 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (34m) 23s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:45:44.321 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (34m) 23s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:45:44.321 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:45:44.322 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (33m) 23s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:45:44.322 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (40m) 23s ago 40m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:45:44.322 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:45:44.322 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (33m) 23s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:45:44.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (32m) 23s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:45:44.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (32m) 23s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:45:44.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (31m) 23s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:45:44.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:45:44.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:45:44.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:45:44.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:45:44.324 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (39m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:45:44.324 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 23s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:44.325 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:44.576 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:45:44.577 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:45:44.577 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:44.578 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:44.578 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:45:44.579 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:44.579 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:44.579 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:45:44.580 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:45:44.580 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:45:44.580 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:45:44.581 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:45:44.581 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:45:44.581 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:45:44.581 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:45:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:44 gibba004 bash[30897]: cluster 2021-03-10T20:45:43.553386+0000 mgr.gibba009.xiladd (mgr.34457) 1900 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:45.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:44 gibba004 bash[30897]: audit 2021-03-10T20:45:44.576440+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.104:0/1944260084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:44 gibba004 bash[31878]: cluster 2021-03-10T20:45:43.553386+0000 mgr.gibba009.xiladd (mgr.34457) 1900 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:44 gibba004 bash[31878]: audit 2021-03-10T20:45:44.576440+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.104:0/1944260084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:44 gibba009 bash[26136]: cluster 2021-03-10T20:45:43.553386+0000 mgr.gibba009.xiladd (mgr.34457) 1900 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:44 gibba009 bash[26136]: audit 2021-03-10T20:45:44.576440+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? 172.21.2.104:0/1944260084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:45 gibba004 bash[30897]: audit 2021-03-10T20:45:44.052432+0000 mgr.gibba009.xiladd (mgr.34457) 1901 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:45 gibba004 bash[30897]: audit 2021-03-10T20:45:44.277875+0000 mgr.gibba009.xiladd (mgr.34457) 1902 : audit [DBG] from='client.55321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:46.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:45 gibba004 bash[31878]: audit 2021-03-10T20:45:44.052432+0000 mgr.gibba009.xiladd (mgr.34457) 1901 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:45 gibba004 bash[31878]: audit 2021-03-10T20:45:44.277875+0000 mgr.gibba009.xiladd (mgr.34457) 1902 : audit [DBG] from='client.55321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:45 gibba009 bash[26136]: audit 2021-03-10T20:45:44.052432+0000 mgr.gibba009.xiladd (mgr.34457) 1901 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:45 gibba009 bash[26136]: audit 2021-03-10T20:45:44.277875+0000 mgr.gibba009.xiladd (mgr.34457) 1902 : audit [DBG] from='client.55321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:46 gibba004 bash[30897]: cluster 2021-03-10T20:45:45.554879+0000 mgr.gibba009.xiladd (mgr.34457) 1903 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:46 gibba004 bash[31878]: cluster 2021-03-10T20:45:45.554879+0000 mgr.gibba009.xiladd (mgr.34457) 1903 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:47.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:46 gibba009 bash[26136]: cluster 2021-03-10T20:45:45.554879+0000 mgr.gibba009.xiladd (mgr.34457) 1903 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:48 gibba004 bash[30897]: cluster 2021-03-10T20:45:47.556551+0000 mgr.gibba009.xiladd (mgr.34457) 1904 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:49.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:48 gibba004 bash[31878]: cluster 2021-03-10T20:45:47.556551+0000 mgr.gibba009.xiladd (mgr.34457) 1904 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:48 gibba009 bash[26136]: cluster 2021-03-10T20:45:47.556551+0000 mgr.gibba009.xiladd (mgr.34457) 1904 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:50 gibba004 bash[30897]: cluster 2021-03-10T20:45:49.557871+0000 mgr.gibba009.xiladd (mgr.34457) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:50 gibba004 bash[31878]: cluster 2021-03-10T20:45:49.557871+0000 mgr.gibba009.xiladd (mgr.34457) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:50 gibba009 bash[26136]: cluster 2021-03-10T20:45:49.557871+0000 mgr.gibba009.xiladd (mgr.34457) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:53.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:52 gibba004 bash[30897]: cephadm 2021-03-10T20:45:51.249765+0000 mgr.gibba009.xiladd (mgr.34457) 1906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:53.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:52 gibba004 bash[30897]: cluster 2021-03-10T20:45:51.559599+0000 mgr.gibba009.xiladd (mgr.34457) 1907 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:53.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:52 gibba004 bash[31878]: cephadm 2021-03-10T20:45:51.249765+0000 mgr.gibba009.xiladd (mgr.34457) 1906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:53.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:52 gibba004 bash[31878]: cluster 2021-03-10T20:45:51.559599+0000 mgr.gibba009.xiladd (mgr.34457) 1907 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:53.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:52 gibba009 bash[26136]: cephadm 2021-03-10T20:45:51.249765+0000 mgr.gibba009.xiladd (mgr.34457) 1906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:45:53.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:52 gibba009 bash[26136]: cluster 2021-03-10T20:45:51.559599+0000 mgr.gibba009.xiladd (mgr.34457) 1907 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:54 gibba004 bash[30897]: cluster 2021-03-10T20:45:53.561115+0000 mgr.gibba009.xiladd (mgr.34457) 1908 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:54 gibba004 bash[31878]: cluster 2021-03-10T20:45:53.561115+0000 mgr.gibba009.xiladd (mgr.34457) 1908 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:55.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:54 gibba009 bash[26136]: cluster 2021-03-10T20:45:53.561115+0000 mgr.gibba009.xiladd (mgr.34457) 1908 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:56 gibba004 bash[30897]: cluster 2021-03-10T20:45:55.562502+0000 mgr.gibba009.xiladd (mgr.34457) 1909 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:56 gibba004 bash[31878]: cluster 2021-03-10T20:45:55.562502+0000 mgr.gibba009.xiladd (mgr.34457) 1909 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:56 gibba009 bash[26136]: cluster 2021-03-10T20:45:55.562502+0000 mgr.gibba009.xiladd (mgr.34457) 1909 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:59.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:45:58 gibba004 bash[30897]: cluster 2021-03-10T20:45:57.564176+0000 mgr.gibba009.xiladd (mgr.34457) 1910 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:45:58 gibba004 bash[31878]: cluster 2021-03-10T20:45:57.564176+0000 mgr.gibba009.xiladd (mgr.34457) 1910 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:59.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:45:58 gibba009 bash[26136]: cluster 2021-03-10T20:45:57.564176+0000 mgr.gibba009.xiladd (mgr.34457) 1910 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:00 gibba004 bash[30897]: cluster 2021-03-10T20:45:59.565486+0000 mgr.gibba009.xiladd (mgr.34457) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:00 gibba004 bash[31878]: cluster 2021-03-10T20:45:59.565486+0000 mgr.gibba009.xiladd (mgr.34457) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:00 gibba009 bash[26136]: cluster 2021-03-10T20:45:59.565486+0000 mgr.gibba009.xiladd (mgr.34457) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:03.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:02 gibba004 bash[30897]: cluster 2021-03-10T20:46:01.567266+0000 mgr.gibba009.xiladd (mgr.34457) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:03.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:02 gibba004 bash[31878]: cluster 2021-03-10T20:46:01.567266+0000 mgr.gibba009.xiladd (mgr.34457) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:03.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:02 gibba009 bash[26136]: cluster 2021-03-10T20:46:01.567266+0000 mgr.gibba009.xiladd (mgr.34457) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:04 gibba004 bash[30897]: cluster 2021-03-10T20:46:03.568944+0000 mgr.gibba009.xiladd (mgr.34457) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:04 gibba004 bash[31878]: cluster 2021-03-10T20:46:03.568944+0000 mgr.gibba009.xiladd (mgr.34457) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:05.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:04 gibba009 bash[26136]: cluster 2021-03-10T20:46:03.568944+0000 mgr.gibba009.xiladd (mgr.34457) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:07.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:06 gibba004 bash[30897]: cluster 2021-03-10T20:46:05.570331+0000 mgr.gibba009.xiladd (mgr.34457) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:07.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:06 gibba004 bash[31878]: cluster 2021-03-10T20:46:05.570331+0000 mgr.gibba009.xiladd (mgr.34457) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:07.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:06 gibba009 bash[26136]: cluster 2021-03-10T20:46:05.570331+0000 mgr.gibba009.xiladd (mgr.34457) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:08.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:07 gibba004 bash[30897]: cephadm 2021-03-10T20:46:06.257513+0000 mgr.gibba009.xiladd (mgr.34457) 1915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:08.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:07 gibba004 bash[31878]: cephadm 2021-03-10T20:46:06.257513+0000 mgr.gibba009.xiladd (mgr.34457) 1915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:08.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:07 gibba009 bash[26136]: cephadm 2021-03-10T20:46:06.257513+0000 mgr.gibba009.xiladd (mgr.34457) 1915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:09.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:08 gibba004 bash[31878]: cluster 2021-03-10T20:46:07.571856+0000 mgr.gibba009.xiladd (mgr.34457) 1916 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:09.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:08 gibba004 bash[30897]: cluster 2021-03-10T20:46:07.571856+0000 mgr.gibba009.xiladd (mgr.34457) 1916 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:09.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:08 gibba009 bash[26136]: cluster 2021-03-10T20:46:07.571856+0000 mgr.gibba009.xiladd (mgr.34457) 1916 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:10 gibba004 bash[30897]: cluster 2021-03-10T20:46:09.573176+0000 mgr.gibba009.xiladd (mgr.34457) 1917 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:10 gibba004 bash[31878]: cluster 2021-03-10T20:46:09.573176+0000 mgr.gibba009.xiladd (mgr.34457) 1917 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:10 gibba009 bash[26136]: cluster 2021-03-10T20:46:09.573176+0000 mgr.gibba009.xiladd (mgr.34457) 1917 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:13.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:12 gibba004 bash[30897]: cluster 2021-03-10T20:46:11.575017+0000 mgr.gibba009.xiladd (mgr.34457) 1918 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:13.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:12 gibba004 bash[31878]: cluster 2021-03-10T20:46:11.575017+0000 mgr.gibba009.xiladd (mgr.34457) 1918 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:13.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:12 gibba009 bash[26136]: cluster 2021-03-10T20:46:11.575017+0000 mgr.gibba009.xiladd (mgr.34457) 1918 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:14.822 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:46:15.049 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:46:15.049 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (35m) 54s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:46:15.049 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (40m) 10m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:46:15.050 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (35m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:46:15.050 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (35m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:46:15.050 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (34m) 54s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:46:15.050 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (34m) 54s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:46:15.050 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (34m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:46:15.051 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (34m) 54s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:46:15.051 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (40m) 54s ago 40m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:46:15.051 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (40m) 10m ago 40m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:46:15.051 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (33m) 54s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:46:15.052 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (33m) 54s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:46:15.052 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (32m) 54s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:46:15.052 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (32m) 54s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:46:15.052 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (31m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:46:15.052 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:46:15.053 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:46:15.053 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:46:15.053 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (40m) 10m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:46:15.053 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 54s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:15.054 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 10m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:15.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:14 gibba004 bash[30897]: cluster 2021-03-10T20:46:13.575974+0000 mgr.gibba009.xiladd (mgr.34457) 1919 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:15.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:14 gibba004 bash[31878]: cluster 2021-03-10T20:46:13.575974+0000 mgr.gibba009.xiladd (mgr.34457) 1919 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:15.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:14 gibba009 bash[26136]: cluster 2021-03-10T20:46:13.575974+0000 mgr.gibba009.xiladd (mgr.34457) 1919 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:15.297 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:46:15.297 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:46:15.298 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:15.298 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:15.298 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:46:15.298 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:15.298 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:15.299 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:46:15.299 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:46:15.299 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:15.299 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:46:15.300 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:46:15.300 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:46:15.300 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:46:15.300 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:46:16.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:15 gibba004 bash[30897]: audit 2021-03-10T20:46:15.297153+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.2.104:0/3623574136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:16.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:15 gibba004 bash[31878]: audit 2021-03-10T20:46:15.297153+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.2.104:0/3623574136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:16.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:15 gibba009 bash[26136]: audit 2021-03-10T20:46:15.297153+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.2.104:0/3623574136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[30897]: audit 2021-03-10T20:46:14.812820+0000 mgr.gibba009.xiladd (mgr.34457) 1920 : audit [DBG] from='client.45354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[30897]: audit 2021-03-10T20:46:15.035384+0000 mgr.gibba009.xiladd (mgr.34457) 1921 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[30897]: cluster 2021-03-10T20:46:15.577610+0000 mgr.gibba009.xiladd (mgr.34457) 1922 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:17.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[31878]: audit 2021-03-10T20:46:14.812820+0000 mgr.gibba009.xiladd (mgr.34457) 1920 : audit [DBG] from='client.45354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[31878]: audit 2021-03-10T20:46:15.035384+0000 mgr.gibba009.xiladd (mgr.34457) 1921 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:16 gibba004 bash[31878]: cluster 2021-03-10T20:46:15.577610+0000 mgr.gibba009.xiladd (mgr.34457) 1922 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:17.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:16 gibba009 bash[26136]: audit 2021-03-10T20:46:14.812820+0000 mgr.gibba009.xiladd (mgr.34457) 1920 : audit [DBG] from='client.45354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:16 gibba009 bash[26136]: audit 2021-03-10T20:46:15.035384+0000 mgr.gibba009.xiladd (mgr.34457) 1921 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:17.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:16 gibba009 bash[26136]: cluster 2021-03-10T20:46:15.577610+0000 mgr.gibba009.xiladd (mgr.34457) 1922 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:19.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:18 gibba004 bash[30897]: cluster 2021-03-10T20:46:17.579245+0000 mgr.gibba009.xiladd (mgr.34457) 1923 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:19.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:18 gibba004 bash[31878]: cluster 2021-03-10T20:46:17.579245+0000 mgr.gibba009.xiladd (mgr.34457) 1923 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:18 gibba009 bash[26136]: cluster 2021-03-10T20:46:17.579245+0000 mgr.gibba009.xiladd (mgr.34457) 1923 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:20 gibba004 bash[30897]: cluster 2021-03-10T20:46:19.579912+0000 mgr.gibba009.xiladd (mgr.34457) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:20 gibba004 bash[31878]: cluster 2021-03-10T20:46:19.579912+0000 mgr.gibba009.xiladd (mgr.34457) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:20 gibba009 bash[26136]: cluster 2021-03-10T20:46:19.579912+0000 mgr.gibba009.xiladd (mgr.34457) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:21.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:21 gibba004 bash[30897]: audit 2021-03-10T20:46:21.275049+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:21.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:21 gibba004 bash[30897]: audit 2021-03-10T20:46:21.283561+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:46:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:21 gibba004 bash[31878]: audit 2021-03-10T20:46:21.275049+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:21.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:21 gibba004 bash[31878]: audit 2021-03-10T20:46:21.283561+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:46:21.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:21 gibba009 bash[26136]: audit 2021-03-10T20:46:21.275049+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:21.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:21 gibba009 bash[26136]: audit 2021-03-10T20:46:21.283561+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:46:22.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:22 gibba004 bash[30897]: cephadm 2021-03-10T20:46:21.279456+0000 mgr.gibba009.xiladd (mgr.34457) 1925 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:46:22.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:22 gibba004 bash[30897]: cluster 2021-03-10T20:46:21.581043+0000 mgr.gibba009.xiladd (mgr.34457) 1926 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:22 gibba004 bash[31878]: cephadm 2021-03-10T20:46:21.279456+0000 mgr.gibba009.xiladd (mgr.34457) 1925 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:46:22.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:22 gibba004 bash[31878]: cluster 2021-03-10T20:46:21.581043+0000 mgr.gibba009.xiladd (mgr.34457) 1926 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:22 gibba009 bash[26136]: cephadm 2021-03-10T20:46:21.279456+0000 mgr.gibba009.xiladd (mgr.34457) 1925 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:46:22.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:22 gibba009 bash[26136]: cluster 2021-03-10T20:46:21.581043+0000 mgr.gibba009.xiladd (mgr.34457) 1926 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:25.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:24 gibba004 bash[30897]: cluster 2021-03-10T20:46:23.582385+0000 mgr.gibba009.xiladd (mgr.34457) 1927 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:25.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:24 gibba004 bash[31878]: cluster 2021-03-10T20:46:23.582385+0000 mgr.gibba009.xiladd (mgr.34457) 1927 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:25.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:24 gibba009 bash[26136]: cluster 2021-03-10T20:46:23.582385+0000 mgr.gibba009.xiladd (mgr.34457) 1927 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.065155+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.065356+0000 mgr.gibba009.xiladd (mgr.34457) 1928 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:46:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.263728+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.265884+0000 mgr.gibba009.xiladd (mgr.34457) 1929 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.267547+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:26.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.267578+0000 mgr.gibba009.xiladd (mgr.34457) 1930 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.268546+0000 mgr.gibba009.xiladd (mgr.34457) 1931 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.268585+0000 mgr.gibba009.xiladd (mgr.34457) 1932 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.268873+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.269831+0000 mgr.gibba009.xiladd (mgr.34457) 1933 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.269870+0000 mgr.gibba009.xiladd (mgr.34457) 1934 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.269942+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.270786+0000 mgr.gibba009.xiladd (mgr.34457) 1935 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.271087+0000 mon.c (mon.1) 598 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.272246+0000 mgr.gibba009.xiladd (mgr.34457) 1936 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:26.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.272294+0000 mgr.gibba009.xiladd (mgr.34457) 1937 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:26.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.273765+0000 mgr.gibba009.xiladd (mgr.34457) 1938 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:26.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.273886+0000 mon.c (mon.1) 599 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.274092+0000 mgr.gibba009.xiladd (mgr.34457) 1939 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:26.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.275027+0000 mgr.gibba009.xiladd (mgr.34457) 1940 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:26.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.275070+0000 mgr.gibba009.xiladd (mgr.34457) 1941 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:26.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cephadm 2021-03-10T20:46:25.275275+0000 mgr.gibba009.xiladd (mgr.34457) 1942 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:26.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: audit 2021-03-10T20:46:25.275295+0000 mon.c (mon.1) 600 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:26 gibba009 bash[26136]: cluster 2021-03-10T20:46:25.583049+0000 mgr.gibba009.xiladd (mgr.34457) 1943 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.563 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.065155+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.065356+0000 mgr.gibba009.xiladd (mgr.34457) 1928 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:46:26.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.263728+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.265884+0000 mgr.gibba009.xiladd (mgr.34457) 1929 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.267547+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.267578+0000 mgr.gibba009.xiladd (mgr.34457) 1930 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.268546+0000 mgr.gibba009.xiladd (mgr.34457) 1931 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:26.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.268585+0000 mgr.gibba009.xiladd (mgr.34457) 1932 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:26.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.268873+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.269831+0000 mgr.gibba009.xiladd (mgr.34457) 1933 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:26.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.269870+0000 mgr.gibba009.xiladd (mgr.34457) 1934 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:26.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.269942+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.270786+0000 mgr.gibba009.xiladd (mgr.34457) 1935 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:26.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.271087+0000 mon.c (mon.1) 598 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.272246+0000 mgr.gibba009.xiladd (mgr.34457) 1936 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:26.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.272294+0000 mgr.gibba009.xiladd (mgr.34457) 1937 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:26.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.273765+0000 mgr.gibba009.xiladd (mgr.34457) 1938 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:26.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.273886+0000 mon.c (mon.1) 599 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.274092+0000 mgr.gibba009.xiladd (mgr.34457) 1939 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:26.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.275027+0000 mgr.gibba009.xiladd (mgr.34457) 1940 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:26.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.275070+0000 mgr.gibba009.xiladd (mgr.34457) 1941 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:26.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.065155+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.065356+0000 mgr.gibba009.xiladd (mgr.34457) 1928 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:46:26.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.263728+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:46:26.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.265884+0000 mgr.gibba009.xiladd (mgr.34457) 1929 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:26.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.267547+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:26.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.267578+0000 mgr.gibba009.xiladd (mgr.34457) 1930 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:26.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.268546+0000 mgr.gibba009.xiladd (mgr.34457) 1931 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:26.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.268585+0000 mgr.gibba009.xiladd (mgr.34457) 1932 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:26.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.268873+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.269831+0000 mgr.gibba009.xiladd (mgr.34457) 1933 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:26.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.269870+0000 mgr.gibba009.xiladd (mgr.34457) 1934 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:26.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.269942+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.270786+0000 mgr.gibba009.xiladd (mgr.34457) 1935 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:26.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.271087+0000 mon.c (mon.1) 598 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.272246+0000 mgr.gibba009.xiladd (mgr.34457) 1936 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:26.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.272294+0000 mgr.gibba009.xiladd (mgr.34457) 1937 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:26.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.273765+0000 mgr.gibba009.xiladd (mgr.34457) 1938 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:26.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.273886+0000 mon.c (mon.1) 599 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.274092+0000 mgr.gibba009.xiladd (mgr.34457) 1939 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:26.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.275027+0000 mgr.gibba009.xiladd (mgr.34457) 1940 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:26.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.275070+0000 mgr.gibba009.xiladd (mgr.34457) 1941 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:26.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cephadm 2021-03-10T20:46:25.275275+0000 mgr.gibba009.xiladd (mgr.34457) 1942 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:26.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: audit 2021-03-10T20:46:25.275295+0000 mon.c (mon.1) 600 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[30897]: cluster 2021-03-10T20:46:25.583049+0000 mgr.gibba009.xiladd (mgr.34457) 1943 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cephadm 2021-03-10T20:46:25.275275+0000 mgr.gibba009.xiladd (mgr.34457) 1942 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:26.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: audit 2021-03-10T20:46:25.275295+0000 mon.c (mon.1) 600 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:26.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:26 gibba004 bash[31878]: cluster 2021-03-10T20:46:25.583049+0000 mgr.gibba009.xiladd (mgr.34457) 1943 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:29.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:28 gibba004 bash[30897]: cluster 2021-03-10T20:46:27.584513+0000 mgr.gibba009.xiladd (mgr.34457) 1944 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:28 gibba004 bash[31878]: cluster 2021-03-10T20:46:27.584513+0000 mgr.gibba009.xiladd (mgr.34457) 1944 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:28 gibba009 bash[26136]: cluster 2021-03-10T20:46:27.584513+0000 mgr.gibba009.xiladd (mgr.34457) 1944 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:30.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:30 gibba004 bash[30897]: cluster 2021-03-10T20:46:29.585777+0000 mgr.gibba009.xiladd (mgr.34457) 1945 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:30.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:30 gibba004 bash[31878]: cluster 2021-03-10T20:46:29.585777+0000 mgr.gibba009.xiladd (mgr.34457) 1945 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:30 gibba009 bash[26136]: cluster 2021-03-10T20:46:29.585777+0000 mgr.gibba009.xiladd (mgr.34457) 1945 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:33.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:32 gibba004 bash[30897]: cluster 2021-03-10T20:46:31.586490+0000 mgr.gibba009.xiladd (mgr.34457) 1946 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:33.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:32 gibba004 bash[31878]: cluster 2021-03-10T20:46:31.586490+0000 mgr.gibba009.xiladd (mgr.34457) 1946 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:33.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:32 gibba009 bash[26136]: cluster 2021-03-10T20:46:31.586490+0000 mgr.gibba009.xiladd (mgr.34457) 1946 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:34 gibba004 bash[30897]: cluster 2021-03-10T20:46:33.587784+0000 mgr.gibba009.xiladd (mgr.34457) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:34 gibba004 bash[31878]: cluster 2021-03-10T20:46:33.587784+0000 mgr.gibba009.xiladd (mgr.34457) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:34 gibba009 bash[26136]: cluster 2021-03-10T20:46:33.587784+0000 mgr.gibba009.xiladd (mgr.34457) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:36 gibba004 bash[30897]: cluster 2021-03-10T20:46:35.589483+0000 mgr.gibba009.xiladd (mgr.34457) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:36 gibba004 bash[31878]: cluster 2021-03-10T20:46:35.589483+0000 mgr.gibba009.xiladd (mgr.34457) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:36 gibba009 bash[26136]: cluster 2021-03-10T20:46:35.589483+0000 mgr.gibba009.xiladd (mgr.34457) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:39.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:38 gibba004 bash[30897]: cluster 2021-03-10T20:46:37.590130+0000 mgr.gibba009.xiladd (mgr.34457) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:39.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:38 gibba004 bash[31878]: cluster 2021-03-10T20:46:37.590130+0000 mgr.gibba009.xiladd (mgr.34457) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:39.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:38 gibba009 bash[26136]: cluster 2021-03-10T20:46:37.590130+0000 mgr.gibba009.xiladd (mgr.34457) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: cluster 2021-03-10T20:46:39.591441+0000 mgr.gibba009.xiladd (mgr.34457) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.794973+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.795924+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.796226+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.588 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.797251+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.800947+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.802019+0000 mon.c (mon.1) 604 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.802309+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.803137+0000 mon.c (mon.1) 605 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.803364+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.804404+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.804681+0000 mon.c (mon.1) 606 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:40 gibba009 bash[26136]: audit 2021-03-10T20:46:39.805939+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: cluster 2021-03-10T20:46:39.591441+0000 mgr.gibba009.xiladd (mgr.34457) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.794973+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.795924+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.796226+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.797251+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.800947+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.802019+0000 mon.c (mon.1) 604 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.802309+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.803137+0000 mon.c (mon.1) 605 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.803364+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.804404+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.804681+0000 mon.c (mon.1) 606 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[30897]: audit 2021-03-10T20:46:39.805939+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: cluster 2021-03-10T20:46:39.591441+0000 mgr.gibba009.xiladd (mgr.34457) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.794973+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.795924+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.796226+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.797251+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.800947+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.802019+0000 mon.c (mon.1) 604 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.802309+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:46:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.803137+0000 mon.c (mon.1) 605 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.803364+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.804404+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.821 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.804681+0000 mon.c (mon.1) 606 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:40.822 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:40 gibba004 bash[31878]: audit 2021-03-10T20:46:39.805939+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:41.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:41 gibba004 bash[30897]: cephadm 2021-03-10T20:46:40.290431+0000 mgr.gibba009.xiladd (mgr.34457) 1951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:41 gibba004 bash[31878]: cephadm 2021-03-10T20:46:40.290431+0000 mgr.gibba009.xiladd (mgr.34457) 1951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:41 gibba009 bash[26136]: cephadm 2021-03-10T20:46:40.290431+0000 mgr.gibba009.xiladd (mgr.34457) 1951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:42 gibba004 bash[30897]: cluster 2021-03-10T20:46:41.593124+0000 mgr.gibba009.xiladd (mgr.34457) 1952 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:42 gibba004 bash[31878]: cluster 2021-03-10T20:46:41.593124+0000 mgr.gibba009.xiladd (mgr.34457) 1952 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:42.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:42 gibba009 bash[26136]: cluster 2021-03-10T20:46:41.593124+0000 mgr.gibba009.xiladd (mgr.34457) 1952 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:44 gibba004 bash[30897]: cluster 2021-03-10T20:46:43.593864+0000 mgr.gibba009.xiladd (mgr.34457) 1953 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:44 gibba004 bash[31878]: cluster 2021-03-10T20:46:43.593864+0000 mgr.gibba009.xiladd (mgr.34457) 1953 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:44 gibba009 bash[26136]: cluster 2021-03-10T20:46:43.593864+0000 mgr.gibba009.xiladd (mgr.34457) 1953 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:45.538 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:46:45.768 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:46:46.176 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (35m) 84s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:46:46.176 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (40m) 20s ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:46:46.176 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (36m) 20s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:46:46.177 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (36m) 20s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:46:46.177 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (35m) 84s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:46:46.177 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (35m) 84s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:46:46.177 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (34m) 20s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:46:46.177 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (34m) 84s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:46:46.178 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (41m) 84s ago 41m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:46:46.178 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (41m) 20s ago 41m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:46:46.178 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (34m) 84s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:46:46.178 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (33m) 84s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:46:46.179 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (33m) 84s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:46:46.179 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (32m) 84s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:46:46.179 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (32m) 20s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:46:46.179 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (31m) 20s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:46:46.179 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (31m) 20s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:46:46.180 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (31m) 20s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:46:46.180 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (40m) 20s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:46:46.180 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 84s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:46.180 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 20s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:46.181 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:46:46.182 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:46:46.182 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:46.182 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:46.182 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:46:46.182 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:46.183 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:46.183 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:46:46.183 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:46:46.183 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:46:46.184 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:46:46.184 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:46:46.184 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:46:46.184 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:46:46.184 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:46:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[30897]: audit 2021-03-10T20:46:45.528808+0000 mgr.gibba009.xiladd (mgr.34457) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[30897]: cluster 2021-03-10T20:46:45.595237+0000 mgr.gibba009.xiladd (mgr.34457) 1955 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:47.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[30897]: audit 2021-03-10T20:46:46.014485+0000 mon.c (mon.1) 607 : audit [DBG] from='client.? 172.21.2.104:0/4143787316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:47.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[31878]: audit 2021-03-10T20:46:45.528808+0000 mgr.gibba009.xiladd (mgr.34457) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:47.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[31878]: cluster 2021-03-10T20:46:45.595237+0000 mgr.gibba009.xiladd (mgr.34457) 1955 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:47.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:46 gibba004 bash[31878]: audit 2021-03-10T20:46:46.014485+0000 mon.c (mon.1) 607 : audit [DBG] from='client.? 172.21.2.104:0/4143787316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:46 gibba009 bash[26136]: audit 2021-03-10T20:46:45.528808+0000 mgr.gibba009.xiladd (mgr.34457) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:46 gibba009 bash[26136]: cluster 2021-03-10T20:46:45.595237+0000 mgr.gibba009.xiladd (mgr.34457) 1955 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:46 gibba009 bash[26136]: audit 2021-03-10T20:46:46.014485+0000 mon.c (mon.1) 607 : audit [DBG] from='client.? 172.21.2.104:0/4143787316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:47 gibba004 bash[30897]: audit 2021-03-10T20:46:45.754522+0000 mgr.gibba009.xiladd (mgr.34457) 1956 : audit [DBG] from='client.45378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:48.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:47 gibba004 bash[31878]: audit 2021-03-10T20:46:45.754522+0000 mgr.gibba009.xiladd (mgr.34457) 1956 : audit [DBG] from='client.45378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:47 gibba009 bash[26136]: audit 2021-03-10T20:46:45.754522+0000 mgr.gibba009.xiladd (mgr.34457) 1956 : audit [DBG] from='client.45378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:48 gibba004 bash[30897]: cluster 2021-03-10T20:46:47.596953+0000 mgr.gibba009.xiladd (mgr.34457) 1957 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:49.216 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:48 gibba004 bash[31878]: cluster 2021-03-10T20:46:47.596953+0000 mgr.gibba009.xiladd (mgr.34457) 1957 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:49.217 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:48 gibba009 bash[26136]: cluster 2021-03-10T20:46:47.596953+0000 mgr.gibba009.xiladd (mgr.34457) 1957 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:50 gibba004 bash[30897]: cluster 2021-03-10T20:46:49.597562+0000 mgr.gibba009.xiladd (mgr.34457) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:50 gibba004 bash[31878]: cluster 2021-03-10T20:46:49.597562+0000 mgr.gibba009.xiladd (mgr.34457) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:50 gibba009 bash[26136]: cluster 2021-03-10T20:46:49.597562+0000 mgr.gibba009.xiladd (mgr.34457) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:53.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:52 gibba004 bash[30897]: cluster 2021-03-10T20:46:51.598925+0000 mgr.gibba009.xiladd (mgr.34457) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:53.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:52 gibba004 bash[31878]: cluster 2021-03-10T20:46:51.598925+0000 mgr.gibba009.xiladd (mgr.34457) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:53.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:52 gibba009 bash[26136]: cluster 2021-03-10T20:46:51.598925+0000 mgr.gibba009.xiladd (mgr.34457) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:54 gibba004 bash[30897]: cluster 2021-03-10T20:46:53.600567+0000 mgr.gibba009.xiladd (mgr.34457) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:54 gibba004 bash[31878]: cluster 2021-03-10T20:46:53.600567+0000 mgr.gibba009.xiladd (mgr.34457) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:55.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:54 gibba009 bash[26136]: cluster 2021-03-10T20:46:53.600567+0000 mgr.gibba009.xiladd (mgr.34457) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:56 gibba004 bash[30897]: cephadm 2021-03-10T20:46:55.306493+0000 mgr.gibba009.xiladd (mgr.34457) 1961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:57.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:56 gibba004 bash[30897]: cluster 2021-03-10T20:46:55.601195+0000 mgr.gibba009.xiladd (mgr.34457) 1962 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:56 gibba004 bash[31878]: cephadm 2021-03-10T20:46:55.306493+0000 mgr.gibba009.xiladd (mgr.34457) 1961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:56 gibba004 bash[31878]: cluster 2021-03-10T20:46:55.601195+0000 mgr.gibba009.xiladd (mgr.34457) 1962 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:56 gibba009 bash[26136]: cephadm 2021-03-10T20:46:55.306493+0000 mgr.gibba009.xiladd (mgr.34457) 1961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:46:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:56 gibba009 bash[26136]: cluster 2021-03-10T20:46:55.601195+0000 mgr.gibba009.xiladd (mgr.34457) 1962 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:46:58 gibba004 bash[30897]: cluster 2021-03-10T20:46:57.602467+0000 mgr.gibba009.xiladd (mgr.34457) 1963 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:46:58 gibba004 bash[31878]: cluster 2021-03-10T20:46:57.602467+0000 mgr.gibba009.xiladd (mgr.34457) 1963 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:59.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:46:58 gibba009 bash[26136]: cluster 2021-03-10T20:46:57.602467+0000 mgr.gibba009.xiladd (mgr.34457) 1963 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:00 gibba004 bash[30897]: cluster 2021-03-10T20:46:59.603708+0000 mgr.gibba009.xiladd (mgr.34457) 1964 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:00 gibba004 bash[31878]: cluster 2021-03-10T20:46:59.603708+0000 mgr.gibba009.xiladd (mgr.34457) 1964 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:00 gibba009 bash[26136]: cluster 2021-03-10T20:46:59.603708+0000 mgr.gibba009.xiladd (mgr.34457) 1964 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:03.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:02 gibba004 bash[30897]: cluster 2021-03-10T20:47:01.604675+0000 mgr.gibba009.xiladd (mgr.34457) 1965 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:03.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:02 gibba004 bash[31878]: cluster 2021-03-10T20:47:01.604675+0000 mgr.gibba009.xiladd (mgr.34457) 1965 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:03.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:02 gibba009 bash[26136]: cluster 2021-03-10T20:47:01.604675+0000 mgr.gibba009.xiladd (mgr.34457) 1965 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:04 gibba004 bash[30897]: cluster 2021-03-10T20:47:03.606220+0000 mgr.gibba009.xiladd (mgr.34457) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:04 gibba004 bash[31878]: cluster 2021-03-10T20:47:03.606220+0000 mgr.gibba009.xiladd (mgr.34457) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:04 gibba009 bash[26136]: cluster 2021-03-10T20:47:03.606220+0000 mgr.gibba009.xiladd (mgr.34457) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:06 gibba004 bash[30897]: cluster 2021-03-10T20:47:05.608010+0000 mgr.gibba009.xiladd (mgr.34457) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:06 gibba004 bash[31878]: cluster 2021-03-10T20:47:05.608010+0000 mgr.gibba009.xiladd (mgr.34457) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:07.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:06 gibba009 bash[26136]: cluster 2021-03-10T20:47:05.608010+0000 mgr.gibba009.xiladd (mgr.34457) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:09.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:08 gibba004 bash[30897]: cluster 2021-03-10T20:47:07.608935+0000 mgr.gibba009.xiladd (mgr.34457) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:08 gibba004 bash[31878]: cluster 2021-03-10T20:47:07.608935+0000 mgr.gibba009.xiladd (mgr.34457) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:09.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:08 gibba009 bash[26136]: cluster 2021-03-10T20:47:07.608935+0000 mgr.gibba009.xiladd (mgr.34457) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:10.587 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:10 gibba009 bash[26136]: cluster 2021-03-10T20:47:09.610207+0000 mgr.gibba009.xiladd (mgr.34457) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:10 gibba004 bash[30897]: cluster 2021-03-10T20:47:09.610207+0000 mgr.gibba009.xiladd (mgr.34457) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:10 gibba004 bash[31878]: cluster 2021-03-10T20:47:09.610207+0000 mgr.gibba009.xiladd (mgr.34457) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:11 gibba004 bash[31878]: cephadm 2021-03-10T20:47:10.317393+0000 mgr.gibba009.xiladd (mgr.34457) 1970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:11.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:11 gibba004 bash[30897]: cephadm 2021-03-10T20:47:10.317393+0000 mgr.gibba009.xiladd (mgr.34457) 1970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:11.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:11 gibba009 bash[26136]: cephadm 2021-03-10T20:47:10.317393+0000 mgr.gibba009.xiladd (mgr.34457) 1970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:12.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:12 gibba004 bash[30897]: cluster 2021-03-10T20:47:11.611869+0000 mgr.gibba009.xiladd (mgr.34457) 1971 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:12.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:12 gibba004 bash[31878]: cluster 2021-03-10T20:47:11.611869+0000 mgr.gibba009.xiladd (mgr.34457) 1971 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:12 gibba009 bash[26136]: cluster 2021-03-10T20:47:11.611869+0000 mgr.gibba009.xiladd (mgr.34457) 1971 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:15.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:14 gibba004 bash[30897]: cluster 2021-03-10T20:47:13.613591+0000 mgr.gibba009.xiladd (mgr.34457) 1972 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:15.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:14 gibba004 bash[31878]: cluster 2021-03-10T20:47:13.613591+0000 mgr.gibba009.xiladd (mgr.34457) 1972 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:15.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:14 gibba009 bash[26136]: cluster 2021-03-10T20:47:13.613591+0000 mgr.gibba009.xiladd (mgr.34457) 1972 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:16.261 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:47:16.488 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:47:16.488 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (36m) 115s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:47:16.488 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (41m) 51s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:47:16.489 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (36m) 51s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:47:16.489 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (36m) 51s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:47:16.489 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (35m) 115s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:47:16.489 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (35m) 115s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:47:16.490 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (35m) 51s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:47:16.490 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (35m) 115s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:47:16.490 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (41m) 115s ago 41m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:47:16.490 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (41m) 51s ago 41m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:47:16.491 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (34m) 115s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:47:16.491 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (34m) 115s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:47:16.491 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (33m) 115s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:47:16.491 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (33m) 115s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:47:16.492 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (32m) 51s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:47:16.492 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (32m) 51s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:47:16.492 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (32m) 51s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:47:16.493 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (31m) 51s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:47:16.493 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (41m) 51s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:47:16.493 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 115s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:16.493 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 51s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:16.749 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:47:16.749 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:47:16.750 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:16.750 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:16.750 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:47:16.750 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:16.751 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:16.751 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:47:16.751 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:47:16.751 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:16.751 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:47:16.752 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:47:16.752 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:47:16.752 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:47:16.752 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:47:17.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:16 gibba004 bash[30897]: cluster 2021-03-10T20:47:15.615381+0000 mgr.gibba009.xiladd (mgr.34457) 1973 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:17.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:16 gibba004 bash[31878]: cluster 2021-03-10T20:47:15.615381+0000 mgr.gibba009.xiladd (mgr.34457) 1973 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:17.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:16 gibba009 bash[26136]: cluster 2021-03-10T20:47:15.615381+0000 mgr.gibba009.xiladd (mgr.34457) 1973 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[30897]: audit 2021-03-10T20:47:16.250898+0000 mgr.gibba009.xiladd (mgr.34457) 1974 : audit [DBG] from='client.45390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[30897]: audit 2021-03-10T20:47:16.473679+0000 mgr.gibba009.xiladd (mgr.34457) 1975 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[30897]: audit 2021-03-10T20:47:16.749347+0000 mon.c (mon.1) 608 : audit [DBG] from='client.? 172.21.2.104:0/3939945034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[31878]: audit 2021-03-10T20:47:16.250898+0000 mgr.gibba009.xiladd (mgr.34457) 1974 : audit [DBG] from='client.45390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[31878]: audit 2021-03-10T20:47:16.473679+0000 mgr.gibba009.xiladd (mgr.34457) 1975 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:17 gibba004 bash[31878]: audit 2021-03-10T20:47:16.749347+0000 mon.c (mon.1) 608 : audit [DBG] from='client.? 172.21.2.104:0/3939945034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:17 gibba009 bash[26136]: audit 2021-03-10T20:47:16.250898+0000 mgr.gibba009.xiladd (mgr.34457) 1974 : audit [DBG] from='client.45390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:17 gibba009 bash[26136]: audit 2021-03-10T20:47:16.473679+0000 mgr.gibba009.xiladd (mgr.34457) 1975 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:18.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:17 gibba009 bash[26136]: audit 2021-03-10T20:47:16.749347+0000 mon.c (mon.1) 608 : audit [DBG] from='client.? 172.21.2.104:0/3939945034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:18 gibba004 bash[30897]: cluster 2021-03-10T20:47:17.616931+0000 mgr.gibba009.xiladd (mgr.34457) 1976 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:19.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:18 gibba004 bash[31878]: cluster 2021-03-10T20:47:17.616931+0000 mgr.gibba009.xiladd (mgr.34457) 1976 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:19.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:18 gibba009 bash[26136]: cluster 2021-03-10T20:47:17.616931+0000 mgr.gibba009.xiladd (mgr.34457) 1976 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:20 gibba004 bash[30897]: cluster 2021-03-10T20:47:19.617525+0000 mgr.gibba009.xiladd (mgr.34457) 1977 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:20 gibba004 bash[31878]: cluster 2021-03-10T20:47:19.617525+0000 mgr.gibba009.xiladd (mgr.34457) 1977 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:20 gibba009 bash[26136]: cluster 2021-03-10T20:47:19.617525+0000 mgr.gibba009.xiladd (mgr.34457) 1977 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:23.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:22 gibba004 bash[30897]: cluster 2021-03-10T20:47:21.619002+0000 mgr.gibba009.xiladd (mgr.34457) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:23.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:22 gibba004 bash[31878]: cluster 2021-03-10T20:47:21.619002+0000 mgr.gibba009.xiladd (mgr.34457) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:23.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:22 gibba009 bash[26136]: cluster 2021-03-10T20:47:21.619002+0000 mgr.gibba009.xiladd (mgr.34457) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:25.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:24 gibba004 bash[30897]: cluster 2021-03-10T20:47:23.620681+0000 mgr.gibba009.xiladd (mgr.34457) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:25.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:24 gibba004 bash[31878]: cluster 2021-03-10T20:47:23.620681+0000 mgr.gibba009.xiladd (mgr.34457) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:25.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:24 gibba009 bash[26136]: cluster 2021-03-10T20:47:23.620681+0000 mgr.gibba009.xiladd (mgr.34457) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:25.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.335288+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:25.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.545591+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:47:25.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.549229+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:25.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.550414+0000 mon.c (mon.1) 611 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:25.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.551606+0000 mon.c (mon.1) 612 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:25.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.552828+0000 mon.c (mon.1) 613 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:25.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.555944+0000 mon.c (mon.1) 614 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:25.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:25 gibba009 bash[26136]: audit 2021-03-10T20:47:25.557232+0000 mon.c (mon.1) 615 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.335288+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.545591+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:47:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.549229+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.550414+0000 mon.c (mon.1) 611 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.551606+0000 mon.c (mon.1) 612 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.552828+0000 mon.c (mon.1) 613 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.555944+0000 mon.c (mon.1) 614 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[30897]: audit 2021-03-10T20:47:25.557232+0000 mon.c (mon.1) 615 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.335288+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.545591+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:47:26.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.549229+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:26.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.550414+0000 mon.c (mon.1) 611 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.551606+0000 mon.c (mon.1) 612 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.552828+0000 mon.c (mon.1) 613 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.555944+0000 mon.c (mon.1) 614 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:26.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:25 gibba004 bash[31878]: audit 2021-03-10T20:47:25.557232+0000 mon.c (mon.1) 615 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.339997+0000 mgr.gibba009.xiladd (mgr.34457) 1980 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:47:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.341765+0000 mgr.gibba009.xiladd (mgr.34457) 1981 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:47:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.547464+0000 mgr.gibba009.xiladd (mgr.34457) 1982 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.549062+0000 mgr.gibba009.xiladd (mgr.34457) 1983 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.550032+0000 mgr.gibba009.xiladd (mgr.34457) 1984 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.550072+0000 mgr.gibba009.xiladd (mgr.34457) 1985 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.551308+0000 mgr.gibba009.xiladd (mgr.34457) 1986 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.551348+0000 mgr.gibba009.xiladd (mgr.34457) 1987 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.552741+0000 mgr.gibba009.xiladd (mgr.34457) 1988 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.554454+0000 mgr.gibba009.xiladd (mgr.34457) 1989 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.554491+0000 mgr.gibba009.xiladd (mgr.34457) 1990 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.555617+0000 mgr.gibba009.xiladd (mgr.34457) 1991 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.555944+0000 mgr.gibba009.xiladd (mgr.34457) 1992 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.556873+0000 mgr.gibba009.xiladd (mgr.34457) 1993 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.556914+0000 mgr.gibba009.xiladd (mgr.34457) 1994 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cephadm 2021-03-10T20:47:25.557042+0000 mgr.gibba009.xiladd (mgr.34457) 1995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:27.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[30897]: cluster 2021-03-10T20:47:25.622179+0000 mgr.gibba009.xiladd (mgr.34457) 1996 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:27.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.339997+0000 mgr.gibba009.xiladd (mgr.34457) 1980 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:47:27.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.341765+0000 mgr.gibba009.xiladd (mgr.34457) 1981 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:47:27.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.547464+0000 mgr.gibba009.xiladd (mgr.34457) 1982 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:27.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.549062+0000 mgr.gibba009.xiladd (mgr.34457) 1983 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:27.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.550032+0000 mgr.gibba009.xiladd (mgr.34457) 1984 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:27.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.550072+0000 mgr.gibba009.xiladd (mgr.34457) 1985 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:27.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.551308+0000 mgr.gibba009.xiladd (mgr.34457) 1986 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:27.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.551348+0000 mgr.gibba009.xiladd (mgr.34457) 1987 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:27.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.552741+0000 mgr.gibba009.xiladd (mgr.34457) 1988 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:27.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.554454+0000 mgr.gibba009.xiladd (mgr.34457) 1989 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:27.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.554491+0000 mgr.gibba009.xiladd (mgr.34457) 1990 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:27.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.555617+0000 mgr.gibba009.xiladd (mgr.34457) 1991 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:27.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.555944+0000 mgr.gibba009.xiladd (mgr.34457) 1992 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:27.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.556873+0000 mgr.gibba009.xiladd (mgr.34457) 1993 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:27.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.556914+0000 mgr.gibba009.xiladd (mgr.34457) 1994 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:27.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cephadm 2021-03-10T20:47:25.557042+0000 mgr.gibba009.xiladd (mgr.34457) 1995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:27.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:26 gibba004 bash[31878]: cluster 2021-03-10T20:47:25.622179+0000 mgr.gibba009.xiladd (mgr.34457) 1996 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:27.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.339997+0000 mgr.gibba009.xiladd (mgr.34457) 1980 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:47:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.341765+0000 mgr.gibba009.xiladd (mgr.34457) 1981 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:47:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.547464+0000 mgr.gibba009.xiladd (mgr.34457) 1982 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.549062+0000 mgr.gibba009.xiladd (mgr.34457) 1983 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.550032+0000 mgr.gibba009.xiladd (mgr.34457) 1984 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.550072+0000 mgr.gibba009.xiladd (mgr.34457) 1985 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.551308+0000 mgr.gibba009.xiladd (mgr.34457) 1986 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.551348+0000 mgr.gibba009.xiladd (mgr.34457) 1987 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.552741+0000 mgr.gibba009.xiladd (mgr.34457) 1988 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.554454+0000 mgr.gibba009.xiladd (mgr.34457) 1989 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.554491+0000 mgr.gibba009.xiladd (mgr.34457) 1990 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.555617+0000 mgr.gibba009.xiladd (mgr.34457) 1991 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.555944+0000 mgr.gibba009.xiladd (mgr.34457) 1992 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.556873+0000 mgr.gibba009.xiladd (mgr.34457) 1993 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.556914+0000 mgr.gibba009.xiladd (mgr.34457) 1994 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cephadm 2021-03-10T20:47:25.557042+0000 mgr.gibba009.xiladd (mgr.34457) 1995 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:26 gibba009 bash[26136]: cluster 2021-03-10T20:47:25.622179+0000 mgr.gibba009.xiladd (mgr.34457) 1996 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:29.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:28 gibba004 bash[30897]: cluster 2021-03-10T20:47:27.623609+0000 mgr.gibba009.xiladd (mgr.34457) 1997 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:28 gibba004 bash[31878]: cluster 2021-03-10T20:47:27.623609+0000 mgr.gibba009.xiladd (mgr.34457) 1997 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:28 gibba009 bash[26136]: cluster 2021-03-10T20:47:27.623609+0000 mgr.gibba009.xiladd (mgr.34457) 1997 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:30 gibba004 bash[30897]: cluster 2021-03-10T20:47:29.624872+0000 mgr.gibba009.xiladd (mgr.34457) 1998 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:30 gibba004 bash[31878]: cluster 2021-03-10T20:47:29.624872+0000 mgr.gibba009.xiladd (mgr.34457) 1998 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:30 gibba009 bash[26136]: cluster 2021-03-10T20:47:29.624872+0000 mgr.gibba009.xiladd (mgr.34457) 1998 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:33.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:32 gibba004 bash[30897]: cluster 2021-03-10T20:47:31.626659+0000 mgr.gibba009.xiladd (mgr.34457) 1999 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:33.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:32 gibba004 bash[31878]: cluster 2021-03-10T20:47:31.626659+0000 mgr.gibba009.xiladd (mgr.34457) 1999 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:33.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:32 gibba009 bash[26136]: cluster 2021-03-10T20:47:31.626659+0000 mgr.gibba009.xiladd (mgr.34457) 1999 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:35.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:34 gibba004 bash[30897]: cluster 2021-03-10T20:47:33.628363+0000 mgr.gibba009.xiladd (mgr.34457) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:34 gibba004 bash[31878]: cluster 2021-03-10T20:47:33.628363+0000 mgr.gibba009.xiladd (mgr.34457) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:35.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:34 gibba009 bash[26136]: cluster 2021-03-10T20:47:33.628363+0000 mgr.gibba009.xiladd (mgr.34457) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:36 gibba004 bash[30897]: cluster 2021-03-10T20:47:35.630190+0000 mgr.gibba009.xiladd (mgr.34457) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:36 gibba004 bash[31878]: cluster 2021-03-10T20:47:35.630190+0000 mgr.gibba009.xiladd (mgr.34457) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:37.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:36 gibba009 bash[26136]: cluster 2021-03-10T20:47:35.630190+0000 mgr.gibba009.xiladd (mgr.34457) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:39.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:38 gibba004 bash[30897]: cluster 2021-03-10T20:47:37.631027+0000 mgr.gibba009.xiladd (mgr.34457) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:39.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:38 gibba004 bash[31878]: cluster 2021-03-10T20:47:37.631027+0000 mgr.gibba009.xiladd (mgr.34457) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:39.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:38 gibba009 bash[26136]: cluster 2021-03-10T20:47:37.631027+0000 mgr.gibba009.xiladd (mgr.34457) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: cluster 2021-03-10T20:47:39.632345+0000 mgr.gibba009.xiladd (mgr.34457) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.802276+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.803738+0000 mon.c (mon.1) 617 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.804133+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.804832+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.809071+0000 mon.c (mon.1) 618 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.809976+0000 mon.c (mon.1) 619 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.810080+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.810904+0000 mon.c (mon.1) 620 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.811118+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.812080+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.812406+0000 mon.c (mon.1) 621 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[30897]: audit 2021-03-10T20:47:39.813480+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:40.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: cluster 2021-03-10T20:47:39.632345+0000 mgr.gibba009.xiladd (mgr.34457) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.802276+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.803738+0000 mon.c (mon.1) 617 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.804133+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.804832+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.809071+0000 mon.c (mon.1) 618 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.809976+0000 mon.c (mon.1) 619 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.810080+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.810904+0000 mon.c (mon.1) 620 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.811118+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.812080+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.812406+0000 mon.c (mon.1) 621 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:40 gibba004 bash[31878]: audit 2021-03-10T20:47:39.813480+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: cluster 2021-03-10T20:47:39.632345+0000 mgr.gibba009.xiladd (mgr.34457) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.802276+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.803738+0000 mon.c (mon.1) 617 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.804133+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:40.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.804832+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.809071+0000 mon.c (mon.1) 618 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.809976+0000 mon.c (mon.1) 619 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.810080+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:47:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.810904+0000 mon.c (mon.1) 620 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.811118+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.812080+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:47:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.812406+0000 mon.c (mon.1) 621 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:40 gibba009 bash[26136]: audit 2021-03-10T20:47:39.813480+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T20:47:41.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:41 gibba004 bash[30897]: cephadm 2021-03-10T20:47:40.572506+0000 mgr.gibba009.xiladd (mgr.34457) 2004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:41.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:41 gibba004 bash[31878]: cephadm 2021-03-10T20:47:40.572506+0000 mgr.gibba009.xiladd (mgr.34457) 2004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:41.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:41 gibba009 bash[26136]: cephadm 2021-03-10T20:47:40.572506+0000 mgr.gibba009.xiladd (mgr.34457) 2004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:42.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:42 gibba004 bash[30897]: cluster 2021-03-10T20:47:41.633979+0000 mgr.gibba009.xiladd (mgr.34457) 2005 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:42.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:42 gibba004 bash[31878]: cluster 2021-03-10T20:47:41.633979+0000 mgr.gibba009.xiladd (mgr.34457) 2005 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:42.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:42 gibba009 bash[26136]: cluster 2021-03-10T20:47:41.633979+0000 mgr.gibba009.xiladd (mgr.34457) 2005 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:44 gibba004 bash[30897]: cluster 2021-03-10T20:47:43.635074+0000 mgr.gibba009.xiladd (mgr.34457) 2006 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:44 gibba004 bash[31878]: cluster 2021-03-10T20:47:43.635074+0000 mgr.gibba009.xiladd (mgr.34457) 2006 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:45.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:44 gibba009 bash[26136]: cluster 2021-03-10T20:47:43.635074+0000 mgr.gibba009.xiladd (mgr.34457) 2006 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:46.998 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:47:47.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:46 gibba004 bash[30897]: cluster 2021-03-10T20:47:45.636468+0000 mgr.gibba009.xiladd (mgr.34457) 2007 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:47.062 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:46 gibba004 bash[31878]: cluster 2021-03-10T20:47:45.636468+0000 mgr.gibba009.xiladd (mgr.34457) 2007 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:47.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:46 gibba009 bash[26136]: cluster 2021-03-10T20:47:45.636468+0000 mgr.gibba009.xiladd (mgr.34457) 2007 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:47.228 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:47:47.229 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (36m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:47:47.229 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (41m) 82s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:47:47.229 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (37m) 82s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:47:47.229 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (37m) 82s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:47:47.230 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:47:47.230 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:47:47.230 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (35m) 82s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:47:47.230 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:47:47.231 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:47:47.231 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (42m) 82s ago 42m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:47:47.231 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:47:47.231 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:47:47.231 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:47:47.232 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:47:47.232 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (33m) 82s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:47:47.232 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (32m) 82s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:47:47.232 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (32m) 82s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:47:47.233 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (32m) 82s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:47:47.233 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (41m) 82s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:47:47.233 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:47.233 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 82s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:47.477 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:47:47.477 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:47:47.477 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:47.478 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:47.478 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:47:47.478 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:47.478 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:47.479 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:47:47.479 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:47:47.479 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:47:47.479 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:47:47.480 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:47:47.480 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:47:47.480 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:47:47.480 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:47:48.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:47 gibba004 bash[30897]: audit 2021-03-10T20:47:47.476944+0000 mon.c (mon.1) 622 : audit [DBG] from='client.? 172.21.2.104:0/4245020865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:48.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:47 gibba004 bash[31878]: audit 2021-03-10T20:47:47.476944+0000 mon.c (mon.1) 622 : audit [DBG] from='client.? 172.21.2.104:0/4245020865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:47 gibba009 bash[26136]: audit 2021-03-10T20:47:47.476944+0000 mon.c (mon.1) 622 : audit [DBG] from='client.? 172.21.2.104:0/4245020865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[30897]: audit 2021-03-10T20:47:46.988069+0000 mgr.gibba009.xiladd (mgr.34457) 2008 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[30897]: audit 2021-03-10T20:47:47.214879+0000 mgr.gibba009.xiladd (mgr.34457) 2009 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[30897]: cluster 2021-03-10T20:47:47.638119+0000 mgr.gibba009.xiladd (mgr.34457) 2010 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[31878]: audit 2021-03-10T20:47:46.988069+0000 mgr.gibba009.xiladd (mgr.34457) 2008 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[31878]: audit 2021-03-10T20:47:47.214879+0000 mgr.gibba009.xiladd (mgr.34457) 2009 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:48 gibba004 bash[31878]: cluster 2021-03-10T20:47:47.638119+0000 mgr.gibba009.xiladd (mgr.34457) 2010 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:48 gibba009 bash[26136]: audit 2021-03-10T20:47:46.988069+0000 mgr.gibba009.xiladd (mgr.34457) 2008 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:48 gibba009 bash[26136]: audit 2021-03-10T20:47:47.214879+0000 mgr.gibba009.xiladd (mgr.34457) 2009 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:48 gibba009 bash[26136]: cluster 2021-03-10T20:47:47.638119+0000 mgr.gibba009.xiladd (mgr.34457) 2010 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:50 gibba004 bash[30897]: cluster 2021-03-10T20:47:49.639105+0000 mgr.gibba009.xiladd (mgr.34457) 2011 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:50 gibba004 bash[31878]: cluster 2021-03-10T20:47:49.639105+0000 mgr.gibba009.xiladd (mgr.34457) 2011 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:50 gibba009 bash[26136]: cluster 2021-03-10T20:47:49.639105+0000 mgr.gibba009.xiladd (mgr.34457) 2011 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:53.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:52 gibba004 bash[30897]: cluster 2021-03-10T20:47:51.640774+0000 mgr.gibba009.xiladd (mgr.34457) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:53.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:52 gibba004 bash[31878]: cluster 2021-03-10T20:47:51.640774+0000 mgr.gibba009.xiladd (mgr.34457) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:53.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:52 gibba009 bash[26136]: cluster 2021-03-10T20:47:51.640774+0000 mgr.gibba009.xiladd (mgr.34457) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:55.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:54 gibba004 bash[30897]: cluster 2021-03-10T20:47:53.642495+0000 mgr.gibba009.xiladd (mgr.34457) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:55.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:54 gibba004 bash[31878]: cluster 2021-03-10T20:47:53.642495+0000 mgr.gibba009.xiladd (mgr.34457) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:55.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:54 gibba009 bash[26136]: cluster 2021-03-10T20:47:53.642495+0000 mgr.gibba009.xiladd (mgr.34457) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:56 gibba004 bash[30897]: cephadm 2021-03-10T20:47:55.588033+0000 mgr.gibba009.xiladd (mgr.34457) 2014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:57.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:56 gibba004 bash[30897]: cluster 2021-03-10T20:47:55.643707+0000 mgr.gibba009.xiladd (mgr.34457) 2015 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:56 gibba004 bash[31878]: cephadm 2021-03-10T20:47:55.588033+0000 mgr.gibba009.xiladd (mgr.34457) 2014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:56 gibba004 bash[31878]: cluster 2021-03-10T20:47:55.643707+0000 mgr.gibba009.xiladd (mgr.34457) 2015 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:56 gibba009 bash[26136]: cephadm 2021-03-10T20:47:55.588033+0000 mgr.gibba009.xiladd (mgr.34457) 2014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:47:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:56 gibba009 bash[26136]: cluster 2021-03-10T20:47:55.643707+0000 mgr.gibba009.xiladd (mgr.34457) 2015 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:47:58 gibba004 bash[30897]: cluster 2021-03-10T20:47:57.645269+0000 mgr.gibba009.xiladd (mgr.34457) 2016 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:47:58 gibba004 bash[31878]: cluster 2021-03-10T20:47:57.645269+0000 mgr.gibba009.xiladd (mgr.34457) 2016 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:59.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:47:58 gibba009 bash[26136]: cluster 2021-03-10T20:47:57.645269+0000 mgr.gibba009.xiladd (mgr.34457) 2016 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:00 gibba004 bash[30897]: cluster 2021-03-10T20:47:59.646572+0000 mgr.gibba009.xiladd (mgr.34457) 2017 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:00 gibba004 bash[31878]: cluster 2021-03-10T20:47:59.646572+0000 mgr.gibba009.xiladd (mgr.34457) 2017 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:00 gibba009 bash[26136]: cluster 2021-03-10T20:47:59.646572+0000 mgr.gibba009.xiladd (mgr.34457) 2017 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:03.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:02 gibba004 bash[30897]: cluster 2021-03-10T20:48:01.647627+0000 mgr.gibba009.xiladd (mgr.34457) 2018 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:03.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:02 gibba004 bash[31878]: cluster 2021-03-10T20:48:01.647627+0000 mgr.gibba009.xiladd (mgr.34457) 2018 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:03.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:02 gibba009 bash[26136]: cluster 2021-03-10T20:48:01.647627+0000 mgr.gibba009.xiladd (mgr.34457) 2018 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:05.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:04 gibba004 bash[30897]: cluster 2021-03-10T20:48:03.648994+0000 mgr.gibba009.xiladd (mgr.34457) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:05.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:04 gibba004 bash[31878]: cluster 2021-03-10T20:48:03.648994+0000 mgr.gibba009.xiladd (mgr.34457) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:05.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:04 gibba009 bash[26136]: cluster 2021-03-10T20:48:03.648994+0000 mgr.gibba009.xiladd (mgr.34457) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:06 gibba004 bash[30897]: cluster 2021-03-10T20:48:05.650804+0000 mgr.gibba009.xiladd (mgr.34457) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:06 gibba004 bash[31878]: cluster 2021-03-10T20:48:05.650804+0000 mgr.gibba009.xiladd (mgr.34457) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:07.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:06 gibba009 bash[26136]: cluster 2021-03-10T20:48:05.650804+0000 mgr.gibba009.xiladd (mgr.34457) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:09.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:08 gibba004 bash[30897]: cluster 2021-03-10T20:48:07.652073+0000 mgr.gibba009.xiladd (mgr.34457) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:09.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:08 gibba004 bash[31878]: cluster 2021-03-10T20:48:07.652073+0000 mgr.gibba009.xiladd (mgr.34457) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:09.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:08 gibba009 bash[26136]: cluster 2021-03-10T20:48:07.652073+0000 mgr.gibba009.xiladd (mgr.34457) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:10 gibba004 bash[30897]: cluster 2021-03-10T20:48:09.653364+0000 mgr.gibba009.xiladd (mgr.34457) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:10 gibba004 bash[31878]: cluster 2021-03-10T20:48:09.653364+0000 mgr.gibba009.xiladd (mgr.34457) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:10 gibba009 bash[26136]: cluster 2021-03-10T20:48:09.653364+0000 mgr.gibba009.xiladd (mgr.34457) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:11.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:11 gibba004 bash[30897]: cephadm 2021-03-10T20:48:10.588340+0000 mgr.gibba009.xiladd (mgr.34457) 2023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:11.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:11 gibba004 bash[31878]: cephadm 2021-03-10T20:48:10.588340+0000 mgr.gibba009.xiladd (mgr.34457) 2023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:11.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:11 gibba009 bash[26136]: cephadm 2021-03-10T20:48:10.588340+0000 mgr.gibba009.xiladd (mgr.34457) 2023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:12.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:12 gibba004 bash[30897]: cluster 2021-03-10T20:48:11.655086+0000 mgr.gibba009.xiladd (mgr.34457) 2024 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:12.814 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:12 gibba004 bash[31878]: cluster 2021-03-10T20:48:11.655086+0000 mgr.gibba009.xiladd (mgr.34457) 2024 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:12.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:12 gibba009 bash[26136]: cluster 2021-03-10T20:48:11.655086+0000 mgr.gibba009.xiladd (mgr.34457) 2024 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:15.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:14 gibba004 bash[30897]: cluster 2021-03-10T20:48:13.656397+0000 mgr.gibba009.xiladd (mgr.34457) 2025 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:15.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:14 gibba004 bash[31878]: cluster 2021-03-10T20:48:13.656397+0000 mgr.gibba009.xiladd (mgr.34457) 2025 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:15.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:14 gibba009 bash[26136]: cluster 2021-03-10T20:48:13.656397+0000 mgr.gibba009.xiladd (mgr.34457) 2025 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:17.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:16 gibba004 bash[30897]: cluster 2021-03-10T20:48:15.657998+0000 mgr.gibba009.xiladd (mgr.34457) 2026 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:17.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:16 gibba004 bash[31878]: cluster 2021-03-10T20:48:15.657998+0000 mgr.gibba009.xiladd (mgr.34457) 2026 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:17.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:16 gibba009 bash[26136]: cluster 2021-03-10T20:48:15.657998+0000 mgr.gibba009.xiladd (mgr.34457) 2026 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:17.719 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:48:17.948 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:48:17.948 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (37m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:48:17.949 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (42m) 112s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:48:17.949 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (37m) 112s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:48:17.949 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (37m) 112s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:48:17.949 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:48:17.950 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:48:17.950 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (36m) 112s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:48:17.950 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:48:17.950 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:48:17.951 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (42m) 112s ago 42m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:48:17.951 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:48:17.951 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:48:17.951 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:48:17.951 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:48:17.952 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (33m) 112s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:48:17.952 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (33m) 112s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:48:17.952 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (33m) 112s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:48:17.952 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (32m) 112s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:48:17.952 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (42m) 112s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:48:17.953 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:17.953 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 112s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:18.197 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:48:18.197 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:48:18.198 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:18.198 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:18.198 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:48:18.198 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:18.199 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:18.199 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:48:18.199 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:48:18.199 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:18.200 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:48:18.200 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:48:18.200 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:48:18.200 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:48:18.200 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:48:19.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[30897]: cluster 2021-03-10T20:48:17.659367+0000 mgr.gibba009.xiladd (mgr.34457) 2027 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:19.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[30897]: audit 2021-03-10T20:48:17.708820+0000 mgr.gibba009.xiladd (mgr.34457) 2028 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:19.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[30897]: audit 2021-03-10T20:48:18.197487+0000 mon.a (mon.0) 857 : audit [DBG] from='client.? 172.21.2.104:0/27588039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:19.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[31878]: cluster 2021-03-10T20:48:17.659367+0000 mgr.gibba009.xiladd (mgr.34457) 2027 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:19.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[31878]: audit 2021-03-10T20:48:17.708820+0000 mgr.gibba009.xiladd (mgr.34457) 2028 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:19.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:18 gibba004 bash[31878]: audit 2021-03-10T20:48:18.197487+0000 mon.a (mon.0) 857 : audit [DBG] from='client.? 172.21.2.104:0/27588039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:19.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:18 gibba009 bash[26136]: cluster 2021-03-10T20:48:17.659367+0000 mgr.gibba009.xiladd (mgr.34457) 2027 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:19.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:18 gibba009 bash[26136]: audit 2021-03-10T20:48:17.708820+0000 mgr.gibba009.xiladd (mgr.34457) 2028 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:19.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:18 gibba009 bash[26136]: audit 2021-03-10T20:48:18.197487+0000 mon.a (mon.0) 857 : audit [DBG] from='client.? 172.21.2.104:0/27588039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:19 gibba004 bash[30897]: audit 2021-03-10T20:48:17.934776+0000 mgr.gibba009.xiladd (mgr.34457) 2029 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:20.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:19 gibba004 bash[31878]: audit 2021-03-10T20:48:17.934776+0000 mgr.gibba009.xiladd (mgr.34457) 2029 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:20.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:19 gibba009 bash[26136]: audit 2021-03-10T20:48:17.934776+0000 mgr.gibba009.xiladd (mgr.34457) 2029 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:21.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:20 gibba004 bash[30897]: cluster 2021-03-10T20:48:19.660584+0000 mgr.gibba009.xiladd (mgr.34457) 2030 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:21.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:20 gibba004 bash[31878]: cluster 2021-03-10T20:48:19.660584+0000 mgr.gibba009.xiladd (mgr.34457) 2030 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:21.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:20 gibba009 bash[26136]: cluster 2021-03-10T20:48:19.660584+0000 mgr.gibba009.xiladd (mgr.34457) 2030 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:21 gibba004 bash[30897]: cluster 2021-03-10T20:48:21.662108+0000 mgr.gibba009.xiladd (mgr.34457) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:21 gibba004 bash[31878]: cluster 2021-03-10T20:48:21.662108+0000 mgr.gibba009.xiladd (mgr.34457) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:21 gibba009 bash[26136]: cluster 2021-03-10T20:48:21.662108+0000 mgr.gibba009.xiladd (mgr.34457) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:24 gibba004 bash[30897]: cluster 2021-03-10T20:48:23.663829+0000 mgr.gibba009.xiladd (mgr.34457) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:24 gibba004 bash[31878]: cluster 2021-03-10T20:48:23.663829+0000 mgr.gibba009.xiladd (mgr.34457) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:24 gibba009 bash[26136]: cluster 2021-03-10T20:48:23.663829+0000 mgr.gibba009.xiladd (mgr.34457) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:26.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:25 gibba004 bash[30897]: audit 2021-03-10T20:48:25.605756+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:26.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:25 gibba004 bash[31878]: audit 2021-03-10T20:48:25.605756+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:26.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:25 gibba009 bash[26136]: audit 2021-03-10T20:48:25.605756+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.607443+0000 mgr.gibba009.xiladd (mgr.34457) 2033 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:48:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.608029+0000 mgr.gibba009.xiladd (mgr.34457) 2034 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:48:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: cluster 2021-03-10T20:48:25.664346+0000 mgr.gibba009.xiladd (mgr.34457) 2035 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:27.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.821116+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:48:27.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.824949+0000 mon.c (mon.1) 624 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:27.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.826158+0000 mon.c (mon.1) 625 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.087 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.827530+0000 mon.c (mon.1) 626 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.092 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.828578+0000 mon.c (mon.1) 627 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.093 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.830726+0000 mon.c (mon.1) 628 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.096 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[30897]: audit 2021-03-10T20:48:25.832031+0000 mon.c (mon.1) 629 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.607443+0000 mgr.gibba009.xiladd (mgr.34457) 2033 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:48:27.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.608029+0000 mgr.gibba009.xiladd (mgr.34457) 2034 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:48:27.104 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: cluster 2021-03-10T20:48:25.664346+0000 mgr.gibba009.xiladd (mgr.34457) 2035 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:27.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.821116+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:48:27.106 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.824949+0000 mon.c (mon.1) 624 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:27.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.826158+0000 mon.c (mon.1) 625 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.827530+0000 mon.c (mon.1) 626 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.828578+0000 mon.c (mon.1) 627 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.830726+0000 mon.c (mon.1) 628 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.110 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:26 gibba004 bash[31878]: audit 2021-03-10T20:48:25.832031+0000 mon.c (mon.1) 629 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.112 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.607443+0000 mgr.gibba009.xiladd (mgr.34457) 2033 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:48:27.113 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.608029+0000 mgr.gibba009.xiladd (mgr.34457) 2034 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:48:27.114 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: cluster 2021-03-10T20:48:25.664346+0000 mgr.gibba009.xiladd (mgr.34457) 2035 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:27.114 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.821116+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:48:27.115 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.824949+0000 mon.c (mon.1) 624 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:27.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.826158+0000 mon.c (mon.1) 625 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.827530+0000 mon.c (mon.1) 626 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.120 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.828578+0000 mon.c (mon.1) 627 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.121 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.830726+0000 mon.c (mon.1) 628 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:27.121 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:26 gibba009 bash[26136]: audit 2021-03-10T20:48:25.832031+0000 mon.c (mon.1) 629 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:28.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.823209+0000 mgr.gibba009.xiladd (mgr.34457) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:28.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.824728+0000 mgr.gibba009.xiladd (mgr.34457) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:28.074 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.825841+0000 mgr.gibba009.xiladd (mgr.34457) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:28.075 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.825883+0000 mgr.gibba009.xiladd (mgr.34457) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:28.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.827203+0000 mgr.gibba009.xiladd (mgr.34457) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:28.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.827244+0000 mgr.gibba009.xiladd (mgr.34457) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:28.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.828095+0000 mgr.gibba009.xiladd (mgr.34457) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:28.081 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.829059+0000 mgr.gibba009.xiladd (mgr.34457) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:28.083 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.829096+0000 mgr.gibba009.xiladd (mgr.34457) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:28.084 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.830233+0000 mgr.gibba009.xiladd (mgr.34457) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:28.086 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.830556+0000 mgr.gibba009.xiladd (mgr.34457) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:28.087 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.831586+0000 mgr.gibba009.xiladd (mgr.34457) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:28.090 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.831627+0000 mgr.gibba009.xiladd (mgr.34457) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:28.092 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[30897]: cephadm 2021-03-10T20:48:25.831754+0000 mgr.gibba009.xiladd (mgr.34457) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:28.095 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.823209+0000 mgr.gibba009.xiladd (mgr.34457) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:28.097 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.824728+0000 mgr.gibba009.xiladd (mgr.34457) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:28.098 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.825841+0000 mgr.gibba009.xiladd (mgr.34457) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:28.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.825883+0000 mgr.gibba009.xiladd (mgr.34457) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:28.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.827203+0000 mgr.gibba009.xiladd (mgr.34457) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:28.099 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.827244+0000 mgr.gibba009.xiladd (mgr.34457) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:28.101 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.828095+0000 mgr.gibba009.xiladd (mgr.34457) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:28.102 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.829059+0000 mgr.gibba009.xiladd (mgr.34457) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:28.103 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.829096+0000 mgr.gibba009.xiladd (mgr.34457) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:28.105 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.830233+0000 mgr.gibba009.xiladd (mgr.34457) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:28.108 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.830556+0000 mgr.gibba009.xiladd (mgr.34457) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:28.109 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.831586+0000 mgr.gibba009.xiladd (mgr.34457) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:28.112 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.831627+0000 mgr.gibba009.xiladd (mgr.34457) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:28.113 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:27 gibba004 bash[31878]: cephadm 2021-03-10T20:48:25.831754+0000 mgr.gibba009.xiladd (mgr.34457) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:28.114 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.823209+0000 mgr.gibba009.xiladd (mgr.34457) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:28.114 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.824728+0000 mgr.gibba009.xiladd (mgr.34457) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:28.114 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.825841+0000 mgr.gibba009.xiladd (mgr.34457) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:28.115 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.825883+0000 mgr.gibba009.xiladd (mgr.34457) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:28.115 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.827203+0000 mgr.gibba009.xiladd (mgr.34457) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:28.115 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.827244+0000 mgr.gibba009.xiladd (mgr.34457) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:28.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.828095+0000 mgr.gibba009.xiladd (mgr.34457) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:28.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.829059+0000 mgr.gibba009.xiladd (mgr.34457) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:28.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.829096+0000 mgr.gibba009.xiladd (mgr.34457) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:28.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.830233+0000 mgr.gibba009.xiladd (mgr.34457) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:28.117 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.830556+0000 mgr.gibba009.xiladd (mgr.34457) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:28.117 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.831586+0000 mgr.gibba009.xiladd (mgr.34457) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:28.117 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.831627+0000 mgr.gibba009.xiladd (mgr.34457) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:28.118 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:27 gibba009 bash[26136]: cephadm 2021-03-10T20:48:25.831754+0000 mgr.gibba009.xiladd (mgr.34457) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:29.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:28 gibba004 bash[30897]: cluster 2021-03-10T20:48:27.665605+0000 mgr.gibba009.xiladd (mgr.34457) 2050 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:29.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:28 gibba004 bash[31878]: cluster 2021-03-10T20:48:27.665605+0000 mgr.gibba009.xiladd (mgr.34457) 2050 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:29.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:28 gibba009 bash[26136]: cluster 2021-03-10T20:48:27.665605+0000 mgr.gibba009.xiladd (mgr.34457) 2050 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:30.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:30 gibba004 bash[30897]: cluster 2021-03-10T20:48:29.666873+0000 mgr.gibba009.xiladd (mgr.34457) 2051 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:30 gibba004 bash[31878]: cluster 2021-03-10T20:48:29.666873+0000 mgr.gibba009.xiladd (mgr.34457) 2051 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:30.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:30 gibba009 bash[26136]: cluster 2021-03-10T20:48:29.666873+0000 mgr.gibba009.xiladd (mgr.34457) 2051 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:33.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:32 gibba004 bash[30897]: cluster 2021-03-10T20:48:31.668625+0000 mgr.gibba009.xiladd (mgr.34457) 2052 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:33.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:32 gibba004 bash[31878]: cluster 2021-03-10T20:48:31.668625+0000 mgr.gibba009.xiladd (mgr.34457) 2052 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:33.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:32 gibba009 bash[26136]: cluster 2021-03-10T20:48:31.668625+0000 mgr.gibba009.xiladd (mgr.34457) 2052 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:35.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:34 gibba004 bash[30897]: cluster 2021-03-10T20:48:33.670112+0000 mgr.gibba009.xiladd (mgr.34457) 2053 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:35.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:34 gibba004 bash[31878]: cluster 2021-03-10T20:48:33.670112+0000 mgr.gibba009.xiladd (mgr.34457) 2053 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:35.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:34 gibba009 bash[26136]: cluster 2021-03-10T20:48:33.670112+0000 mgr.gibba009.xiladd (mgr.34457) 2053 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:37.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:36 gibba004 bash[30897]: cluster 2021-03-10T20:48:35.671892+0000 mgr.gibba009.xiladd (mgr.34457) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:37.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:36 gibba004 bash[31878]: cluster 2021-03-10T20:48:35.671892+0000 mgr.gibba009.xiladd (mgr.34457) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:37.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:36 gibba009 bash[26136]: cluster 2021-03-10T20:48:35.671892+0000 mgr.gibba009.xiladd (mgr.34457) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:37 gibba004 bash[30897]: cluster 2021-03-10T20:48:37.673377+0000 mgr.gibba009.xiladd (mgr.34457) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:37 gibba004 bash[31878]: cluster 2021-03-10T20:48:37.673377+0000 mgr.gibba009.xiladd (mgr.34457) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:37 gibba009 bash[26136]: cluster 2021-03-10T20:48:37.673377+0000 mgr.gibba009.xiladd (mgr.34457) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: cluster 2021-03-10T20:48:39.674889+0000 mgr.gibba009.xiladd (mgr.34457) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.807992+0000 mon.c (mon.1) 630 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.808765+0000 mon.c (mon.1) 631 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.809146+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.810463+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.816269+0000 mon.c (mon.1) 632 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.817120+0000 mon.c (mon.1) 633 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.817371+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.818066+0000 mon.c (mon.1) 634 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.818816+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.819201+0000 mon.c (mon.1) 635 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:40.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.819855+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[30897]: audit 2021-03-10T20:48:39.820850+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: cluster 2021-03-10T20:48:39.674889+0000 mgr.gibba009.xiladd (mgr.34457) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.807992+0000 mon.c (mon.1) 630 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.808765+0000 mon.c (mon.1) 631 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.809146+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.810463+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.816269+0000 mon.c (mon.1) 632 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.818 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.817120+0000 mon.c (mon.1) 633 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.817371+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.818066+0000 mon.c (mon.1) 634 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.818816+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.819 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.819201+0000 mon.c (mon.1) 635 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.819855+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.820 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:40 gibba004 bash[31878]: audit 2021-03-10T20:48:39.820850+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: cluster 2021-03-10T20:48:39.674889+0000 mgr.gibba009.xiladd (mgr.34457) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.807992+0000 mon.c (mon.1) 630 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.808765+0000 mon.c (mon.1) 631 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.809146+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.810463+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.816269+0000 mon.c (mon.1) 632 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.817120+0000 mon.c (mon.1) 633 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.817371+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:48:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.818066+0000 mon.c (mon.1) 634 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.818816+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.819201+0000 mon.c (mon.1) 635 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.819855+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:48:40.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:40 gibba009 bash[26136]: audit 2021-03-10T20:48:39.820850+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:48:43.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:42 gibba004 bash[30897]: cephadm 2021-03-10T20:48:40.847685+0000 mgr.gibba009.xiladd (mgr.34457) 2057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:43.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:42 gibba004 bash[30897]: cluster 2021-03-10T20:48:41.676613+0000 mgr.gibba009.xiladd (mgr.34457) 2058 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:43.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:42 gibba004 bash[31878]: cephadm 2021-03-10T20:48:40.847685+0000 mgr.gibba009.xiladd (mgr.34457) 2057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:43.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:42 gibba004 bash[31878]: cluster 2021-03-10T20:48:41.676613+0000 mgr.gibba009.xiladd (mgr.34457) 2058 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:43.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:42 gibba009 bash[26136]: cephadm 2021-03-10T20:48:40.847685+0000 mgr.gibba009.xiladd (mgr.34457) 2057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:43.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:42 gibba009 bash[26136]: cluster 2021-03-10T20:48:41.676613+0000 mgr.gibba009.xiladd (mgr.34457) 2058 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:45.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:44 gibba004 bash[30897]: cluster 2021-03-10T20:48:43.678322+0000 mgr.gibba009.xiladd (mgr.34457) 2059 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:45.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:44 gibba004 bash[31878]: cluster 2021-03-10T20:48:43.678322+0000 mgr.gibba009.xiladd (mgr.34457) 2059 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:45.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:44 gibba009 bash[26136]: cluster 2021-03-10T20:48:43.678322+0000 mgr.gibba009.xiladd (mgr.34457) 2059 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:45 gibba004 bash[30897]: cluster 2021-03-10T20:48:45.680062+0000 mgr.gibba009.xiladd (mgr.34457) 2060 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:45 gibba004 bash[31878]: cluster 2021-03-10T20:48:45.680062+0000 mgr.gibba009.xiladd (mgr.34457) 2060 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:45 gibba009 bash[26136]: cluster 2021-03-10T20:48:45.680062+0000 mgr.gibba009.xiladd (mgr.34457) 2060 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:48.441 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:48:48.668 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:48:48.668 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (37m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:48:48.668 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (42m) 2m ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:48:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:48:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:48:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:48:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:48:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:48:48.670 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (36m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:48:48.670 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:48:48.670 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:48:48.670 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:48:48.671 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:48:48.671 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:48:48.671 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:48:48.671 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:48:48.671 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:48:48.672 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:48:48.672 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (33m) 2m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:48:48.672 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (42m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:48:48.672 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:48.673 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:48.916 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:48:48.916 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:48:48.916 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:48.917 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:48.917 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:48:48.917 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:48.917 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:48.917 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:48:48.918 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:48:48.918 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:48:48.918 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:48:48.918 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:48:48.919 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:48:48.919 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:48:48.919 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:48:49.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:48 gibba004 bash[30897]: cluster 2021-03-10T20:48:47.681735+0000 mgr.gibba009.xiladd (mgr.34457) 2061 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:49.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:48 gibba004 bash[31878]: cluster 2021-03-10T20:48:47.681735+0000 mgr.gibba009.xiladd (mgr.34457) 2061 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:49.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:48 gibba009 bash[26136]: cluster 2021-03-10T20:48:47.681735+0000 mgr.gibba009.xiladd (mgr.34457) 2061 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:50.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[30897]: audit 2021-03-10T20:48:48.430876+0000 mgr.gibba009.xiladd (mgr.34457) 2062 : audit [DBG] from='client.45444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[30897]: audit 2021-03-10T20:48:48.654235+0000 mgr.gibba009.xiladd (mgr.34457) 2063 : audit [DBG] from='client.45450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[30897]: audit 2021-03-10T20:48:48.916021+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? 172.21.2.104:0/1407671038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[31878]: audit 2021-03-10T20:48:48.430876+0000 mgr.gibba009.xiladd (mgr.34457) 2062 : audit [DBG] from='client.45444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[31878]: audit 2021-03-10T20:48:48.654235+0000 mgr.gibba009.xiladd (mgr.34457) 2063 : audit [DBG] from='client.45450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:49 gibba004 bash[31878]: audit 2021-03-10T20:48:48.916021+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? 172.21.2.104:0/1407671038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:50.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:49 gibba009 bash[26136]: audit 2021-03-10T20:48:48.430876+0000 mgr.gibba009.xiladd (mgr.34457) 2062 : audit [DBG] from='client.45444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:49 gibba009 bash[26136]: audit 2021-03-10T20:48:48.654235+0000 mgr.gibba009.xiladd (mgr.34457) 2063 : audit [DBG] from='client.45450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:50.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:49 gibba009 bash[26136]: audit 2021-03-10T20:48:48.916021+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? 172.21.2.104:0/1407671038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:51.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:50 gibba004 bash[30897]: cluster 2021-03-10T20:48:49.683063+0000 mgr.gibba009.xiladd (mgr.34457) 2064 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:51.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:50 gibba004 bash[31878]: cluster 2021-03-10T20:48:49.683063+0000 mgr.gibba009.xiladd (mgr.34457) 2064 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:51.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:50 gibba009 bash[26136]: cluster 2021-03-10T20:48:49.683063+0000 mgr.gibba009.xiladd (mgr.34457) 2064 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:53.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:52 gibba004 bash[30897]: cluster 2021-03-10T20:48:51.684756+0000 mgr.gibba009.xiladd (mgr.34457) 2065 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:53.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:52 gibba004 bash[31878]: cluster 2021-03-10T20:48:51.684756+0000 mgr.gibba009.xiladd (mgr.34457) 2065 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:53.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:52 gibba009 bash[26136]: cluster 2021-03-10T20:48:51.684756+0000 mgr.gibba009.xiladd (mgr.34457) 2065 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:54.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:53 gibba004 bash[30897]: cluster 2021-03-10T20:48:53.686159+0000 mgr.gibba009.xiladd (mgr.34457) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:53 gibba004 bash[31878]: cluster 2021-03-10T20:48:53.686159+0000 mgr.gibba009.xiladd (mgr.34457) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:54.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:53 gibba009 bash[26136]: cluster 2021-03-10T20:48:53.686159+0000 mgr.gibba009.xiladd (mgr.34457) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:57.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:56 gibba004 bash[30897]: cluster 2021-03-10T20:48:55.687810+0000 mgr.gibba009.xiladd (mgr.34457) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:57.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:56 gibba004 bash[31878]: cluster 2021-03-10T20:48:55.687810+0000 mgr.gibba009.xiladd (mgr.34457) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:57.087 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:56 gibba009 bash[26136]: cluster 2021-03-10T20:48:55.687810+0000 mgr.gibba009.xiladd (mgr.34457) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:58.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:57 gibba004 bash[30897]: cephadm 2021-03-10T20:48:55.850472+0000 mgr.gibba009.xiladd (mgr.34457) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:58.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:57 gibba004 bash[31878]: cephadm 2021-03-10T20:48:55.850472+0000 mgr.gibba009.xiladd (mgr.34457) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:58.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:57 gibba009 bash[26136]: cephadm 2021-03-10T20:48:55.850472+0000 mgr.gibba009.xiladd (mgr.34457) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:48:59.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:48:58 gibba004 bash[30897]: cluster 2021-03-10T20:48:57.689476+0000 mgr.gibba009.xiladd (mgr.34457) 2069 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:59.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:48:58 gibba004 bash[31878]: cluster 2021-03-10T20:48:57.689476+0000 mgr.gibba009.xiladd (mgr.34457) 2069 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:59.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:48:58 gibba009 bash[26136]: cluster 2021-03-10T20:48:57.689476+0000 mgr.gibba009.xiladd (mgr.34457) 2069 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:00 gibba004 bash[30897]: cluster 2021-03-10T20:48:59.691129+0000 mgr.gibba009.xiladd (mgr.34457) 2070 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:00 gibba004 bash[31878]: cluster 2021-03-10T20:48:59.691129+0000 mgr.gibba009.xiladd (mgr.34457) 2070 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:00 gibba009 bash[26136]: cluster 2021-03-10T20:48:59.691129+0000 mgr.gibba009.xiladd (mgr.34457) 2070 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:03.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:02 gibba004 bash[30897]: cluster 2021-03-10T20:49:01.692733+0000 mgr.gibba009.xiladd (mgr.34457) 2071 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:03.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:02 gibba004 bash[31878]: cluster 2021-03-10T20:49:01.692733+0000 mgr.gibba009.xiladd (mgr.34457) 2071 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:03.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:02 gibba009 bash[26136]: cluster 2021-03-10T20:49:01.692733+0000 mgr.gibba009.xiladd (mgr.34457) 2071 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:03 gibba004 bash[30897]: cluster 2021-03-10T20:49:03.694394+0000 mgr.gibba009.xiladd (mgr.34457) 2072 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:03 gibba004 bash[31878]: cluster 2021-03-10T20:49:03.694394+0000 mgr.gibba009.xiladd (mgr.34457) 2072 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:03 gibba009 bash[26136]: cluster 2021-03-10T20:49:03.694394+0000 mgr.gibba009.xiladd (mgr.34457) 2072 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:07.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:06 gibba004 bash[30897]: cluster 2021-03-10T20:49:05.696182+0000 mgr.gibba009.xiladd (mgr.34457) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:07.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:06 gibba004 bash[31878]: cluster 2021-03-10T20:49:05.696182+0000 mgr.gibba009.xiladd (mgr.34457) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:07.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:06 gibba009 bash[26136]: cluster 2021-03-10T20:49:05.696182+0000 mgr.gibba009.xiladd (mgr.34457) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:07 gibba004 bash[30897]: cluster 2021-03-10T20:49:07.697610+0000 mgr.gibba009.xiladd (mgr.34457) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:07 gibba004 bash[31878]: cluster 2021-03-10T20:49:07.697610+0000 mgr.gibba009.xiladd (mgr.34457) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:07 gibba009 bash[26136]: cluster 2021-03-10T20:49:07.697610+0000 mgr.gibba009.xiladd (mgr.34457) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.812 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:10 gibba004 bash[30897]: cluster 2021-03-10T20:49:09.699111+0000 mgr.gibba009.xiladd (mgr.34457) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:10 gibba004 bash[31878]: cluster 2021-03-10T20:49:09.699111+0000 mgr.gibba009.xiladd (mgr.34457) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.837 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:10 gibba009 bash[26136]: cluster 2021-03-10T20:49:09.699111+0000 mgr.gibba009.xiladd (mgr.34457) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:13.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:12 gibba004 bash[30897]: cephadm 2021-03-10T20:49:10.865637+0000 mgr.gibba009.xiladd (mgr.34457) 2076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:13.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:12 gibba004 bash[30897]: cluster 2021-03-10T20:49:11.700576+0000 mgr.gibba009.xiladd (mgr.34457) 2077 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:13.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:12 gibba004 bash[31878]: cephadm 2021-03-10T20:49:10.865637+0000 mgr.gibba009.xiladd (mgr.34457) 2076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:13.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:12 gibba004 bash[31878]: cluster 2021-03-10T20:49:11.700576+0000 mgr.gibba009.xiladd (mgr.34457) 2077 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:13.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:12 gibba009 bash[26136]: cephadm 2021-03-10T20:49:10.865637+0000 mgr.gibba009.xiladd (mgr.34457) 2076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:13.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:12 gibba009 bash[26136]: cluster 2021-03-10T20:49:11.700576+0000 mgr.gibba009.xiladd (mgr.34457) 2077 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:14.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:13 gibba004 bash[30897]: cluster 2021-03-10T20:49:13.702082+0000 mgr.gibba009.xiladd (mgr.34457) 2078 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:14.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:13 gibba004 bash[31878]: cluster 2021-03-10T20:49:13.702082+0000 mgr.gibba009.xiladd (mgr.34457) 2078 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:14.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:13 gibba009 bash[26136]: cluster 2021-03-10T20:49:13.702082+0000 mgr.gibba009.xiladd (mgr.34457) 2078 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:15 gibba004 bash[30897]: cluster 2021-03-10T20:49:15.703852+0000 mgr.gibba009.xiladd (mgr.34457) 2079 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:15 gibba004 bash[31878]: cluster 2021-03-10T20:49:15.703852+0000 mgr.gibba009.xiladd (mgr.34457) 2079 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:15 gibba009 bash[26136]: cluster 2021-03-10T20:49:15.703852+0000 mgr.gibba009.xiladd (mgr.34457) 2079 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:17 gibba004 bash[30897]: cluster 2021-03-10T20:49:17.705526+0000 mgr.gibba009.xiladd (mgr.34457) 2080 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:17 gibba004 bash[31878]: cluster 2021-03-10T20:49:17.705526+0000 mgr.gibba009.xiladd (mgr.34457) 2080 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:17 gibba009 bash[26136]: cluster 2021-03-10T20:49:17.705526+0000 mgr.gibba009.xiladd (mgr.34457) 2080 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:19.158 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:49:19.383 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:49:19.384 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (38m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:49:19.384 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:49:19.384 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:49:19.384 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:49:19.385 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:49:19.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:49:19.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (37m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:49:19.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:49:19.386 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:49:19.386 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:49:19.386 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:49:19.386 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:49:19.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:49:19.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:49:19.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:49:19.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:49:19.388 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:49:19.389 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:49:19.389 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (43m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:49:19.389 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:19.389 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:19.638 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:49:19.638 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:49:19.639 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:19.639 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:19.640 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:49:19.640 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:19.640 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:19.641 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:49:19.641 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:49:19.642 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:19.642 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:49:19.643 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:49:19.643 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:49:19.644 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:49:19.644 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:49:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[30897]: audit 2021-03-10T20:49:19.148361+0000 mgr.gibba009.xiladd (mgr.34457) 2081 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[30897]: audit 2021-03-10T20:49:19.369093+0000 mgr.gibba009.xiladd (mgr.34457) 2082 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[30897]: audit 2021-03-10T20:49:19.637641+0000 mon.c (mon.1) 636 : audit [DBG] from='client.? 172.21.2.104:0/344893559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:20.814 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[30897]: cluster 2021-03-10T20:49:19.706947+0000 mgr.gibba009.xiladd (mgr.34457) 2083 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[31878]: audit 2021-03-10T20:49:19.148361+0000 mgr.gibba009.xiladd (mgr.34457) 2081 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[31878]: audit 2021-03-10T20:49:19.369093+0000 mgr.gibba009.xiladd (mgr.34457) 2082 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.815 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[31878]: audit 2021-03-10T20:49:19.637641+0000 mon.c (mon.1) 636 : audit [DBG] from='client.? 172.21.2.104:0/344893559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:20.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:20 gibba004 bash[31878]: cluster 2021-03-10T20:49:19.706947+0000 mgr.gibba009.xiladd (mgr.34457) 2083 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:20.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:20 gibba009 bash[26136]: audit 2021-03-10T20:49:19.148361+0000 mgr.gibba009.xiladd (mgr.34457) 2081 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:20 gibba009 bash[26136]: audit 2021-03-10T20:49:19.369093+0000 mgr.gibba009.xiladd (mgr.34457) 2082 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:20.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:20 gibba009 bash[26136]: audit 2021-03-10T20:49:19.637641+0000 mon.c (mon.1) 636 : audit [DBG] from='client.? 172.21.2.104:0/344893559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:20.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:20 gibba009 bash[26136]: cluster 2021-03-10T20:49:19.706947+0000 mgr.gibba009.xiladd (mgr.34457) 2083 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:21 gibba009 bash[26136]: cluster 2021-03-10T20:49:21.708301+0000 mgr.gibba009.xiladd (mgr.34457) 2084 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:21 gibba004 bash[30897]: cluster 2021-03-10T20:49:21.708301+0000 mgr.gibba009.xiladd (mgr.34457) 2084 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:21 gibba004 bash[31878]: cluster 2021-03-10T20:49:21.708301+0000 mgr.gibba009.xiladd (mgr.34457) 2084 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:23 gibba009 bash[26136]: cluster 2021-03-10T20:49:23.709710+0000 mgr.gibba009.xiladd (mgr.34457) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:23 gibba004 bash[30897]: cluster 2021-03-10T20:49:23.709710+0000 mgr.gibba009.xiladd (mgr.34457) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:23 gibba004 bash[31878]: cluster 2021-03-10T20:49:23.709710+0000 mgr.gibba009.xiladd (mgr.34457) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:25 gibba009 bash[26136]: cluster 2021-03-10T20:49:25.711447+0000 mgr.gibba009.xiladd (mgr.34457) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:25 gibba004 bash[30897]: cluster 2021-03-10T20:49:25.711447+0000 mgr.gibba009.xiladd (mgr.34457) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:25 gibba004 bash[31878]: cluster 2021-03-10T20:49:25.711447+0000 mgr.gibba009.xiladd (mgr.34457) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:25.882995+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:25.886192+0000 mgr.gibba009.xiladd (mgr.34457) 2087 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:49:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:25.887610+0000 mgr.gibba009.xiladd (mgr.34457) 2088 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:49:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.110349+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:49:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.116961+0000 mgr.gibba009.xiladd (mgr.34457) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.118965+0000 mon.c (mon.1) 638 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.119224+0000 mgr.gibba009.xiladd (mgr.34457) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.120603+0000 mgr.gibba009.xiladd (mgr.34457) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.120675+0000 mgr.gibba009.xiladd (mgr.34457) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.120843+0000 mon.c (mon.1) 639 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.122212+0000 mon.c (mon.1) 640 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.122239+0000 mgr.gibba009.xiladd (mgr.34457) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.122279+0000 mgr.gibba009.xiladd (mgr.34457) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.123743+0000 mgr.gibba009.xiladd (mgr.34457) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.123835+0000 mon.c (mon.1) 641 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.125758+0000 mgr.gibba009.xiladd (mgr.34457) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.125799+0000 mgr.gibba009.xiladd (mgr.34457) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.127265+0000 mgr.gibba009.xiladd (mgr.34457) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.127587+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.127615+0000 mgr.gibba009.xiladd (mgr.34457) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.128782+0000 mgr.gibba009.xiladd (mgr.34457) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.128823+0000 mgr.gibba009.xiladd (mgr.34457) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: cephadm 2021-03-10T20:49:26.128962+0000 mgr.gibba009.xiladd (mgr.34457) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:27.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:26 gibba009 bash[26136]: audit 2021-03-10T20:49:26.129176+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:25.882995+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:25.886192+0000 mgr.gibba009.xiladd (mgr.34457) 2087 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:49:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:25.887610+0000 mgr.gibba009.xiladd (mgr.34457) 2088 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:49:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.110349+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:49:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.116961+0000 mgr.gibba009.xiladd (mgr.34457) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.118965+0000 mon.c (mon.1) 638 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.119224+0000 mgr.gibba009.xiladd (mgr.34457) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.120603+0000 mgr.gibba009.xiladd (mgr.34457) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.120675+0000 mgr.gibba009.xiladd (mgr.34457) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.120843+0000 mon.c (mon.1) 639 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.122212+0000 mon.c (mon.1) 640 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.122239+0000 mgr.gibba009.xiladd (mgr.34457) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.122279+0000 mgr.gibba009.xiladd (mgr.34457) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.123743+0000 mgr.gibba009.xiladd (mgr.34457) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.123835+0000 mon.c (mon.1) 641 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.125758+0000 mgr.gibba009.xiladd (mgr.34457) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.125799+0000 mgr.gibba009.xiladd (mgr.34457) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.127265+0000 mgr.gibba009.xiladd (mgr.34457) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.127587+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.127615+0000 mgr.gibba009.xiladd (mgr.34457) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:27.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.128782+0000 mgr.gibba009.xiladd (mgr.34457) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:27.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:25.882995+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:25.886192+0000 mgr.gibba009.xiladd (mgr.34457) 2087 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:49:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:25.887610+0000 mgr.gibba009.xiladd (mgr.34457) 2088 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:49:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.110349+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:49:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.116961+0000 mgr.gibba009.xiladd (mgr.34457) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.118965+0000 mon.c (mon.1) 638 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.119224+0000 mgr.gibba009.xiladd (mgr.34457) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.120603+0000 mgr.gibba009.xiladd (mgr.34457) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.120675+0000 mgr.gibba009.xiladd (mgr.34457) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:27.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.120843+0000 mon.c (mon.1) 639 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.122212+0000 mon.c (mon.1) 640 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.122239+0000 mgr.gibba009.xiladd (mgr.34457) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.122279+0000 mgr.gibba009.xiladd (mgr.34457) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.123743+0000 mgr.gibba009.xiladd (mgr.34457) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.123835+0000 mon.c (mon.1) 641 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.125758+0000 mgr.gibba009.xiladd (mgr.34457) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.125799+0000 mgr.gibba009.xiladd (mgr.34457) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.127265+0000 mgr.gibba009.xiladd (mgr.34457) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:27.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.127587+0000 mon.c (mon.1) 642 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.127615+0000 mgr.gibba009.xiladd (mgr.34457) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:27.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.128782+0000 mgr.gibba009.xiladd (mgr.34457) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:27.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.128823+0000 mgr.gibba009.xiladd (mgr.34457) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:27.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: cephadm 2021-03-10T20:49:26.128962+0000 mgr.gibba009.xiladd (mgr.34457) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:27.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[30897]: audit 2021-03-10T20:49:26.129176+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:27.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.128823+0000 mgr.gibba009.xiladd (mgr.34457) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:27.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: cephadm 2021-03-10T20:49:26.128962+0000 mgr.gibba009.xiladd (mgr.34457) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:27.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:26 gibba004 bash[31878]: audit 2021-03-10T20:49:26.129176+0000 mon.c (mon.1) 643 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:28.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:27 gibba009 bash[26136]: cluster 2021-03-10T20:49:27.712949+0000 mgr.gibba009.xiladd (mgr.34457) 2103 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:27 gibba004 bash[30897]: cluster 2021-03-10T20:49:27.712949+0000 mgr.gibba009.xiladd (mgr.34457) 2103 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:27 gibba004 bash[31878]: cluster 2021-03-10T20:49:27.712949+0000 mgr.gibba009.xiladd (mgr.34457) 2103 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:30.813 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:30 gibba004 bash[30897]: cluster 2021-03-10T20:49:29.714870+0000 mgr.gibba009.xiladd (mgr.34457) 2104 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:30.813 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:30 gibba004 bash[31878]: cluster 2021-03-10T20:49:29.714870+0000 mgr.gibba009.xiladd (mgr.34457) 2104 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:30.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:30 gibba009 bash[26136]: cluster 2021-03-10T20:49:29.714870+0000 mgr.gibba009.xiladd (mgr.34457) 2104 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:31 gibba009 bash[26136]: cluster 2021-03-10T20:49:31.716188+0000 mgr.gibba009.xiladd (mgr.34457) 2105 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:31 gibba004 bash[30897]: cluster 2021-03-10T20:49:31.716188+0000 mgr.gibba009.xiladd (mgr.34457) 2105 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:31 gibba004 bash[31878]: cluster 2021-03-10T20:49:31.716188+0000 mgr.gibba009.xiladd (mgr.34457) 2105 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:33 gibba009 bash[26136]: cluster 2021-03-10T20:49:33.717612+0000 mgr.gibba009.xiladd (mgr.34457) 2106 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:33 gibba004 bash[30897]: cluster 2021-03-10T20:49:33.717612+0000 mgr.gibba009.xiladd (mgr.34457) 2106 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:33 gibba004 bash[31878]: cluster 2021-03-10T20:49:33.717612+0000 mgr.gibba009.xiladd (mgr.34457) 2106 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:35 gibba009 bash[26136]: cluster 2021-03-10T20:49:35.719306+0000 mgr.gibba009.xiladd (mgr.34457) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:35 gibba004 bash[30897]: cluster 2021-03-10T20:49:35.719306+0000 mgr.gibba009.xiladd (mgr.34457) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:35 gibba004 bash[31878]: cluster 2021-03-10T20:49:35.719306+0000 mgr.gibba009.xiladd (mgr.34457) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:37 gibba009 bash[26136]: cluster 2021-03-10T20:49:37.721038+0000 mgr.gibba009.xiladd (mgr.34457) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:37 gibba004 bash[30897]: cluster 2021-03-10T20:49:37.721038+0000 mgr.gibba009.xiladd (mgr.34457) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:37 gibba004 bash[31878]: cluster 2021-03-10T20:49:37.721038+0000 mgr.gibba009.xiladd (mgr.34457) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:40.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: cluster 2021-03-10T20:49:39.722558+0000 mgr.gibba009.xiladd (mgr.34457) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:41.168 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.815395+0000 mon.c (mon.1) 644 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.168 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.816169+0000 mon.c (mon.1) 645 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.169 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.816698+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.169 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.818476+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.169 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.822791+0000 mon.c (mon.1) 646 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.169 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.823620+0000 mon.c (mon.1) 647 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.170 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.824038+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.170 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.824529+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.170 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.825943+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.170 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.826028+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.171 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.827967+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.171 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:40 gibba009 bash[26136]: audit 2021-03-10T20:49:39.828950+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.172 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: cluster 2021-03-10T20:49:39.722558+0000 mgr.gibba009.xiladd (mgr.34457) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:41.172 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.815395+0000 mon.c (mon.1) 644 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.172 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.816169+0000 mon.c (mon.1) 645 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.173 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.816698+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.173 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.818476+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.173 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.822791+0000 mon.c (mon.1) 646 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.174 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.823620+0000 mon.c (mon.1) 647 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.174 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.824038+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.174 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.824529+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.825943+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.826028+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.827967+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[30897]: audit 2021-03-10T20:49:39.828950+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.176 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: cluster 2021-03-10T20:49:39.722558+0000 mgr.gibba009.xiladd (mgr.34457) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:41.176 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.815395+0000 mon.c (mon.1) 644 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.176 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.816169+0000 mon.c (mon.1) 645 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.176 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.816698+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:41.177 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.818476+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:41.177 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.822791+0000 mon.c (mon.1) 646 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.177 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.823620+0000 mon.c (mon.1) 647 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.177 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.824038+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:49:41.178 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.824529+0000 mon.c (mon.1) 648 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.178 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.825943+0000 mon.c (mon.1) 649 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.178 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.826028+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:49:41.178 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.827967+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:49:41.179 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:40 gibba004 bash[31878]: audit 2021-03-10T20:49:39.828950+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:49:42.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:41 gibba009 bash[26136]: cephadm 2021-03-10T20:49:41.137789+0000 mgr.gibba009.xiladd (mgr.34457) 2110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:42.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:41 gibba009 bash[26136]: cluster 2021-03-10T20:49:41.724025+0000 mgr.gibba009.xiladd (mgr.34457) 2111 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:42.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:41 gibba004 bash[30897]: cephadm 2021-03-10T20:49:41.137789+0000 mgr.gibba009.xiladd (mgr.34457) 2110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:41 gibba004 bash[30897]: cluster 2021-03-10T20:49:41.724025+0000 mgr.gibba009.xiladd (mgr.34457) 2111 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:41 gibba004 bash[31878]: cephadm 2021-03-10T20:49:41.137789+0000 mgr.gibba009.xiladd (mgr.34457) 2110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:42.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:41 gibba004 bash[31878]: cluster 2021-03-10T20:49:41.724025+0000 mgr.gibba009.xiladd (mgr.34457) 2111 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:44.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:43 gibba009 bash[26136]: cluster 2021-03-10T20:49:43.725639+0000 mgr.gibba009.xiladd (mgr.34457) 2112 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:44.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:43 gibba004 bash[30897]: cluster 2021-03-10T20:49:43.725639+0000 mgr.gibba009.xiladd (mgr.34457) 2112 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:44.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:43 gibba004 bash[31878]: cluster 2021-03-10T20:49:43.725639+0000 mgr.gibba009.xiladd (mgr.34457) 2112 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:46.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:45 gibba009 bash[26136]: cluster 2021-03-10T20:49:45.727151+0000 mgr.gibba009.xiladd (mgr.34457) 2113 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:45 gibba004 bash[30897]: cluster 2021-03-10T20:49:45.727151+0000 mgr.gibba009.xiladd (mgr.34457) 2113 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:46.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:45 gibba004 bash[31878]: cluster 2021-03-10T20:49:45.727151+0000 mgr.gibba009.xiladd (mgr.34457) 2113 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:47 gibba009 bash[26136]: cluster 2021-03-10T20:49:47.728793+0000 mgr.gibba009.xiladd (mgr.34457) 2114 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:47 gibba004 bash[30897]: cluster 2021-03-10T20:49:47.728793+0000 mgr.gibba009.xiladd (mgr.34457) 2114 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:47 gibba004 bash[31878]: cluster 2021-03-10T20:49:47.728793+0000 mgr.gibba009.xiladd (mgr.34457) 2114 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:49.880 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:49:50.100 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:49:50.102 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (38m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:49:50.104 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (43m) 3m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:49:50.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:49:50.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:49:50.105 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:49:50.105 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:49:50.105 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:49:50.106 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:49:50.106 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:49:50.106 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:49:50.106 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:49:50.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:49:50.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:49:50.107 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:49:50.108 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:49:50.109 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:49:50.109 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:49:50.109 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (34m) 3m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:49:50.109 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (43m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:49:50.109 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:50.110 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:50.349 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:49:50.349 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:49:50.350 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:50.350 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:50.350 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:49:50.351 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:50.351 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:50.351 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:49:50.351 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:49:50.351 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:49:50.352 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:49:50.352 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:49:50.353 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:49:50.353 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:49:50.353 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:49:50.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:50 gibba009 bash[26136]: cluster 2021-03-10T20:49:49.730253+0000 mgr.gibba009.xiladd (mgr.34457) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:50.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:50 gibba009 bash[26136]: audit 2021-03-10T20:49:50.349145+0000 mon.c (mon.1) 650 : audit [DBG] from='client.? 172.21.2.104:0/1299434854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:51.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:50 gibba004 bash[30897]: cluster 2021-03-10T20:49:49.730253+0000 mgr.gibba009.xiladd (mgr.34457) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:51.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:50 gibba004 bash[30897]: audit 2021-03-10T20:49:50.349145+0000 mon.c (mon.1) 650 : audit [DBG] from='client.? 172.21.2.104:0/1299434854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:51.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:50 gibba004 bash[31878]: cluster 2021-03-10T20:49:49.730253+0000 mgr.gibba009.xiladd (mgr.34457) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:51.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:50 gibba004 bash[31878]: audit 2021-03-10T20:49:50.349145+0000 mon.c (mon.1) 650 : audit [DBG] from='client.? 172.21.2.104:0/1299434854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:51.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:51 gibba009 bash[26136]: audit 2021-03-10T20:49:49.868820+0000 mgr.gibba009.xiladd (mgr.34457) 2116 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:51.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:51 gibba009 bash[26136]: audit 2021-03-10T20:49:50.089792+0000 mgr.gibba009.xiladd (mgr.34457) 2117 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:52.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:51 gibba004 bash[30897]: audit 2021-03-10T20:49:49.868820+0000 mgr.gibba009.xiladd (mgr.34457) 2116 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:52.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:51 gibba004 bash[30897]: audit 2021-03-10T20:49:50.089792+0000 mgr.gibba009.xiladd (mgr.34457) 2117 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:52.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:51 gibba004 bash[31878]: audit 2021-03-10T20:49:49.868820+0000 mgr.gibba009.xiladd (mgr.34457) 2116 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:52.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:51 gibba004 bash[31878]: audit 2021-03-10T20:49:50.089792+0000 mgr.gibba009.xiladd (mgr.34457) 2117 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:52.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:52 gibba009 bash[26136]: cluster 2021-03-10T20:49:51.731485+0000 mgr.gibba009.xiladd (mgr.34457) 2118 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:53.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:52 gibba004 bash[30897]: cluster 2021-03-10T20:49:51.731485+0000 mgr.gibba009.xiladd (mgr.34457) 2118 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:53.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:52 gibba004 bash[31878]: cluster 2021-03-10T20:49:51.731485+0000 mgr.gibba009.xiladd (mgr.34457) 2118 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:54.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:53 gibba009 bash[26136]: cluster 2021-03-10T20:49:53.733163+0000 mgr.gibba009.xiladd (mgr.34457) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:54.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:53 gibba004 bash[30897]: cluster 2021-03-10T20:49:53.733163+0000 mgr.gibba009.xiladd (mgr.34457) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:54.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:53 gibba004 bash[31878]: cluster 2021-03-10T20:49:53.733163+0000 mgr.gibba009.xiladd (mgr.34457) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:55 gibba009 bash[26136]: cluster 2021-03-10T20:49:55.734914+0000 mgr.gibba009.xiladd (mgr.34457) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:55 gibba004 bash[30897]: cluster 2021-03-10T20:49:55.734914+0000 mgr.gibba009.xiladd (mgr.34457) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:55 gibba004 bash[31878]: cluster 2021-03-10T20:49:55.734914+0000 mgr.gibba009.xiladd (mgr.34457) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:57.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:56 gibba009 bash[26136]: cephadm 2021-03-10T20:49:56.153847+0000 mgr.gibba009.xiladd (mgr.34457) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:56 gibba004 bash[30897]: cephadm 2021-03-10T20:49:56.153847+0000 mgr.gibba009.xiladd (mgr.34457) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:57.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:56 gibba004 bash[31878]: cephadm 2021-03-10T20:49:56.153847+0000 mgr.gibba009.xiladd (mgr.34457) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:49:58.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:49:57 gibba009 bash[26136]: cluster 2021-03-10T20:49:57.736523+0000 mgr.gibba009.xiladd (mgr.34457) 2122 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:58.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:49:57 gibba004 bash[30897]: cluster 2021-03-10T20:49:57.736523+0000 mgr.gibba009.xiladd (mgr.34457) 2122 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:49:57 gibba004 bash[31878]: cluster 2021-03-10T20:49:57.736523+0000 mgr.gibba009.xiladd (mgr.34457) 2122 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:00 gibba004 bash[30897]: debug 2021-03-10T20:49:59.996+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:00 gibba009 bash[26136]: cluster 2021-03-10T20:49:59.738028+0000 mgr.gibba009.xiladd (mgr.34457) 2123 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:00 gibba009 bash[26136]: cluster 2021-03-10T20:50:00.000206+0000 mon.a (mon.0) 873 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:01.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:00 gibba004 bash[30897]: cluster 2021-03-10T20:49:59.738028+0000 mgr.gibba009.xiladd (mgr.34457) 2123 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:01.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:00 gibba004 bash[30897]: cluster 2021-03-10T20:50:00.000206+0000 mon.a (mon.0) 873 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:01.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:00 gibba004 bash[31878]: cluster 2021-03-10T20:49:59.738028+0000 mgr.gibba009.xiladd (mgr.34457) 2123 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:01.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:00 gibba004 bash[31878]: cluster 2021-03-10T20:50:00.000206+0000 mon.a (mon.0) 873 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:02.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:01 gibba009 bash[26136]: cluster 2021-03-10T20:50:01.739570+0000 mgr.gibba009.xiladd (mgr.34457) 2124 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:02.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:01 gibba004 bash[30897]: cluster 2021-03-10T20:50:01.739570+0000 mgr.gibba009.xiladd (mgr.34457) 2124 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:02.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:01 gibba004 bash[31878]: cluster 2021-03-10T20:50:01.739570+0000 mgr.gibba009.xiladd (mgr.34457) 2124 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:03 gibba009 bash[26136]: cluster 2021-03-10T20:50:03.741014+0000 mgr.gibba009.xiladd (mgr.34457) 2125 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:03 gibba004 bash[30897]: cluster 2021-03-10T20:50:03.741014+0000 mgr.gibba009.xiladd (mgr.34457) 2125 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:03 gibba004 bash[31878]: cluster 2021-03-10T20:50:03.741014+0000 mgr.gibba009.xiladd (mgr.34457) 2125 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:05 gibba009 bash[26136]: cluster 2021-03-10T20:50:05.742729+0000 mgr.gibba009.xiladd (mgr.34457) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:05 gibba004 bash[30897]: cluster 2021-03-10T20:50:05.742729+0000 mgr.gibba009.xiladd (mgr.34457) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:05 gibba004 bash[31878]: cluster 2021-03-10T20:50:05.742729+0000 mgr.gibba009.xiladd (mgr.34457) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:07 gibba009 bash[26136]: cluster 2021-03-10T20:50:07.744325+0000 mgr.gibba009.xiladd (mgr.34457) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:07 gibba004 bash[30897]: cluster 2021-03-10T20:50:07.744325+0000 mgr.gibba009.xiladd (mgr.34457) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:07 gibba004 bash[31878]: cluster 2021-03-10T20:50:07.744325+0000 mgr.gibba009.xiladd (mgr.34457) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:10.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:10 gibba009 bash[26136]: cluster 2021-03-10T20:50:09.745876+0000 mgr.gibba009.xiladd (mgr.34457) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:11.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:10 gibba004 bash[30897]: cluster 2021-03-10T20:50:09.745876+0000 mgr.gibba009.xiladd (mgr.34457) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:11.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:10 gibba004 bash[31878]: cluster 2021-03-10T20:50:09.745876+0000 mgr.gibba009.xiladd (mgr.34457) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:11 gibba009 bash[26136]: cephadm 2021-03-10T20:50:11.169607+0000 mgr.gibba009.xiladd (mgr.34457) 2129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:12.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:11 gibba009 bash[26136]: cluster 2021-03-10T20:50:11.747103+0000 mgr.gibba009.xiladd (mgr.34457) 2130 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:11 gibba004 bash[30897]: cephadm 2021-03-10T20:50:11.169607+0000 mgr.gibba009.xiladd (mgr.34457) 2129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:12.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:11 gibba004 bash[30897]: cluster 2021-03-10T20:50:11.747103+0000 mgr.gibba009.xiladd (mgr.34457) 2130 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:11 gibba004 bash[31878]: cephadm 2021-03-10T20:50:11.169607+0000 mgr.gibba009.xiladd (mgr.34457) 2129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:12.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:11 gibba004 bash[31878]: cluster 2021-03-10T20:50:11.747103+0000 mgr.gibba009.xiladd (mgr.34457) 2130 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:13 gibba009 bash[26136]: cluster 2021-03-10T20:50:13.748627+0000 mgr.gibba009.xiladd (mgr.34457) 2131 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:13 gibba004 bash[30897]: cluster 2021-03-10T20:50:13.748627+0000 mgr.gibba009.xiladd (mgr.34457) 2131 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:13 gibba004 bash[31878]: cluster 2021-03-10T20:50:13.748627+0000 mgr.gibba009.xiladd (mgr.34457) 2131 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:16.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:15 gibba009 bash[26136]: cluster 2021-03-10T20:50:15.750189+0000 mgr.gibba009.xiladd (mgr.34457) 2132 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:16.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:15 gibba004 bash[30897]: cluster 2021-03-10T20:50:15.750189+0000 mgr.gibba009.xiladd (mgr.34457) 2132 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:16.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:15 gibba004 bash[31878]: cluster 2021-03-10T20:50:15.750189+0000 mgr.gibba009.xiladd (mgr.34457) 2132 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:17 gibba009 bash[26136]: cluster 2021-03-10T20:50:17.751685+0000 mgr.gibba009.xiladd (mgr.34457) 2133 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:17 gibba004 bash[30897]: cluster 2021-03-10T20:50:17.751685+0000 mgr.gibba009.xiladd (mgr.34457) 2133 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:17 gibba004 bash[31878]: cluster 2021-03-10T20:50:17.751685+0000 mgr.gibba009.xiladd (mgr.34457) 2133 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:20.591 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:50:20.821 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:50:20.821 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (39m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:50:20.822 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:50:20.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:50:20.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:50:20.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:50:20.823 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:50:20.823 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:50:20.823 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:50:20.823 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:50:20.823 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:50:20.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:50:20.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:50:20.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:50:20.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:50:20.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:50:20.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:50:20.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:50:20.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:50:20.825 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (44m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:50:20.826 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:20.826 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:20.838 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:20 gibba009 bash[26136]: cluster 2021-03-10T20:50:19.753536+0000 mgr.gibba009.xiladd (mgr.34457) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:21.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:20 gibba004 bash[30897]: cluster 2021-03-10T20:50:19.753536+0000 mgr.gibba009.xiladd (mgr.34457) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:21.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:20 gibba004 bash[31878]: cluster 2021-03-10T20:50:19.753536+0000 mgr.gibba009.xiladd (mgr.34457) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:21.071 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:50:21.072 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:50:21.072 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:21.072 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:21.072 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:50:21.073 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:21.073 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:21.073 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:50:21.073 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:50:21.074 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:21.074 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:50:21.074 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:50:21.074 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:50:21.075 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:50:21.075 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:50:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:21 gibba004 bash[30897]: audit 2021-03-10T20:50:20.581059+0000 mgr.gibba009.xiladd (mgr.34457) 2135 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:21 gibba004 bash[30897]: audit 2021-03-10T20:50:21.071604+0000 mon.c (mon.1) 651 : audit [DBG] from='client.? 172.21.2.104:0/4086756401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:21 gibba004 bash[31878]: audit 2021-03-10T20:50:20.581059+0000 mgr.gibba009.xiladd (mgr.34457) 2135 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:21 gibba004 bash[31878]: audit 2021-03-10T20:50:21.071604+0000 mon.c (mon.1) 651 : audit [DBG] from='client.? 172.21.2.104:0/4086756401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:22.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:21 gibba009 bash[26136]: audit 2021-03-10T20:50:20.581059+0000 mgr.gibba009.xiladd (mgr.34457) 2135 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:22.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:21 gibba009 bash[26136]: audit 2021-03-10T20:50:21.071604+0000 mon.c (mon.1) 651 : audit [DBG] from='client.? 172.21.2.104:0/4086756401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:22 gibba004 bash[30897]: audit 2021-03-10T20:50:20.807192+0000 mgr.gibba009.xiladd (mgr.34457) 2136 : audit [DBG] from='client.55483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:23.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:22 gibba004 bash[30897]: cluster 2021-03-10T20:50:21.754898+0000 mgr.gibba009.xiladd (mgr.34457) 2137 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:23.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:22 gibba004 bash[31878]: audit 2021-03-10T20:50:20.807192+0000 mgr.gibba009.xiladd (mgr.34457) 2136 : audit [DBG] from='client.55483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:23.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:22 gibba004 bash[31878]: cluster 2021-03-10T20:50:21.754898+0000 mgr.gibba009.xiladd (mgr.34457) 2137 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:23.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:22 gibba009 bash[26136]: audit 2021-03-10T20:50:20.807192+0000 mgr.gibba009.xiladd (mgr.34457) 2136 : audit [DBG] from='client.55483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:23.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:22 gibba009 bash[26136]: cluster 2021-03-10T20:50:21.754898+0000 mgr.gibba009.xiladd (mgr.34457) 2137 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:23 gibba009 bash[26136]: cluster 2021-03-10T20:50:23.756294+0000 mgr.gibba009.xiladd (mgr.34457) 2138 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:24.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:23 gibba004 bash[30897]: cluster 2021-03-10T20:50:23.756294+0000 mgr.gibba009.xiladd (mgr.34457) 2138 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:24.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:23 gibba004 bash[31878]: cluster 2021-03-10T20:50:23.756294+0000 mgr.gibba009.xiladd (mgr.34457) 2138 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:26.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:25 gibba009 bash[26136]: cluster 2021-03-10T20:50:25.757964+0000 mgr.gibba009.xiladd (mgr.34457) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:26.312 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:25 gibba004 bash[30897]: cluster 2021-03-10T20:50:25.757964+0000 mgr.gibba009.xiladd (mgr.34457) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:26.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:25 gibba004 bash[31878]: cluster 2021-03-10T20:50:25.757964+0000 mgr.gibba009.xiladd (mgr.34457) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:27.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.187486+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.191207+0000 mgr.gibba009.xiladd (mgr.34457) 2140 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:50:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.193121+0000 mgr.gibba009.xiladd (mgr.34457) 2141 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:50:27.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.420847+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:50:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.422985+0000 mgr.gibba009.xiladd (mgr.34457) 2142 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.424867+0000 mon.c (mon.1) 653 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.425002+0000 mgr.gibba009.xiladd (mgr.34457) 2143 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.426419+0000 mgr.gibba009.xiladd (mgr.34457) 2144 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:27.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.426459+0000 mgr.gibba009.xiladd (mgr.34457) 2145 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.426740+0000 mon.c (mon.1) 654 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.427903+0000 mgr.gibba009.xiladd (mgr.34457) 2146 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.427945+0000 mgr.gibba009.xiladd (mgr.34457) 2147 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:27.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.428105+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.429025+0000 mgr.gibba009.xiladd (mgr.34457) 2148 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:27.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.429512+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.430338+0000 mgr.gibba009.xiladd (mgr.34457) 2149 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.430380+0000 mgr.gibba009.xiladd (mgr.34457) 2150 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.431616+0000 mgr.gibba009.xiladd (mgr.34457) 2151 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:27.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.431966+0000 mgr.gibba009.xiladd (mgr.34457) 2152 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.432054+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.433048+0000 mgr.gibba009.xiladd (mgr.34457) 2153 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:27.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.187486+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.191207+0000 mgr.gibba009.xiladd (mgr.34457) 2140 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:50:27.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.193121+0000 mgr.gibba009.xiladd (mgr.34457) 2141 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:50:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.420847+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:50:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.422985+0000 mgr.gibba009.xiladd (mgr.34457) 2142 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.424867+0000 mon.c (mon.1) 653 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.425002+0000 mgr.gibba009.xiladd (mgr.34457) 2143 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.426419+0000 mgr.gibba009.xiladd (mgr.34457) 2144 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.426459+0000 mgr.gibba009.xiladd (mgr.34457) 2145 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:27.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.426740+0000 mon.c (mon.1) 654 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.427903+0000 mgr.gibba009.xiladd (mgr.34457) 2146 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:27.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.427945+0000 mgr.gibba009.xiladd (mgr.34457) 2147 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:27.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.428105+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.429025+0000 mgr.gibba009.xiladd (mgr.34457) 2148 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.429512+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.430338+0000 mgr.gibba009.xiladd (mgr.34457) 2149 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.430380+0000 mgr.gibba009.xiladd (mgr.34457) 2150 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.431616+0000 mgr.gibba009.xiladd (mgr.34457) 2151 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:27.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.431966+0000 mgr.gibba009.xiladd (mgr.34457) 2152 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.432054+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.433048+0000 mgr.gibba009.xiladd (mgr.34457) 2153 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.433094+0000 mgr.gibba009.xiladd (mgr.34457) 2154 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:27.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: cephadm 2021-03-10T20:50:26.433242+0000 mgr.gibba009.xiladd (mgr.34457) 2155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:27.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[31878]: audit 2021-03-10T20:50:26.433508+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.433094+0000 mgr.gibba009.xiladd (mgr.34457) 2154 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:27.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: cephadm 2021-03-10T20:50:26.433242+0000 mgr.gibba009.xiladd (mgr.34457) 2155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:27.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:26 gibba004 bash[30897]: audit 2021-03-10T20:50:26.433508+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.187486+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.191207+0000 mgr.gibba009.xiladd (mgr.34457) 2140 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:50:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.193121+0000 mgr.gibba009.xiladd (mgr.34457) 2141 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:50:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.420847+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:50:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.422985+0000 mgr.gibba009.xiladd (mgr.34457) 2142 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.424867+0000 mon.c (mon.1) 653 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.425002+0000 mgr.gibba009.xiladd (mgr.34457) 2143 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.426419+0000 mgr.gibba009.xiladd (mgr.34457) 2144 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.426459+0000 mgr.gibba009.xiladd (mgr.34457) 2145 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.426740+0000 mon.c (mon.1) 654 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.427903+0000 mgr.gibba009.xiladd (mgr.34457) 2146 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.427945+0000 mgr.gibba009.xiladd (mgr.34457) 2147 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:27.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.428105+0000 mon.c (mon.1) 655 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.429025+0000 mgr.gibba009.xiladd (mgr.34457) 2148 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.429512+0000 mon.c (mon.1) 656 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.430338+0000 mgr.gibba009.xiladd (mgr.34457) 2149 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.430380+0000 mgr.gibba009.xiladd (mgr.34457) 2150 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:27.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.431616+0000 mgr.gibba009.xiladd (mgr.34457) 2151 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:27.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.431966+0000 mgr.gibba009.xiladd (mgr.34457) 2152 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:27.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.432054+0000 mon.c (mon.1) 657 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:27.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.433048+0000 mgr.gibba009.xiladd (mgr.34457) 2153 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:27.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.433094+0000 mgr.gibba009.xiladd (mgr.34457) 2154 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:27.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: cephadm 2021-03-10T20:50:26.433242+0000 mgr.gibba009.xiladd (mgr.34457) 2155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:27.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:26 gibba009 bash[26136]: audit 2021-03-10T20:50:26.433508+0000 mon.c (mon.1) 658 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:28.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:27 gibba004 bash[30897]: cluster 2021-03-10T20:50:27.759329+0000 mgr.gibba009.xiladd (mgr.34457) 2156 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:27 gibba004 bash[31878]: cluster 2021-03-10T20:50:27.759329+0000 mgr.gibba009.xiladd (mgr.34457) 2156 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:27 gibba009 bash[26136]: cluster 2021-03-10T20:50:27.759329+0000 mgr.gibba009.xiladd (mgr.34457) 2156 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:31.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:30 gibba004 bash[30897]: cluster 2021-03-10T20:50:29.761047+0000 mgr.gibba009.xiladd (mgr.34457) 2157 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:31.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:30 gibba004 bash[31878]: cluster 2021-03-10T20:50:29.761047+0000 mgr.gibba009.xiladd (mgr.34457) 2157 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:31.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:30 gibba009 bash[26136]: cluster 2021-03-10T20:50:29.761047+0000 mgr.gibba009.xiladd (mgr.34457) 2157 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:31 gibba009 bash[26136]: cluster 2021-03-10T20:50:31.761734+0000 mgr.gibba009.xiladd (mgr.34457) 2158 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:31 gibba004 bash[30897]: cluster 2021-03-10T20:50:31.761734+0000 mgr.gibba009.xiladd (mgr.34457) 2158 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:31 gibba004 bash[31878]: cluster 2021-03-10T20:50:31.761734+0000 mgr.gibba009.xiladd (mgr.34457) 2158 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:33 gibba009 bash[26136]: cluster 2021-03-10T20:50:33.762594+0000 mgr.gibba009.xiladd (mgr.34457) 2159 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:33 gibba004 bash[30897]: cluster 2021-03-10T20:50:33.762594+0000 mgr.gibba009.xiladd (mgr.34457) 2159 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:33 gibba004 bash[31878]: cluster 2021-03-10T20:50:33.762594+0000 mgr.gibba009.xiladd (mgr.34457) 2159 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:35 gibba009 bash[26136]: cluster 2021-03-10T20:50:35.764289+0000 mgr.gibba009.xiladd (mgr.34457) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:35 gibba004 bash[30897]: cluster 2021-03-10T20:50:35.764289+0000 mgr.gibba009.xiladd (mgr.34457) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:35 gibba004 bash[31878]: cluster 2021-03-10T20:50:35.764289+0000 mgr.gibba009.xiladd (mgr.34457) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:37 gibba009 bash[26136]: cluster 2021-03-10T20:50:37.765906+0000 mgr.gibba009.xiladd (mgr.34457) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:37 gibba004 bash[30897]: cluster 2021-03-10T20:50:37.765906+0000 mgr.gibba009.xiladd (mgr.34457) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:37 gibba004 bash[31878]: cluster 2021-03-10T20:50:37.765906+0000 mgr.gibba009.xiladd (mgr.34457) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: cluster 2021-03-10T20:50:39.767675+0000 mgr.gibba009.xiladd (mgr.34457) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.822902+0000 mon.c (mon.1) 659 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.823539+0000 mon.c (mon.1) 660 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.824088+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.825271+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.829621+0000 mon.c (mon.1) 661 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.830396+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.831028+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.831059+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.831814+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.833250+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.834053+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[30897]: audit 2021-03-10T20:50:39.834802+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: cluster 2021-03-10T20:50:39.767675+0000 mgr.gibba009.xiladd (mgr.34457) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.822902+0000 mon.c (mon.1) 659 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.823539+0000 mon.c (mon.1) 660 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.824088+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.825271+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.829621+0000 mon.c (mon.1) 661 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.830396+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.831028+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.831059+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.831814+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.833250+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.834053+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:40 gibba004 bash[31878]: audit 2021-03-10T20:50:39.834802+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:41.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: cluster 2021-03-10T20:50:39.767675+0000 mgr.gibba009.xiladd (mgr.34457) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:41.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.822902+0000 mon.c (mon.1) 659 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.823539+0000 mon.c (mon.1) 660 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.824088+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.825271+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.829621+0000 mon.c (mon.1) 661 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.830396+0000 mon.c (mon.1) 662 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.831028+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:50:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.831059+0000 mon.c (mon.1) 663 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.831814+0000 mon.c (mon.1) 664 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.833250+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.834053+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:50:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:40 gibba009 bash[26136]: audit 2021-03-10T20:50:39.834802+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:50:42.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:41 gibba009 bash[26136]: cephadm 2021-03-10T20:50:41.449370+0000 mgr.gibba009.xiladd (mgr.34457) 2163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:42.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:41 gibba009 bash[26136]: cluster 2021-03-10T20:50:41.768257+0000 mgr.gibba009.xiladd (mgr.34457) 2164 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:41 gibba004 bash[30897]: cephadm 2021-03-10T20:50:41.449370+0000 mgr.gibba009.xiladd (mgr.34457) 2163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:42.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:41 gibba004 bash[30897]: cluster 2021-03-10T20:50:41.768257+0000 mgr.gibba009.xiladd (mgr.34457) 2164 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:42.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:41 gibba004 bash[31878]: cephadm 2021-03-10T20:50:41.449370+0000 mgr.gibba009.xiladd (mgr.34457) 2163 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:42.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:41 gibba004 bash[31878]: cluster 2021-03-10T20:50:41.768257+0000 mgr.gibba009.xiladd (mgr.34457) 2164 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:43 gibba004 bash[30897]: cluster 2021-03-10T20:50:43.769939+0000 mgr.gibba009.xiladd (mgr.34457) 2165 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:43 gibba004 bash[31878]: cluster 2021-03-10T20:50:43.769939+0000 mgr.gibba009.xiladd (mgr.34457) 2165 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:43 gibba009 bash[26136]: cluster 2021-03-10T20:50:43.769939+0000 mgr.gibba009.xiladd (mgr.34457) 2165 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:45 gibba004 bash[30897]: cluster 2021-03-10T20:50:45.771481+0000 mgr.gibba009.xiladd (mgr.34457) 2166 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:45 gibba004 bash[31878]: cluster 2021-03-10T20:50:45.771481+0000 mgr.gibba009.xiladd (mgr.34457) 2166 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:45 gibba009 bash[26136]: cluster 2021-03-10T20:50:45.771481+0000 mgr.gibba009.xiladd (mgr.34457) 2166 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:48.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:47 gibba004 bash[30897]: cluster 2021-03-10T20:50:47.773041+0000 mgr.gibba009.xiladd (mgr.34457) 2167 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:48.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:47 gibba004 bash[31878]: cluster 2021-03-10T20:50:47.773041+0000 mgr.gibba009.xiladd (mgr.34457) 2167 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:48.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:47 gibba009 bash[26136]: cluster 2021-03-10T20:50:47.773041+0000 mgr.gibba009.xiladd (mgr.34457) 2167 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:51.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:50 gibba004 bash[30897]: cluster 2021-03-10T20:50:49.774798+0000 mgr.gibba009.xiladd (mgr.34457) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:51.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:50 gibba004 bash[31878]: cluster 2021-03-10T20:50:49.774798+0000 mgr.gibba009.xiladd (mgr.34457) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:51.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:50 gibba009 bash[26136]: cluster 2021-03-10T20:50:49.774798+0000 mgr.gibba009.xiladd (mgr.34457) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:51.315 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:50:51.541 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:50:51.542 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (39m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:50:51.542 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (44m) 4m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:50:51.542 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:50:51.542 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:50:51.543 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:50:51.543 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:50:51.543 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:50:51.543 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:50:51.544 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:50:51.544 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:50:51.544 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:50:51.544 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:50:51.544 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:50:51.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:50:51.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:50:51.545 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:50:51.546 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:50:51.546 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (35m) 4m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:50:51.546 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (44m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:50:51.546 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:51.547 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:51.795 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:50:51.795 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:50:51.796 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:51.796 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:51.796 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:50:51.796 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:51.796 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:51.797 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:50:51.797 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:50:51.797 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:50:51.797 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:50:51.798 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:50:51.798 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:50:51.798 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:50:51.798 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:50:52.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[30897]: audit 2021-03-10T20:50:51.303702+0000 mgr.gibba009.xiladd (mgr.34457) 2169 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[30897]: audit 2021-03-10T20:50:51.526791+0000 mgr.gibba009.xiladd (mgr.34457) 2170 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[30897]: cluster 2021-03-10T20:50:51.775738+0000 mgr.gibba009.xiladd (mgr.34457) 2171 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[30897]: audit 2021-03-10T20:50:51.794748+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.2.104:0/3673291784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[31878]: audit 2021-03-10T20:50:51.303702+0000 mgr.gibba009.xiladd (mgr.34457) 2169 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[31878]: audit 2021-03-10T20:50:51.526791+0000 mgr.gibba009.xiladd (mgr.34457) 2170 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[31878]: cluster 2021-03-10T20:50:51.775738+0000 mgr.gibba009.xiladd (mgr.34457) 2171 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:51 gibba004 bash[31878]: audit 2021-03-10T20:50:51.794748+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.2.104:0/3673291784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:52.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:51 gibba009 bash[26136]: audit 2021-03-10T20:50:51.303702+0000 mgr.gibba009.xiladd (mgr.34457) 2169 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:51 gibba009 bash[26136]: audit 2021-03-10T20:50:51.526791+0000 mgr.gibba009.xiladd (mgr.34457) 2170 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:51 gibba009 bash[26136]: cluster 2021-03-10T20:50:51.775738+0000 mgr.gibba009.xiladd (mgr.34457) 2171 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:51 gibba009 bash[26136]: audit 2021-03-10T20:50:51.794748+0000 mon.a (mon.0) 881 : audit [DBG] from='client.? 172.21.2.104:0/3673291784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:54.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:53 gibba004 bash[30897]: cluster 2021-03-10T20:50:53.777327+0000 mgr.gibba009.xiladd (mgr.34457) 2172 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:54.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:53 gibba004 bash[31878]: cluster 2021-03-10T20:50:53.777327+0000 mgr.gibba009.xiladd (mgr.34457) 2172 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:54.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:53 gibba009 bash[26136]: cluster 2021-03-10T20:50:53.777327+0000 mgr.gibba009.xiladd (mgr.34457) 2172 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:55 gibba004 bash[30897]: cluster 2021-03-10T20:50:55.779026+0000 mgr.gibba009.xiladd (mgr.34457) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:55 gibba004 bash[31878]: cluster 2021-03-10T20:50:55.779026+0000 mgr.gibba009.xiladd (mgr.34457) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:55 gibba009 bash[26136]: cluster 2021-03-10T20:50:55.779026+0000 mgr.gibba009.xiladd (mgr.34457) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:57.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:56 gibba004 bash[30897]: cephadm 2021-03-10T20:50:56.453629+0000 mgr.gibba009.xiladd (mgr.34457) 2174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:57.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:56 gibba004 bash[31878]: cephadm 2021-03-10T20:50:56.453629+0000 mgr.gibba009.xiladd (mgr.34457) 2174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:57.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:56 gibba009 bash[26136]: cephadm 2021-03-10T20:50:56.453629+0000 mgr.gibba009.xiladd (mgr.34457) 2174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:50:58.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:50:57 gibba004 bash[30897]: cluster 2021-03-10T20:50:57.780427+0000 mgr.gibba009.xiladd (mgr.34457) 2175 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:58.313 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:50:57 gibba004 bash[31878]: cluster 2021-03-10T20:50:57.780427+0000 mgr.gibba009.xiladd (mgr.34457) 2175 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:58.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:50:57 gibba009 bash[26136]: cluster 2021-03-10T20:50:57.780427+0000 mgr.gibba009.xiladd (mgr.34457) 2175 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:01.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:00 gibba004 bash[30897]: cluster 2021-03-10T20:50:59.782071+0000 mgr.gibba009.xiladd (mgr.34457) 2176 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:01.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:00 gibba004 bash[31878]: cluster 2021-03-10T20:50:59.782071+0000 mgr.gibba009.xiladd (mgr.34457) 2176 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:01.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:00 gibba009 bash[26136]: cluster 2021-03-10T20:50:59.782071+0000 mgr.gibba009.xiladd (mgr.34457) 2176 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:01 gibba004 bash[30897]: cluster 2021-03-10T20:51:01.782806+0000 mgr.gibba009.xiladd (mgr.34457) 2177 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:01 gibba004 bash[31878]: cluster 2021-03-10T20:51:01.782806+0000 mgr.gibba009.xiladd (mgr.34457) 2177 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:01 gibba009 bash[26136]: cluster 2021-03-10T20:51:01.782806+0000 mgr.gibba009.xiladd (mgr.34457) 2177 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:04.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:03 gibba004 bash[30897]: cluster 2021-03-10T20:51:03.784230+0000 mgr.gibba009.xiladd (mgr.34457) 2178 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:04.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:03 gibba004 bash[31878]: cluster 2021-03-10T20:51:03.784230+0000 mgr.gibba009.xiladd (mgr.34457) 2178 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:04.338 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:03 gibba009 bash[26136]: cluster 2021-03-10T20:51:03.784230+0000 mgr.gibba009.xiladd (mgr.34457) 2178 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:05 gibba004 bash[30897]: cluster 2021-03-10T20:51:05.785906+0000 mgr.gibba009.xiladd (mgr.34457) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:05 gibba004 bash[31878]: cluster 2021-03-10T20:51:05.785906+0000 mgr.gibba009.xiladd (mgr.34457) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:05 gibba009 bash[26136]: cluster 2021-03-10T20:51:05.785906+0000 mgr.gibba009.xiladd (mgr.34457) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:09.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:08 gibba004 bash[30897]: cluster 2021-03-10T20:51:07.787490+0000 mgr.gibba009.xiladd (mgr.34457) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:09.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:08 gibba004 bash[31878]: cluster 2021-03-10T20:51:07.787490+0000 mgr.gibba009.xiladd (mgr.34457) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:09.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:08 gibba009 bash[26136]: cluster 2021-03-10T20:51:07.787490+0000 mgr.gibba009.xiladd (mgr.34457) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:11.839 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:11 gibba009 bash[26136]: cluster 2021-03-10T20:51:09.789117+0000 mgr.gibba009.xiladd (mgr.34457) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:12.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:11 gibba004 bash[30897]: cluster 2021-03-10T20:51:09.789117+0000 mgr.gibba009.xiladd (mgr.34457) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:12.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:11 gibba004 bash[31878]: cluster 2021-03-10T20:51:09.789117+0000 mgr.gibba009.xiladd (mgr.34457) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:13.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:12 gibba004 bash[30897]: cephadm 2021-03-10T20:51:11.469677+0000 mgr.gibba009.xiladd (mgr.34457) 2182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:13.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:12 gibba004 bash[31878]: cephadm 2021-03-10T20:51:11.469677+0000 mgr.gibba009.xiladd (mgr.34457) 2182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:13.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:12 gibba009 bash[26136]: cephadm 2021-03-10T20:51:11.469677+0000 mgr.gibba009.xiladd (mgr.34457) 2182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:14.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:13 gibba004 bash[30897]: cluster 2021-03-10T20:51:11.789931+0000 mgr.gibba009.xiladd (mgr.34457) 2183 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:14.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:13 gibba004 bash[31878]: cluster 2021-03-10T20:51:11.789931+0000 mgr.gibba009.xiladd (mgr.34457) 2183 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:14.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:13 gibba009 bash[26136]: cluster 2021-03-10T20:51:11.789931+0000 mgr.gibba009.xiladd (mgr.34457) 2183 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:15 gibba004 bash[30897]: cluster 2021-03-10T20:51:13.791235+0000 mgr.gibba009.xiladd (mgr.34457) 2184 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:15 gibba004 bash[31878]: cluster 2021-03-10T20:51:13.791235+0000 mgr.gibba009.xiladd (mgr.34457) 2184 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:15 gibba009 bash[26136]: cluster 2021-03-10T20:51:13.791235+0000 mgr.gibba009.xiladd (mgr.34457) 2184 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:17 gibba004 bash[30897]: cluster 2021-03-10T20:51:15.792900+0000 mgr.gibba009.xiladd (mgr.34457) 2185 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:17 gibba004 bash[31878]: cluster 2021-03-10T20:51:15.792900+0000 mgr.gibba009.xiladd (mgr.34457) 2185 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:18.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:17 gibba009 bash[26136]: cluster 2021-03-10T20:51:15.792900+0000 mgr.gibba009.xiladd (mgr.34457) 2185 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:19 gibba004 bash[30897]: cluster 2021-03-10T20:51:17.794474+0000 mgr.gibba009.xiladd (mgr.34457) 2186 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:19 gibba004 bash[31878]: cluster 2021-03-10T20:51:17.794474+0000 mgr.gibba009.xiladd (mgr.34457) 2186 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:19 gibba009 bash[26136]: cluster 2021-03-10T20:51:17.794474+0000 mgr.gibba009.xiladd (mgr.34457) 2186 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.044 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:51:22.062 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:21 gibba004 bash[30897]: cluster 2021-03-10T20:51:19.796082+0000 mgr.gibba009.xiladd (mgr.34457) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:21 gibba004 bash[31878]: cluster 2021-03-10T20:51:19.796082+0000 mgr.gibba009.xiladd (mgr.34457) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:21 gibba009 bash[26136]: cluster 2021-03-10T20:51:19.796082+0000 mgr.gibba009.xiladd (mgr.34457) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.274 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:51:22.275 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (40m) 6m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:51:22.275 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:51:22.276 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (40m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:51:22.276 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (41m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:51:22.277 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (39m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:51:22.277 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (39m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:51:22.277 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:51:22.277 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:51:22.278 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (45m) 6m ago 45m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:51:22.278 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:51:22.278 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:51:22.278 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:51:22.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:51:22.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:51:22.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:51:22.279 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:51:22.280 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:51:22.280 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:51:22.280 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (45m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:51:22.280 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:22.281 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:22.530 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:51:22.530 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:51:22.530 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:22.531 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:22.531 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:51:22.531 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:22.531 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:22.531 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:51:22.532 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:51:22.532 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:22.532 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:51:22.532 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:51:22.533 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:51:22.533 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:51:22.533 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:51:23.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:22 gibba004 bash[30897]: audit 2021-03-10T20:51:22.529069+0000 mon.c (mon.1) 665 : audit [DBG] from='client.? 172.21.2.104:0/1139309545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:23.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:22 gibba004 bash[31878]: audit 2021-03-10T20:51:22.529069+0000 mon.c (mon.1) 665 : audit [DBG] from='client.? 172.21.2.104:0/1139309545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:23.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:22 gibba009 bash[26136]: audit 2021-03-10T20:51:22.529069+0000 mon.c (mon.1) 665 : audit [DBG] from='client.? 172.21.2.104:0/1139309545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[30897]: cluster 2021-03-10T20:51:21.797576+0000 mgr.gibba009.xiladd (mgr.34457) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[30897]: audit 2021-03-10T20:51:22.033506+0000 mgr.gibba009.xiladd (mgr.34457) 2189 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[30897]: audit 2021-03-10T20:51:22.259979+0000 mgr.gibba009.xiladd (mgr.34457) 2190 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[31878]: cluster 2021-03-10T20:51:21.797576+0000 mgr.gibba009.xiladd (mgr.34457) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[31878]: audit 2021-03-10T20:51:22.033506+0000 mgr.gibba009.xiladd (mgr.34457) 2189 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:23 gibba004 bash[31878]: audit 2021-03-10T20:51:22.259979+0000 mgr.gibba009.xiladd (mgr.34457) 2190 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:24.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:23 gibba009 bash[26136]: cluster 2021-03-10T20:51:21.797576+0000 mgr.gibba009.xiladd (mgr.34457) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:23 gibba009 bash[26136]: audit 2021-03-10T20:51:22.033506+0000 mgr.gibba009.xiladd (mgr.34457) 2189 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:23 gibba009 bash[26136]: audit 2021-03-10T20:51:22.259979+0000 mgr.gibba009.xiladd (mgr.34457) 2190 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:25 gibba004 bash[30897]: cluster 2021-03-10T20:51:23.798985+0000 mgr.gibba009.xiladd (mgr.34457) 2191 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:26.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:25 gibba004 bash[31878]: cluster 2021-03-10T20:51:23.798985+0000 mgr.gibba009.xiladd (mgr.34457) 2191 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:26.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:25 gibba009 bash[26136]: cluster 2021-03-10T20:51:23.798985+0000 mgr.gibba009.xiladd (mgr.34457) 2191 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:26 gibba004 bash[30897]: audit 2021-03-10T20:51:26.473039+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:27.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:26 gibba004 bash[31878]: audit 2021-03-10T20:51:26.473039+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:26 gibba009 bash[26136]: audit 2021-03-10T20:51:26.473039+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cluster 2021-03-10T20:51:25.800785+0000 mgr.gibba009.xiladd (mgr.34457) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.477725+0000 mgr.gibba009.xiladd (mgr.34457) 2193 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:51:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.479316+0000 mgr.gibba009.xiladd (mgr.34457) 2194 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:51:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.693947+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:51:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.695841+0000 mgr.gibba009.xiladd (mgr.34457) 2195 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.697522+0000 mgr.gibba009.xiladd (mgr.34457) 2196 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.697722+0000 mon.c (mon.1) 667 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.699339+0000 mgr.gibba009.xiladd (mgr.34457) 2197 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.699388+0000 mgr.gibba009.xiladd (mgr.34457) 2198 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.699417+0000 mon.c (mon.1) 668 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.700791+0000 mgr.gibba009.xiladd (mgr.34457) 2199 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.700840+0000 mgr.gibba009.xiladd (mgr.34457) 2200 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.701143+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.702119+0000 mgr.gibba009.xiladd (mgr.34457) 2201 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.702557+0000 mon.c (mon.1) 670 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.703527+0000 mgr.gibba009.xiladd (mgr.34457) 2202 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.703576+0000 mgr.gibba009.xiladd (mgr.34457) 2203 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.704979+0000 mgr.gibba009.xiladd (mgr.34457) 2204 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:28.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.705355+0000 mon.c (mon.1) 671 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.705382+0000 mgr.gibba009.xiladd (mgr.34457) 2205 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.706953+0000 mgr.gibba009.xiladd (mgr.34457) 2206 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.707010+0000 mgr.gibba009.xiladd (mgr.34457) 2207 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:28.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: cephadm 2021-03-10T20:51:26.707183+0000 mgr.gibba009.xiladd (mgr.34457) 2208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:28.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[30897]: audit 2021-03-10T20:51:26.707457+0000 mon.c (mon.1) 672 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cluster 2021-03-10T20:51:25.800785+0000 mgr.gibba009.xiladd (mgr.34457) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.477725+0000 mgr.gibba009.xiladd (mgr.34457) 2193 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:51:28.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.479316+0000 mgr.gibba009.xiladd (mgr.34457) 2194 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:51:28.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.693947+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:51:28.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.695841+0000 mgr.gibba009.xiladd (mgr.34457) 2195 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:28.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.697522+0000 mgr.gibba009.xiladd (mgr.34457) 2196 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:28.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.697722+0000 mon.c (mon.1) 667 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:28.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.699339+0000 mgr.gibba009.xiladd (mgr.34457) 2197 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:28.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.699388+0000 mgr.gibba009.xiladd (mgr.34457) 2198 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:28.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.699417+0000 mon.c (mon.1) 668 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.700791+0000 mgr.gibba009.xiladd (mgr.34457) 2199 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.700840+0000 mgr.gibba009.xiladd (mgr.34457) 2200 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.701143+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.702119+0000 mgr.gibba009.xiladd (mgr.34457) 2201 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:28.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.702557+0000 mon.c (mon.1) 670 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.703527+0000 mgr.gibba009.xiladd (mgr.34457) 2202 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.703576+0000 mgr.gibba009.xiladd (mgr.34457) 2203 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.704979+0000 mgr.gibba009.xiladd (mgr.34457) 2204 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.705355+0000 mon.c (mon.1) 671 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.705382+0000 mgr.gibba009.xiladd (mgr.34457) 2205 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.706953+0000 mgr.gibba009.xiladd (mgr.34457) 2206 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.707010+0000 mgr.gibba009.xiladd (mgr.34457) 2207 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: cephadm 2021-03-10T20:51:26.707183+0000 mgr.gibba009.xiladd (mgr.34457) 2208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:28.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:27 gibba004 bash[31878]: audit 2021-03-10T20:51:26.707457+0000 mon.c (mon.1) 672 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cluster 2021-03-10T20:51:25.800785+0000 mgr.gibba009.xiladd (mgr.34457) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.477725+0000 mgr.gibba009.xiladd (mgr.34457) 2193 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:51:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.479316+0000 mgr.gibba009.xiladd (mgr.34457) 2194 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:51:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.693947+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:51:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.695841+0000 mgr.gibba009.xiladd (mgr.34457) 2195 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.697522+0000 mgr.gibba009.xiladd (mgr.34457) 2196 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.697722+0000 mon.c (mon.1) 667 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.699339+0000 mgr.gibba009.xiladd (mgr.34457) 2197 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.699388+0000 mgr.gibba009.xiladd (mgr.34457) 2198 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.699417+0000 mon.c (mon.1) 668 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.700791+0000 mgr.gibba009.xiladd (mgr.34457) 2199 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.700840+0000 mgr.gibba009.xiladd (mgr.34457) 2200 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.701143+0000 mon.c (mon.1) 669 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.702119+0000 mgr.gibba009.xiladd (mgr.34457) 2201 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.702557+0000 mon.c (mon.1) 670 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.703527+0000 mgr.gibba009.xiladd (mgr.34457) 2202 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.703576+0000 mgr.gibba009.xiladd (mgr.34457) 2203 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.704979+0000 mgr.gibba009.xiladd (mgr.34457) 2204 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:28.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.705355+0000 mon.c (mon.1) 671 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:28.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.705382+0000 mgr.gibba009.xiladd (mgr.34457) 2205 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:28.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.706953+0000 mgr.gibba009.xiladd (mgr.34457) 2206 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:28.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.707010+0000 mgr.gibba009.xiladd (mgr.34457) 2207 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:28.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: cephadm 2021-03-10T20:51:26.707183+0000 mgr.gibba009.xiladd (mgr.34457) 2208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:28.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:27 gibba009 bash[26136]: audit 2021-03-10T20:51:26.707457+0000 mon.c (mon.1) 672 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:30.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:29 gibba004 bash[30897]: cluster 2021-03-10T20:51:27.802198+0000 mgr.gibba009.xiladd (mgr.34457) 2209 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:30.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:29 gibba004 bash[31878]: cluster 2021-03-10T20:51:27.802198+0000 mgr.gibba009.xiladd (mgr.34457) 2209 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:30.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:29 gibba009 bash[26136]: cluster 2021-03-10T20:51:27.802198+0000 mgr.gibba009.xiladd (mgr.34457) 2209 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:31 gibba004 bash[30897]: cluster 2021-03-10T20:51:29.803735+0000 mgr.gibba009.xiladd (mgr.34457) 2210 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:31 gibba004 bash[31878]: cluster 2021-03-10T20:51:29.803735+0000 mgr.gibba009.xiladd (mgr.34457) 2210 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:31 gibba009 bash[26136]: cluster 2021-03-10T20:51:29.803735+0000 mgr.gibba009.xiladd (mgr.34457) 2210 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:33 gibba004 bash[30897]: cluster 2021-03-10T20:51:31.805149+0000 mgr.gibba009.xiladd (mgr.34457) 2211 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:33 gibba004 bash[31878]: cluster 2021-03-10T20:51:31.805149+0000 mgr.gibba009.xiladd (mgr.34457) 2211 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:33 gibba009 bash[26136]: cluster 2021-03-10T20:51:31.805149+0000 mgr.gibba009.xiladd (mgr.34457) 2211 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:35 gibba004 bash[30897]: cluster 2021-03-10T20:51:33.806496+0000 mgr.gibba009.xiladd (mgr.34457) 2212 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:35 gibba004 bash[31878]: cluster 2021-03-10T20:51:33.806496+0000 mgr.gibba009.xiladd (mgr.34457) 2212 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:35 gibba009 bash[26136]: cluster 2021-03-10T20:51:33.806496+0000 mgr.gibba009.xiladd (mgr.34457) 2212 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:37 gibba004 bash[30897]: cluster 2021-03-10T20:51:35.807794+0000 mgr.gibba009.xiladd (mgr.34457) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:37 gibba004 bash[31878]: cluster 2021-03-10T20:51:35.807794+0000 mgr.gibba009.xiladd (mgr.34457) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:37 gibba009 bash[26136]: cluster 2021-03-10T20:51:35.807794+0000 mgr.gibba009.xiladd (mgr.34457) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:39 gibba004 bash[30897]: cluster 2021-03-10T20:51:37.809230+0000 mgr.gibba009.xiladd (mgr.34457) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:40.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:39 gibba004 bash[31878]: cluster 2021-03-10T20:51:37.809230+0000 mgr.gibba009.xiladd (mgr.34457) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:40.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:39 gibba009 bash[26136]: cluster 2021-03-10T20:51:37.809230+0000 mgr.gibba009.xiladd (mgr.34457) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:41.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.830554+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.831173+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.831731+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.833061+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.836274+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.836966+0000 mon.c (mon.1) 676 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.837438+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.837681+0000 mon.c (mon.1) 677 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.838395+0000 mon.c (mon.1) 678 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.839489+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.840694+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[30897]: audit 2021-03-10T20:51:39.841593+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.830554+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.831173+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.831731+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.833061+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.836274+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.836966+0000 mon.c (mon.1) 676 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.837438+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.837681+0000 mon.c (mon.1) 677 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.838395+0000 mon.c (mon.1) 678 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.839489+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.840694+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:40 gibba004 bash[31878]: audit 2021-03-10T20:51:39.841593+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:41.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.830554+0000 mon.c (mon.1) 673 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.831173+0000 mon.c (mon.1) 674 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.831731+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.833061+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.836274+0000 mon.c (mon.1) 675 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.836966+0000 mon.c (mon.1) 676 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.837438+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:51:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.837681+0000 mon.c (mon.1) 677 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.838395+0000 mon.c (mon.1) 678 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.839489+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.840694+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:51:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:40 gibba009 bash[26136]: audit 2021-03-10T20:51:39.841593+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:42.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:41 gibba004 bash[30897]: cluster 2021-03-10T20:51:39.810362+0000 mgr.gibba009.xiladd (mgr.34457) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:42.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:41 gibba004 bash[31878]: cluster 2021-03-10T20:51:39.810362+0000 mgr.gibba009.xiladd (mgr.34457) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:42.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:41 gibba009 bash[26136]: cluster 2021-03-10T20:51:39.810362+0000 mgr.gibba009.xiladd (mgr.34457) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:43.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:42 gibba004 bash[30897]: cephadm 2021-03-10T20:51:41.721615+0000 mgr.gibba009.xiladd (mgr.34457) 2216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:43.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:42 gibba004 bash[31878]: cephadm 2021-03-10T20:51:41.721615+0000 mgr.gibba009.xiladd (mgr.34457) 2216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:43.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:42 gibba009 bash[26136]: cephadm 2021-03-10T20:51:41.721615+0000 mgr.gibba009.xiladd (mgr.34457) 2216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:44.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:43 gibba004 bash[30897]: cluster 2021-03-10T20:51:41.811742+0000 mgr.gibba009.xiladd (mgr.34457) 2217 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:44.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:43 gibba004 bash[31878]: cluster 2021-03-10T20:51:41.811742+0000 mgr.gibba009.xiladd (mgr.34457) 2217 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:44.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:43 gibba009 bash[26136]: cluster 2021-03-10T20:51:41.811742+0000 mgr.gibba009.xiladd (mgr.34457) 2217 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:45 gibba004 bash[30897]: cluster 2021-03-10T20:51:43.812737+0000 mgr.gibba009.xiladd (mgr.34457) 2218 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:45 gibba004 bash[31878]: cluster 2021-03-10T20:51:43.812737+0000 mgr.gibba009.xiladd (mgr.34457) 2218 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:45 gibba009 bash[26136]: cluster 2021-03-10T20:51:43.812737+0000 mgr.gibba009.xiladd (mgr.34457) 2218 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:47 gibba004 bash[30897]: cluster 2021-03-10T20:51:45.813204+0000 mgr.gibba009.xiladd (mgr.34457) 2219 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:47 gibba004 bash[31878]: cluster 2021-03-10T20:51:45.813204+0000 mgr.gibba009.xiladd (mgr.34457) 2219 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:48.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:47 gibba009 bash[26136]: cluster 2021-03-10T20:51:45.813204+0000 mgr.gibba009.xiladd (mgr.34457) 2219 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:49 gibba004 bash[30897]: cluster 2021-03-10T20:51:47.813758+0000 mgr.gibba009.xiladd (mgr.34457) 2220 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:49 gibba004 bash[31878]: cluster 2021-03-10T20:51:47.813758+0000 mgr.gibba009.xiladd (mgr.34457) 2220 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:49 gibba009 bash[26136]: cluster 2021-03-10T20:51:47.813758+0000 mgr.gibba009.xiladd (mgr.34457) 2220 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:51.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:50 gibba009 bash[26136]: cluster 2021-03-10T20:51:49.814422+0000 mgr.gibba009.xiladd (mgr.34457) 2221 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:51.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:50 gibba004 bash[30897]: cluster 2021-03-10T20:51:49.814422+0000 mgr.gibba009.xiladd (mgr.34457) 2221 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:51.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:50 gibba004 bash[31878]: cluster 2021-03-10T20:51:49.814422+0000 mgr.gibba009.xiladd (mgr.34457) 2221 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:52.773 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:51:53.005 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:51:53.006 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (40m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:51:53.006 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (45m) 5m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:51:53.006 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:51:53.006 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:51:53.007 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:51:53.007 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:51:53.007 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:51:53.007 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:51:53.008 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:51:53.008 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:51:53.008 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:51:53.008 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:51:53.009 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:51:53.009 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:51:53.009 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:51:53.009 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:51:53.010 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:51:53.010 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (36m) 5m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:51:53.010 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (45m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:51:53.010 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:53.011 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:53.253 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:51:53.253 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:51:53.254 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:53.254 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:53.254 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:51:53.254 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:53.255 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:53.255 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:51:53.255 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:51:53.255 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:51:53.256 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:51:53.256 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:51:53.256 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:51:53.256 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:51:53.257 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:51:53.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:52 gibba004 bash[30897]: cluster 2021-03-10T20:51:51.815828+0000 mgr.gibba009.xiladd (mgr.34457) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:53.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:52 gibba004 bash[30897]: audit 2021-03-10T20:51:52.762415+0000 mgr.gibba009.xiladd (mgr.34457) 2223 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:53.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:52 gibba004 bash[31878]: cluster 2021-03-10T20:51:51.815828+0000 mgr.gibba009.xiladd (mgr.34457) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:53.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:52 gibba004 bash[31878]: audit 2021-03-10T20:51:52.762415+0000 mgr.gibba009.xiladd (mgr.34457) 2223 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:53.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:52 gibba009 bash[26136]: cluster 2021-03-10T20:51:51.815828+0000 mgr.gibba009.xiladd (mgr.34457) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:53.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:52 gibba009 bash[26136]: audit 2021-03-10T20:51:52.762415+0000 mgr.gibba009.xiladd (mgr.34457) 2223 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:54.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:53 gibba004 bash[30897]: audit 2021-03-10T20:51:52.990592+0000 mgr.gibba009.xiladd (mgr.34457) 2224 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:54.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:53 gibba004 bash[30897]: audit 2021-03-10T20:51:53.252479+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.104:0/2414093968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:54.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:53 gibba004 bash[31878]: audit 2021-03-10T20:51:52.990592+0000 mgr.gibba009.xiladd (mgr.34457) 2224 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:54.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:53 gibba004 bash[31878]: audit 2021-03-10T20:51:53.252479+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.104:0/2414093968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:54.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:53 gibba009 bash[26136]: audit 2021-03-10T20:51:52.990592+0000 mgr.gibba009.xiladd (mgr.34457) 2224 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:54.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:53 gibba009 bash[26136]: audit 2021-03-10T20:51:53.252479+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.104:0/2414093968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:55 gibba004 bash[30897]: cluster 2021-03-10T20:51:53.816950+0000 mgr.gibba009.xiladd (mgr.34457) 2225 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:56.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:55 gibba004 bash[31878]: cluster 2021-03-10T20:51:53.816950+0000 mgr.gibba009.xiladd (mgr.34457) 2225 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:55 gibba009 bash[26136]: cluster 2021-03-10T20:51:53.816950+0000 mgr.gibba009.xiladd (mgr.34457) 2225 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:57 gibba004 bash[30897]: cluster 2021-03-10T20:51:55.818663+0000 mgr.gibba009.xiladd (mgr.34457) 2226 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.083 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:57 gibba004 bash[30897]: cephadm 2021-03-10T20:51:56.737742+0000 mgr.gibba009.xiladd (mgr.34457) 2227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:58.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:57 gibba004 bash[31878]: cluster 2021-03-10T20:51:55.818663+0000 mgr.gibba009.xiladd (mgr.34457) 2226 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:57 gibba004 bash[31878]: cephadm 2021-03-10T20:51:56.737742+0000 mgr.gibba009.xiladd (mgr.34457) 2227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:51:58.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:57 gibba009 bash[26136]: cluster 2021-03-10T20:51:55.818663+0000 mgr.gibba009.xiladd (mgr.34457) 2226 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:57 gibba009 bash[26136]: cephadm 2021-03-10T20:51:56.737742+0000 mgr.gibba009.xiladd (mgr.34457) 2227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:00.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:51:59 gibba004 bash[30897]: cluster 2021-03-10T20:51:57.820363+0000 mgr.gibba009.xiladd (mgr.34457) 2228 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:00.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:51:59 gibba004 bash[31878]: cluster 2021-03-10T20:51:57.820363+0000 mgr.gibba009.xiladd (mgr.34457) 2228 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:00.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:51:59 gibba009 bash[26136]: cluster 2021-03-10T20:51:57.820363+0000 mgr.gibba009.xiladd (mgr.34457) 2228 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:01 gibba004 bash[30897]: cluster 2021-03-10T20:51:59.822159+0000 mgr.gibba009.xiladd (mgr.34457) 2229 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:01 gibba004 bash[31878]: cluster 2021-03-10T20:51:59.822159+0000 mgr.gibba009.xiladd (mgr.34457) 2229 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:02.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:01 gibba009 bash[26136]: cluster 2021-03-10T20:51:59.822159+0000 mgr.gibba009.xiladd (mgr.34457) 2229 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:03 gibba004 bash[30897]: cluster 2021-03-10T20:52:01.823369+0000 mgr.gibba009.xiladd (mgr.34457) 2230 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:03 gibba004 bash[31878]: cluster 2021-03-10T20:52:01.823369+0000 mgr.gibba009.xiladd (mgr.34457) 2230 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:03 gibba009 bash[26136]: cluster 2021-03-10T20:52:01.823369+0000 mgr.gibba009.xiladd (mgr.34457) 2230 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:05 gibba004 bash[30897]: cluster 2021-03-10T20:52:03.825127+0000 mgr.gibba009.xiladd (mgr.34457) 2231 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:05 gibba004 bash[31878]: cluster 2021-03-10T20:52:03.825127+0000 mgr.gibba009.xiladd (mgr.34457) 2231 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:05 gibba009 bash[26136]: cluster 2021-03-10T20:52:03.825127+0000 mgr.gibba009.xiladd (mgr.34457) 2231 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:07 gibba004 bash[30897]: cluster 2021-03-10T20:52:05.826943+0000 mgr.gibba009.xiladd (mgr.34457) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:07 gibba004 bash[31878]: cluster 2021-03-10T20:52:05.826943+0000 mgr.gibba009.xiladd (mgr.34457) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:07 gibba009 bash[26136]: cluster 2021-03-10T20:52:05.826943+0000 mgr.gibba009.xiladd (mgr.34457) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:10.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:09 gibba004 bash[30897]: cluster 2021-03-10T20:52:07.828562+0000 mgr.gibba009.xiladd (mgr.34457) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:10.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:09 gibba004 bash[31878]: cluster 2021-03-10T20:52:07.828562+0000 mgr.gibba009.xiladd (mgr.34457) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:10.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:09 gibba009 bash[26136]: cluster 2021-03-10T20:52:07.828562+0000 mgr.gibba009.xiladd (mgr.34457) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:11 gibba004 bash[30897]: cluster 2021-03-10T20:52:09.830364+0000 mgr.gibba009.xiladd (mgr.34457) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:11 gibba004 bash[31878]: cluster 2021-03-10T20:52:09.830364+0000 mgr.gibba009.xiladd (mgr.34457) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:11 gibba009 bash[26136]: cluster 2021-03-10T20:52:09.830364+0000 mgr.gibba009.xiladd (mgr.34457) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:13.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:12 gibba004 bash[30897]: cephadm 2021-03-10T20:52:11.753188+0000 mgr.gibba009.xiladd (mgr.34457) 2235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:13.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:12 gibba004 bash[31878]: cephadm 2021-03-10T20:52:11.753188+0000 mgr.gibba009.xiladd (mgr.34457) 2235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:13.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:12 gibba009 bash[26136]: cephadm 2021-03-10T20:52:11.753188+0000 mgr.gibba009.xiladd (mgr.34457) 2235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:14.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:13 gibba004 bash[30897]: cluster 2021-03-10T20:52:11.831837+0000 mgr.gibba009.xiladd (mgr.34457) 2236 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:14.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:13 gibba004 bash[31878]: cluster 2021-03-10T20:52:11.831837+0000 mgr.gibba009.xiladd (mgr.34457) 2236 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:14.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:13 gibba009 bash[26136]: cluster 2021-03-10T20:52:11.831837+0000 mgr.gibba009.xiladd (mgr.34457) 2236 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:15 gibba004 bash[30897]: cluster 2021-03-10T20:52:13.833593+0000 mgr.gibba009.xiladd (mgr.34457) 2237 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:15 gibba004 bash[31878]: cluster 2021-03-10T20:52:13.833593+0000 mgr.gibba009.xiladd (mgr.34457) 2237 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:15 gibba009 bash[26136]: cluster 2021-03-10T20:52:13.833593+0000 mgr.gibba009.xiladd (mgr.34457) 2237 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:17 gibba004 bash[30897]: cluster 2021-03-10T20:52:15.835116+0000 mgr.gibba009.xiladd (mgr.34457) 2238 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:17 gibba004 bash[31878]: cluster 2021-03-10T20:52:15.835116+0000 mgr.gibba009.xiladd (mgr.34457) 2238 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:17 gibba009 bash[26136]: cluster 2021-03-10T20:52:15.835116+0000 mgr.gibba009.xiladd (mgr.34457) 2238 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:19 gibba004 bash[30897]: cluster 2021-03-10T20:52:17.836806+0000 mgr.gibba009.xiladd (mgr.34457) 2239 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:19 gibba004 bash[31878]: cluster 2021-03-10T20:52:17.836806+0000 mgr.gibba009.xiladd (mgr.34457) 2239 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:19 gibba009 bash[26136]: cluster 2021-03-10T20:52:17.836806+0000 mgr.gibba009.xiladd (mgr.34457) 2239 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:21 gibba004 bash[30897]: cluster 2021-03-10T20:52:19.838317+0000 mgr.gibba009.xiladd (mgr.34457) 2240 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:21 gibba004 bash[31878]: cluster 2021-03-10T20:52:19.838317+0000 mgr.gibba009.xiladd (mgr.34457) 2240 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:21 gibba009 bash[26136]: cluster 2021-03-10T20:52:19.838317+0000 mgr.gibba009.xiladd (mgr.34457) 2240 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:23.496 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:52:23.724 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:52:23.724 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (41m) 7m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:52:23.725 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:52:23.725 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (41m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:52:23.725 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (42m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:52:23.725 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:52:23.726 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (40m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:52:23.726 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:52:23.726 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:52:23.726 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (46m) 7m ago 46m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:52:23.726 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:52:23.727 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:52:23.727 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:52:23.727 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:52:23.727 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:52:23.728 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:52:23.728 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:52:23.728 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:52:23.728 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:52:23.728 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (46m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:52:23.729 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:23.729 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:23.974 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:52:23.974 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:52:23.974 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:23.975 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:23.975 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:52:23.975 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:23.975 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:23.976 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:52:23.976 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:52:23.976 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:23.976 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:52:23.976 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:52:23.977 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:52:23.977 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:52:23.977 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:52:24.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:23 gibba004 bash[30897]: cluster 2021-03-10T20:52:21.839776+0000 mgr.gibba009.xiladd (mgr.34457) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:23 gibba004 bash[31878]: cluster 2021-03-10T20:52:21.839776+0000 mgr.gibba009.xiladd (mgr.34457) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:23 gibba009 bash[26136]: cluster 2021-03-10T20:52:21.839776+0000 mgr.gibba009.xiladd (mgr.34457) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:25.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[30897]: audit 2021-03-10T20:52:23.484464+0000 mgr.gibba009.xiladd (mgr.34457) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[30897]: audit 2021-03-10T20:52:23.708836+0000 mgr.gibba009.xiladd (mgr.34457) 2243 : audit [DBG] from='client.55555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[30897]: audit 2021-03-10T20:52:23.972967+0000 mon.a (mon.0) 890 : audit [DBG] from='client.? 172.21.2.104:0/2939015839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:25.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[31878]: audit 2021-03-10T20:52:23.484464+0000 mgr.gibba009.xiladd (mgr.34457) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[31878]: audit 2021-03-10T20:52:23.708836+0000 mgr.gibba009.xiladd (mgr.34457) 2243 : audit [DBG] from='client.55555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:24 gibba004 bash[31878]: audit 2021-03-10T20:52:23.972967+0000 mon.a (mon.0) 890 : audit [DBG] from='client.? 172.21.2.104:0/2939015839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:25.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:24 gibba009 bash[26136]: audit 2021-03-10T20:52:23.484464+0000 mgr.gibba009.xiladd (mgr.34457) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:24 gibba009 bash[26136]: audit 2021-03-10T20:52:23.708836+0000 mgr.gibba009.xiladd (mgr.34457) 2243 : audit [DBG] from='client.55555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:25.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:24 gibba009 bash[26136]: audit 2021-03-10T20:52:23.972967+0000 mon.a (mon.0) 890 : audit [DBG] from='client.? 172.21.2.104:0/2939015839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:26.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:25 gibba004 bash[30897]: cluster 2021-03-10T20:52:23.841481+0000 mgr.gibba009.xiladd (mgr.34457) 2244 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:26.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:25 gibba004 bash[31878]: cluster 2021-03-10T20:52:23.841481+0000 mgr.gibba009.xiladd (mgr.34457) 2244 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:26.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:25 gibba009 bash[26136]: cluster 2021-03-10T20:52:23.841481+0000 mgr.gibba009.xiladd (mgr.34457) 2244 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:27.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:26 gibba004 bash[30897]: audit 2021-03-10T20:52:26.758914+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:26 gibba004 bash[31878]: audit 2021-03-10T20:52:26.758914+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:27.088 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:26 gibba009 bash[26136]: audit 2021-03-10T20:52:26.758914+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:28.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: cluster 2021-03-10T20:52:25.842681+0000 mgr.gibba009.xiladd (mgr.34457) 2245 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:26.947159+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:26.958737+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.146030+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.149812+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.151265+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.152601+0000 mon.c (mon.1) 682 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.153804+0000 mon.c (mon.1) 683 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.157423+0000 mon.c (mon.1) 684 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:27 gibba009 bash[26136]: audit 2021-03-10T20:52:27.159068+0000 mon.c (mon.1) 685 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: cluster 2021-03-10T20:52:25.842681+0000 mgr.gibba009.xiladd (mgr.34457) 2245 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:26.947159+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:26.958737+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.146030+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.149812+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.151265+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.152601+0000 mon.c (mon.1) 682 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.153804+0000 mon.c (mon.1) 683 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.157423+0000 mon.c (mon.1) 684 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[30897]: audit 2021-03-10T20:52:27.159068+0000 mon.c (mon.1) 685 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: cluster 2021-03-10T20:52:25.842681+0000 mgr.gibba009.xiladd (mgr.34457) 2245 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:26.947159+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:26.958737+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.146030+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:52:28.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.149812+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:28.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.151265+0000 mon.c (mon.1) 681 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.152601+0000 mon.c (mon.1) 682 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.153804+0000 mon.c (mon.1) 683 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.157423+0000 mon.c (mon.1) 684 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:28.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:27 gibba004 bash[31878]: audit 2021-03-10T20:52:27.159068+0000 mon.c (mon.1) 685 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:29.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:26.946998+0000 mgr.gibba009.xiladd (mgr.34457) 2246 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:52:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:26.958460+0000 mgr.gibba009.xiladd (mgr.34457) 2247 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:52:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.147898+0000 mgr.gibba009.xiladd (mgr.34457) 2248 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.149453+0000 mgr.gibba009.xiladd (mgr.34457) 2249 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.150831+0000 mgr.gibba009.xiladd (mgr.34457) 2250 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.150871+0000 mgr.gibba009.xiladd (mgr.34457) 2251 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.152169+0000 mgr.gibba009.xiladd (mgr.34457) 2252 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.152207+0000 mgr.gibba009.xiladd (mgr.34457) 2253 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.153461+0000 mgr.gibba009.xiladd (mgr.34457) 2254 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.155576+0000 mgr.gibba009.xiladd (mgr.34457) 2255 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.155611+0000 mgr.gibba009.xiladd (mgr.34457) 2256 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.157070+0000 mgr.gibba009.xiladd (mgr.34457) 2257 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.157400+0000 mgr.gibba009.xiladd (mgr.34457) 2258 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.158869+0000 mgr.gibba009.xiladd (mgr.34457) 2259 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.158909+0000 mgr.gibba009.xiladd (mgr.34457) 2260 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:28 gibba009 bash[26136]: cephadm 2021-03-10T20:52:27.159039+0000 mgr.gibba009.xiladd (mgr.34457) 2261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:26.946998+0000 mgr.gibba009.xiladd (mgr.34457) 2246 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:52:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:26.958460+0000 mgr.gibba009.xiladd (mgr.34457) 2247 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:52:29.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.147898+0000 mgr.gibba009.xiladd (mgr.34457) 2248 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:29.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.149453+0000 mgr.gibba009.xiladd (mgr.34457) 2249 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:29.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.150831+0000 mgr.gibba009.xiladd (mgr.34457) 2250 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:29.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.150871+0000 mgr.gibba009.xiladd (mgr.34457) 2251 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:29.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.152169+0000 mgr.gibba009.xiladd (mgr.34457) 2252 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:29.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.152207+0000 mgr.gibba009.xiladd (mgr.34457) 2253 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:29.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.153461+0000 mgr.gibba009.xiladd (mgr.34457) 2254 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:29.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.155576+0000 mgr.gibba009.xiladd (mgr.34457) 2255 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:29.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.155611+0000 mgr.gibba009.xiladd (mgr.34457) 2256 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:29.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.157070+0000 mgr.gibba009.xiladd (mgr.34457) 2257 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:29.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.157400+0000 mgr.gibba009.xiladd (mgr.34457) 2258 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:29.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.158869+0000 mgr.gibba009.xiladd (mgr.34457) 2259 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:29.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.158909+0000 mgr.gibba009.xiladd (mgr.34457) 2260 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:29.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[30897]: cephadm 2021-03-10T20:52:27.159039+0000 mgr.gibba009.xiladd (mgr.34457) 2261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:29.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:26.946998+0000 mgr.gibba009.xiladd (mgr.34457) 2246 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:52:29.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:26.958460+0000 mgr.gibba009.xiladd (mgr.34457) 2247 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:52:29.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.147898+0000 mgr.gibba009.xiladd (mgr.34457) 2248 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:29.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.149453+0000 mgr.gibba009.xiladd (mgr.34457) 2249 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:29.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.150831+0000 mgr.gibba009.xiladd (mgr.34457) 2250 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:29.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.150871+0000 mgr.gibba009.xiladd (mgr.34457) 2251 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:29.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.152169+0000 mgr.gibba009.xiladd (mgr.34457) 2252 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:29.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.152207+0000 mgr.gibba009.xiladd (mgr.34457) 2253 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:29.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.153461+0000 mgr.gibba009.xiladd (mgr.34457) 2254 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:29.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.155576+0000 mgr.gibba009.xiladd (mgr.34457) 2255 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:29.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.155611+0000 mgr.gibba009.xiladd (mgr.34457) 2256 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:29.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.157070+0000 mgr.gibba009.xiladd (mgr.34457) 2257 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:29.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.157400+0000 mgr.gibba009.xiladd (mgr.34457) 2258 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:29.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.158869+0000 mgr.gibba009.xiladd (mgr.34457) 2259 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:29.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.158909+0000 mgr.gibba009.xiladd (mgr.34457) 2260 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:29.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:28 gibba004 bash[31878]: cephadm 2021-03-10T20:52:27.159039+0000 mgr.gibba009.xiladd (mgr.34457) 2261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:30.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:29 gibba009 bash[26136]: cluster 2021-03-10T20:52:27.843915+0000 mgr.gibba009.xiladd (mgr.34457) 2262 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:30.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:29 gibba004 bash[30897]: cluster 2021-03-10T20:52:27.843915+0000 mgr.gibba009.xiladd (mgr.34457) 2262 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:30.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:29 gibba004 bash[31878]: cluster 2021-03-10T20:52:27.843915+0000 mgr.gibba009.xiladd (mgr.34457) 2262 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:31.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:30 gibba004 bash[30897]: cluster 2021-03-10T20:52:29.844467+0000 mgr.gibba009.xiladd (mgr.34457) 2263 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:31.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:30 gibba004 bash[31878]: cluster 2021-03-10T20:52:29.844467+0000 mgr.gibba009.xiladd (mgr.34457) 2263 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:31.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:30 gibba009 bash[26136]: cluster 2021-03-10T20:52:29.844467+0000 mgr.gibba009.xiladd (mgr.34457) 2263 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:33.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:32 gibba004 bash[30897]: cluster 2021-03-10T20:52:31.845856+0000 mgr.gibba009.xiladd (mgr.34457) 2264 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:33.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:32 gibba004 bash[31878]: cluster 2021-03-10T20:52:31.845856+0000 mgr.gibba009.xiladd (mgr.34457) 2264 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:33.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:32 gibba009 bash[26136]: cluster 2021-03-10T20:52:31.845856+0000 mgr.gibba009.xiladd (mgr.34457) 2264 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:35 gibba004 bash[30897]: cluster 2021-03-10T20:52:33.847399+0000 mgr.gibba009.xiladd (mgr.34457) 2265 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:35 gibba004 bash[31878]: cluster 2021-03-10T20:52:33.847399+0000 mgr.gibba009.xiladd (mgr.34457) 2265 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:35 gibba009 bash[26136]: cluster 2021-03-10T20:52:33.847399+0000 mgr.gibba009.xiladd (mgr.34457) 2265 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:37 gibba004 bash[30897]: cluster 2021-03-10T20:52:35.848915+0000 mgr.gibba009.xiladd (mgr.34457) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:37 gibba004 bash[31878]: cluster 2021-03-10T20:52:35.848915+0000 mgr.gibba009.xiladd (mgr.34457) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:37 gibba009 bash[26136]: cluster 2021-03-10T20:52:35.848915+0000 mgr.gibba009.xiladd (mgr.34457) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:40.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:39 gibba004 bash[30897]: cluster 2021-03-10T20:52:37.850623+0000 mgr.gibba009.xiladd (mgr.34457) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:40.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:39 gibba004 bash[31878]: cluster 2021-03-10T20:52:37.850623+0000 mgr.gibba009.xiladd (mgr.34457) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:39 gibba009 bash[26136]: cluster 2021-03-10T20:52:37.850623+0000 mgr.gibba009.xiladd (mgr.34457) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:41.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.837441+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.838115+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.838725+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.840500+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.842079+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.842816+0000 mon.c (mon.1) 689 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.843244+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.843487+0000 mon.c (mon.1) 690 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.844162+0000 mon.c (mon.1) 691 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:41.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.845380+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.846944+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[31878]: audit 2021-03-10T20:52:39.848156+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.837441+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.838115+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.838725+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.840500+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.842079+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.842816+0000 mon.c (mon.1) 689 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.843244+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.843487+0000 mon.c (mon.1) 690 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.844162+0000 mon.c (mon.1) 691 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.845380+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.846944+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:40 gibba004 bash[30897]: audit 2021-03-10T20:52:39.848156+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.837441+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.838115+0000 mon.c (mon.1) 687 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.838725+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.840500+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.842079+0000 mon.c (mon.1) 688 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.842816+0000 mon.c (mon.1) 689 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.843244+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:52:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.843487+0000 mon.c (mon.1) 690 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.844162+0000 mon.c (mon.1) 691 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.845380+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.846944+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:52:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:40 gibba009 bash[26136]: audit 2021-03-10T20:52:39.848156+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:52:42.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:41 gibba004 bash[30897]: cluster 2021-03-10T20:52:39.851465+0000 mgr.gibba009.xiladd (mgr.34457) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:42.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:41 gibba004 bash[31878]: cluster 2021-03-10T20:52:39.851465+0000 mgr.gibba009.xiladd (mgr.34457) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:42.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:41 gibba009 bash[26136]: cluster 2021-03-10T20:52:39.851465+0000 mgr.gibba009.xiladd (mgr.34457) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:43 gibba004 bash[30897]: cluster 2021-03-10T20:52:41.852921+0000 mgr.gibba009.xiladd (mgr.34457) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:43 gibba004 bash[30897]: cephadm 2021-03-10T20:52:42.159952+0000 mgr.gibba009.xiladd (mgr.34457) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:44.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:43 gibba004 bash[31878]: cluster 2021-03-10T20:52:41.852921+0000 mgr.gibba009.xiladd (mgr.34457) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:43 gibba004 bash[31878]: cephadm 2021-03-10T20:52:42.159952+0000 mgr.gibba009.xiladd (mgr.34457) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:43 gibba009 bash[26136]: cluster 2021-03-10T20:52:41.852921+0000 mgr.gibba009.xiladd (mgr.34457) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:43 gibba009 bash[26136]: cephadm 2021-03-10T20:52:42.159952+0000 mgr.gibba009.xiladd (mgr.34457) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:45 gibba004 bash[30897]: cluster 2021-03-10T20:52:43.854186+0000 mgr.gibba009.xiladd (mgr.34457) 2271 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:45 gibba004 bash[31878]: cluster 2021-03-10T20:52:43.854186+0000 mgr.gibba009.xiladd (mgr.34457) 2271 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:45 gibba009 bash[26136]: cluster 2021-03-10T20:52:43.854186+0000 mgr.gibba009.xiladd (mgr.34457) 2271 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:47 gibba004 bash[30897]: cluster 2021-03-10T20:52:45.855623+0000 mgr.gibba009.xiladd (mgr.34457) 2272 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:47 gibba004 bash[31878]: cluster 2021-03-10T20:52:45.855623+0000 mgr.gibba009.xiladd (mgr.34457) 2272 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:47 gibba009 bash[26136]: cluster 2021-03-10T20:52:45.855623+0000 mgr.gibba009.xiladd (mgr.34457) 2272 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:50.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:49 gibba004 bash[30897]: cluster 2021-03-10T20:52:47.857281+0000 mgr.gibba009.xiladd (mgr.34457) 2273 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:50.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:49 gibba004 bash[31878]: cluster 2021-03-10T20:52:47.857281+0000 mgr.gibba009.xiladd (mgr.34457) 2273 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:50.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:49 gibba009 bash[26136]: cluster 2021-03-10T20:52:47.857281+0000 mgr.gibba009.xiladd (mgr.34457) 2273 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:51 gibba004 bash[30897]: cluster 2021-03-10T20:52:49.859050+0000 mgr.gibba009.xiladd (mgr.34457) 2274 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:51 gibba004 bash[31878]: cluster 2021-03-10T20:52:49.859050+0000 mgr.gibba009.xiladd (mgr.34457) 2274 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:51 gibba009 bash[26136]: cluster 2021-03-10T20:52:49.859050+0000 mgr.gibba009.xiladd (mgr.34457) 2274 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:53 gibba004 bash[30897]: cluster 2021-03-10T20:52:51.860495+0000 mgr.gibba009.xiladd (mgr.34457) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:53 gibba004 bash[31878]: cluster 2021-03-10T20:52:51.860495+0000 mgr.gibba009.xiladd (mgr.34457) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:53 gibba009 bash[26136]: cluster 2021-03-10T20:52:51.860495+0000 mgr.gibba009.xiladd (mgr.34457) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.216 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:52:54.442 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:52:54.442 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (41m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:52:54.442 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:52:54.443 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:52:54.443 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:52:54.443 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:52:54.443 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:52:54.444 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:52:54.444 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:52:54.444 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:52:54.444 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:52:54.445 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:52:54.445 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:52:54.445 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:52:54.445 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:52:54.445 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:52:54.446 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:52:54.446 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:52:54.446 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:52:54.447 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (46m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:52:54.447 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:54.447 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:54.694 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:52:54.695 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:52:54.695 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:54.696 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:54.696 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:52:54.697 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:54.697 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:54.697 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:52:54.698 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:52:54.698 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:52:54.699 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:52:54.699 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:52:54.700 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:52:54.700 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:52:54.700 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:52:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[30897]: cluster 2021-03-10T20:52:53.861915+0000 mgr.gibba009.xiladd (mgr.34457) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[30897]: audit 2021-03-10T20:52:54.205416+0000 mgr.gibba009.xiladd (mgr.34457) 2277 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[30897]: audit 2021-03-10T20:52:54.428448+0000 mgr.gibba009.xiladd (mgr.34457) 2278 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[30897]: audit 2021-03-10T20:52:54.693335+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.2.104:0/4285255952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:56.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[31878]: cluster 2021-03-10T20:52:53.861915+0000 mgr.gibba009.xiladd (mgr.34457) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:56.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[31878]: audit 2021-03-10T20:52:54.205416+0000 mgr.gibba009.xiladd (mgr.34457) 2277 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[31878]: audit 2021-03-10T20:52:54.428448+0000 mgr.gibba009.xiladd (mgr.34457) 2278 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:55 gibba004 bash[31878]: audit 2021-03-10T20:52:54.693335+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.2.104:0/4285255952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:55 gibba009 bash[26136]: cluster 2021-03-10T20:52:53.861915+0000 mgr.gibba009.xiladd (mgr.34457) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:56.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:55 gibba009 bash[26136]: audit 2021-03-10T20:52:54.205416+0000 mgr.gibba009.xiladd (mgr.34457) 2277 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:55 gibba009 bash[26136]: audit 2021-03-10T20:52:54.428448+0000 mgr.gibba009.xiladd (mgr.34457) 2278 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:56.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:55 gibba009 bash[26136]: audit 2021-03-10T20:52:54.693335+0000 mon.a (mon.0) 900 : audit [DBG] from='client.? 172.21.2.104:0/4285255952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:58.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:57 gibba004 bash[30897]: cluster 2021-03-10T20:52:55.863437+0000 mgr.gibba009.xiladd (mgr.34457) 2279 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:58.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:57 gibba004 bash[31878]: cluster 2021-03-10T20:52:55.863437+0000 mgr.gibba009.xiladd (mgr.34457) 2279 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:58.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:57 gibba009 bash[26136]: cluster 2021-03-10T20:52:55.863437+0000 mgr.gibba009.xiladd (mgr.34457) 2279 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:59.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:58 gibba004 bash[30897]: cephadm 2021-03-10T20:52:57.176025+0000 mgr.gibba009.xiladd (mgr.34457) 2280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:59.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:58 gibba004 bash[31878]: cephadm 2021-03-10T20:52:57.176025+0000 mgr.gibba009.xiladd (mgr.34457) 2280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:52:59.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:58 gibba009 bash[26136]: cephadm 2021-03-10T20:52:57.176025+0000 mgr.gibba009.xiladd (mgr.34457) 2280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:00.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:52:59 gibba004 bash[30897]: cluster 2021-03-10T20:52:57.865175+0000 mgr.gibba009.xiladd (mgr.34457) 2281 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:00.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:52:59 gibba004 bash[31878]: cluster 2021-03-10T20:52:57.865175+0000 mgr.gibba009.xiladd (mgr.34457) 2281 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:00.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:52:59 gibba009 bash[26136]: cluster 2021-03-10T20:52:57.865175+0000 mgr.gibba009.xiladd (mgr.34457) 2281 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:01 gibba004 bash[30897]: cluster 2021-03-10T20:52:59.866877+0000 mgr.gibba009.xiladd (mgr.34457) 2282 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:01 gibba004 bash[31878]: cluster 2021-03-10T20:52:59.866877+0000 mgr.gibba009.xiladd (mgr.34457) 2282 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:01 gibba009 bash[26136]: cluster 2021-03-10T20:52:59.866877+0000 mgr.gibba009.xiladd (mgr.34457) 2282 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:03 gibba004 bash[30897]: cluster 2021-03-10T20:53:01.868296+0000 mgr.gibba009.xiladd (mgr.34457) 2283 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:03 gibba004 bash[31878]: cluster 2021-03-10T20:53:01.868296+0000 mgr.gibba009.xiladd (mgr.34457) 2283 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:03 gibba009 bash[26136]: cluster 2021-03-10T20:53:01.868296+0000 mgr.gibba009.xiladd (mgr.34457) 2283 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:05 gibba004 bash[30897]: cluster 2021-03-10T20:53:03.869603+0000 mgr.gibba009.xiladd (mgr.34457) 2284 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:05 gibba004 bash[31878]: cluster 2021-03-10T20:53:03.869603+0000 mgr.gibba009.xiladd (mgr.34457) 2284 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:05 gibba009 bash[26136]: cluster 2021-03-10T20:53:03.869603+0000 mgr.gibba009.xiladd (mgr.34457) 2284 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:07 gibba004 bash[30897]: cluster 2021-03-10T20:53:05.871165+0000 mgr.gibba009.xiladd (mgr.34457) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:07 gibba004 bash[31878]: cluster 2021-03-10T20:53:05.871165+0000 mgr.gibba009.xiladd (mgr.34457) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:07 gibba009 bash[26136]: cluster 2021-03-10T20:53:05.871165+0000 mgr.gibba009.xiladd (mgr.34457) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:10.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:09 gibba004 bash[30897]: cluster 2021-03-10T20:53:07.872905+0000 mgr.gibba009.xiladd (mgr.34457) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:10.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:09 gibba004 bash[31878]: cluster 2021-03-10T20:53:07.872905+0000 mgr.gibba009.xiladd (mgr.34457) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:10.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:09 gibba009 bash[26136]: cluster 2021-03-10T20:53:07.872905+0000 mgr.gibba009.xiladd (mgr.34457) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:11 gibba004 bash[30897]: cluster 2021-03-10T20:53:09.874406+0000 mgr.gibba009.xiladd (mgr.34457) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:11 gibba004 bash[31878]: cluster 2021-03-10T20:53:09.874406+0000 mgr.gibba009.xiladd (mgr.34457) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:11 gibba009 bash[26136]: cluster 2021-03-10T20:53:09.874406+0000 mgr.gibba009.xiladd (mgr.34457) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:13 gibba004 bash[30897]: cluster 2021-03-10T20:53:11.876065+0000 mgr.gibba009.xiladd (mgr.34457) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:13 gibba004 bash[30897]: cephadm 2021-03-10T20:53:12.191908+0000 mgr.gibba009.xiladd (mgr.34457) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:14.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:13 gibba004 bash[31878]: cluster 2021-03-10T20:53:11.876065+0000 mgr.gibba009.xiladd (mgr.34457) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:13 gibba004 bash[31878]: cephadm 2021-03-10T20:53:12.191908+0000 mgr.gibba009.xiladd (mgr.34457) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:14.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:13 gibba009 bash[26136]: cluster 2021-03-10T20:53:11.876065+0000 mgr.gibba009.xiladd (mgr.34457) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:13 gibba009 bash[26136]: cephadm 2021-03-10T20:53:12.191908+0000 mgr.gibba009.xiladd (mgr.34457) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:15 gibba004 bash[30897]: cluster 2021-03-10T20:53:13.877652+0000 mgr.gibba009.xiladd (mgr.34457) 2290 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:16.541 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:15 gibba004 bash[31878]: cluster 2021-03-10T20:53:13.877652+0000 mgr.gibba009.xiladd (mgr.34457) 2290 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:16.542 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:15 gibba009 bash[26136]: cluster 2021-03-10T20:53:13.877652+0000 mgr.gibba009.xiladd (mgr.34457) 2290 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:17 gibba004 bash[30897]: cluster 2021-03-10T20:53:15.879456+0000 mgr.gibba009.xiladd (mgr.34457) 2291 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:17 gibba004 bash[31878]: cluster 2021-03-10T20:53:15.879456+0000 mgr.gibba009.xiladd (mgr.34457) 2291 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:17 gibba009 bash[26136]: cluster 2021-03-10T20:53:15.879456+0000 mgr.gibba009.xiladd (mgr.34457) 2291 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:20.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:19 gibba004 bash[30897]: cluster 2021-03-10T20:53:17.880865+0000 mgr.gibba009.xiladd (mgr.34457) 2292 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:20.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:19 gibba004 bash[31878]: cluster 2021-03-10T20:53:17.880865+0000 mgr.gibba009.xiladd (mgr.34457) 2292 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:20.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:19 gibba009 bash[26136]: cluster 2021-03-10T20:53:17.880865+0000 mgr.gibba009.xiladd (mgr.34457) 2292 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:21 gibba004 bash[30897]: cluster 2021-03-10T20:53:19.882338+0000 mgr.gibba009.xiladd (mgr.34457) 2293 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:21 gibba004 bash[31878]: cluster 2021-03-10T20:53:19.882338+0000 mgr.gibba009.xiladd (mgr.34457) 2293 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:21 gibba009 bash[26136]: cluster 2021-03-10T20:53:19.882338+0000 mgr.gibba009.xiladd (mgr.34457) 2293 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:23 gibba004 bash[30897]: cluster 2021-03-10T20:53:21.883966+0000 mgr.gibba009.xiladd (mgr.34457) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:23 gibba004 bash[31878]: cluster 2021-03-10T20:53:21.883966+0000 mgr.gibba009.xiladd (mgr.34457) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:23 gibba009 bash[26136]: cluster 2021-03-10T20:53:21.883966+0000 mgr.gibba009.xiladd (mgr.34457) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.937 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:53:25.194 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:53:25.195 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (42m) 8m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:53:25.195 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (47m) 7m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:53:25.195 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (42m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:53:25.196 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:53:25.196 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:53:25.196 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (41m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:53:25.196 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:53:25.196 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:53:25.197 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (47m) 8m ago 47m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:53:25.197 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:53:25.197 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:53:25.197 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:53:25.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:53:25.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:53:25.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:53:25.198 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:53:25.199 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:53:25.199 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (37m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:53:25.199 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (47m) 7m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:53:25.199 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:25.199 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:25.446 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:53:25.447 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:53:25.447 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:25.447 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:25.447 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:53:25.448 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:25.448 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:25.448 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:53:25.448 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:53:25.449 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:25.449 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:53:25.449 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:53:25.449 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:53:25.449 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:53:25.450 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:53:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:25 gibba004 bash[30897]: cluster 2021-03-10T20:53:23.885528+0000 mgr.gibba009.xiladd (mgr.34457) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:25 gibba004 bash[30897]: audit 2021-03-10T20:53:25.445285+0000 mon.c (mon.1) 692 : audit [DBG] from='client.? 172.21.2.104:0/1463077191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:25 gibba004 bash[31878]: cluster 2021-03-10T20:53:23.885528+0000 mgr.gibba009.xiladd (mgr.34457) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:25 gibba004 bash[31878]: audit 2021-03-10T20:53:25.445285+0000 mon.c (mon.1) 692 : audit [DBG] from='client.? 172.21.2.104:0/1463077191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:26.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:25 gibba009 bash[26136]: cluster 2021-03-10T20:53:23.885528+0000 mgr.gibba009.xiladd (mgr.34457) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:25 gibba009 bash[26136]: audit 2021-03-10T20:53:25.445285+0000 mon.c (mon.1) 692 : audit [DBG] from='client.? 172.21.2.104:0/1463077191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:26 gibba004 bash[31878]: audit 2021-03-10T20:53:24.925362+0000 mgr.gibba009.xiladd (mgr.34457) 2296 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:27.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:26 gibba004 bash[31878]: audit 2021-03-10T20:53:25.155166+0000 mgr.gibba009.xiladd (mgr.34457) 2297 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:27.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:26 gibba004 bash[30897]: audit 2021-03-10T20:53:24.925362+0000 mgr.gibba009.xiladd (mgr.34457) 2296 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:27.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:26 gibba004 bash[30897]: audit 2021-03-10T20:53:25.155166+0000 mgr.gibba009.xiladd (mgr.34457) 2297 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:27.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:26 gibba009 bash[26136]: audit 2021-03-10T20:53:24.925362+0000 mgr.gibba009.xiladd (mgr.34457) 2296 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:27.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:26 gibba009 bash[26136]: audit 2021-03-10T20:53:25.155166+0000 mgr.gibba009.xiladd (mgr.34457) 2297 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: cluster 2021-03-10T20:53:25.887031+0000 mgr.gibba009.xiladd (mgr.34457) 2298 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.210063+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.437514+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:53:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.441319+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.443310+0000 mon.c (mon.1) 695 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.447760+0000 mon.c (mon.1) 696 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.451597+0000 mon.c (mon.1) 697 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.459282+0000 mon.c (mon.1) 698 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[30897]: audit 2021-03-10T20:53:27.464512+0000 mon.c (mon.1) 699 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: cluster 2021-03-10T20:53:25.887031+0000 mgr.gibba009.xiladd (mgr.34457) 2298 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.210063+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.437514+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:53:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.441319+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.443310+0000 mon.c (mon.1) 695 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.447760+0000 mon.c (mon.1) 696 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.451597+0000 mon.c (mon.1) 697 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.459282+0000 mon.c (mon.1) 698 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:27 gibba004 bash[31878]: audit 2021-03-10T20:53:27.464512+0000 mon.c (mon.1) 699 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: cluster 2021-03-10T20:53:25.887031+0000 mgr.gibba009.xiladd (mgr.34457) 2298 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.210063+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.437514+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:53:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.441319+0000 mon.c (mon.1) 694 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.443310+0000 mon.c (mon.1) 695 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.447760+0000 mon.c (mon.1) 696 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.451597+0000 mon.c (mon.1) 697 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.459282+0000 mon.c (mon.1) 698 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:27 gibba009 bash[26136]: audit 2021-03-10T20:53:27.464512+0000 mon.c (mon.1) 699 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:29.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.214195+0000 mgr.gibba009.xiladd (mgr.34457) 2299 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:53:29.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.216021+0000 mgr.gibba009.xiladd (mgr.34457) 2300 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:53:29.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.439373+0000 mgr.gibba009.xiladd (mgr.34457) 2301 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:29.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.441385+0000 mgr.gibba009.xiladd (mgr.34457) 2302 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:29.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.444168+0000 mgr.gibba009.xiladd (mgr.34457) 2303 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:29.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.445218+0000 mgr.gibba009.xiladd (mgr.34457) 2304 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.448866+0000 mgr.gibba009.xiladd (mgr.34457) 2305 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.449189+0000 mgr.gibba009.xiladd (mgr.34457) 2306 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.452579+0000 mgr.gibba009.xiladd (mgr.34457) 2307 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.456080+0000 mgr.gibba009.xiladd (mgr.34457) 2308 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.456350+0000 mgr.gibba009.xiladd (mgr.34457) 2309 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.460203+0000 mgr.gibba009.xiladd (mgr.34457) 2310 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.462290+0000 mgr.gibba009.xiladd (mgr.34457) 2311 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.465675+0000 mgr.gibba009.xiladd (mgr.34457) 2312 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.465942+0000 mgr.gibba009.xiladd (mgr.34457) 2313 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[30897]: cephadm 2021-03-10T20:53:27.466648+0000 mgr.gibba009.xiladd (mgr.34457) 2314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:29.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.214195+0000 mgr.gibba009.xiladd (mgr.34457) 2299 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:53:29.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.216021+0000 mgr.gibba009.xiladd (mgr.34457) 2300 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:53:29.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.439373+0000 mgr.gibba009.xiladd (mgr.34457) 2301 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:29.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.441385+0000 mgr.gibba009.xiladd (mgr.34457) 2302 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:29.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.444168+0000 mgr.gibba009.xiladd (mgr.34457) 2303 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:29.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.445218+0000 mgr.gibba009.xiladd (mgr.34457) 2304 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:29.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.448866+0000 mgr.gibba009.xiladd (mgr.34457) 2305 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:29.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.449189+0000 mgr.gibba009.xiladd (mgr.34457) 2306 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:29.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.452579+0000 mgr.gibba009.xiladd (mgr.34457) 2307 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:29.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.456080+0000 mgr.gibba009.xiladd (mgr.34457) 2308 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:29.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.456350+0000 mgr.gibba009.xiladd (mgr.34457) 2309 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:29.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.460203+0000 mgr.gibba009.xiladd (mgr.34457) 2310 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:29.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.462290+0000 mgr.gibba009.xiladd (mgr.34457) 2311 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:29.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.465675+0000 mgr.gibba009.xiladd (mgr.34457) 2312 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:29.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.465942+0000 mgr.gibba009.xiladd (mgr.34457) 2313 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:29.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:28 gibba004 bash[31878]: cephadm 2021-03-10T20:53:27.466648+0000 mgr.gibba009.xiladd (mgr.34457) 2314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.214195+0000 mgr.gibba009.xiladd (mgr.34457) 2299 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:53:29.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.216021+0000 mgr.gibba009.xiladd (mgr.34457) 2300 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:53:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.439373+0000 mgr.gibba009.xiladd (mgr.34457) 2301 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.441385+0000 mgr.gibba009.xiladd (mgr.34457) 2302 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.444168+0000 mgr.gibba009.xiladd (mgr.34457) 2303 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.445218+0000 mgr.gibba009.xiladd (mgr.34457) 2304 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.448866+0000 mgr.gibba009.xiladd (mgr.34457) 2305 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.449189+0000 mgr.gibba009.xiladd (mgr.34457) 2306 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.452579+0000 mgr.gibba009.xiladd (mgr.34457) 2307 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.456080+0000 mgr.gibba009.xiladd (mgr.34457) 2308 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.456350+0000 mgr.gibba009.xiladd (mgr.34457) 2309 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.460203+0000 mgr.gibba009.xiladd (mgr.34457) 2310 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:29.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.462290+0000 mgr.gibba009.xiladd (mgr.34457) 2311 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:29.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.465675+0000 mgr.gibba009.xiladd (mgr.34457) 2312 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:29.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.465942+0000 mgr.gibba009.xiladd (mgr.34457) 2313 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:29.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:28 gibba009 bash[26136]: cephadm 2021-03-10T20:53:27.466648+0000 mgr.gibba009.xiladd (mgr.34457) 2314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:30.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:29 gibba009 bash[26136]: cluster 2021-03-10T20:53:27.888735+0000 mgr.gibba009.xiladd (mgr.34457) 2315 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:30.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:29 gibba004 bash[30897]: cluster 2021-03-10T20:53:27.888735+0000 mgr.gibba009.xiladd (mgr.34457) 2315 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:30.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:29 gibba004 bash[31878]: cluster 2021-03-10T20:53:27.888735+0000 mgr.gibba009.xiladd (mgr.34457) 2315 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:31 gibba009 bash[26136]: cluster 2021-03-10T20:53:29.889763+0000 mgr.gibba009.xiladd (mgr.34457) 2316 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:31 gibba004 bash[30897]: cluster 2021-03-10T20:53:29.889763+0000 mgr.gibba009.xiladd (mgr.34457) 2316 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:31 gibba004 bash[31878]: cluster 2021-03-10T20:53:29.889763+0000 mgr.gibba009.xiladd (mgr.34457) 2316 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:33 gibba004 bash[30897]: cluster 2021-03-10T20:53:31.891311+0000 mgr.gibba009.xiladd (mgr.34457) 2317 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:33 gibba004 bash[31878]: cluster 2021-03-10T20:53:31.891311+0000 mgr.gibba009.xiladd (mgr.34457) 2317 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:33 gibba009 bash[26136]: cluster 2021-03-10T20:53:31.891311+0000 mgr.gibba009.xiladd (mgr.34457) 2317 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:35 gibba004 bash[30897]: cluster 2021-03-10T20:53:33.892154+0000 mgr.gibba009.xiladd (mgr.34457) 2318 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:35 gibba004 bash[31878]: cluster 2021-03-10T20:53:33.892154+0000 mgr.gibba009.xiladd (mgr.34457) 2318 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:35 gibba009 bash[26136]: cluster 2021-03-10T20:53:33.892154+0000 mgr.gibba009.xiladd (mgr.34457) 2318 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:37.313 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:36 gibba004 bash[30897]: cluster 2021-03-10T20:53:35.892726+0000 mgr.gibba009.xiladd (mgr.34457) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:37.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:36 gibba004 bash[31878]: cluster 2021-03-10T20:53:35.892726+0000 mgr.gibba009.xiladd (mgr.34457) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:37.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:36 gibba009 bash[26136]: cluster 2021-03-10T20:53:35.892726+0000 mgr.gibba009.xiladd (mgr.34457) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:39.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:38 gibba004 bash[30897]: cluster 2021-03-10T20:53:37.893981+0000 mgr.gibba009.xiladd (mgr.34457) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:39.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:38 gibba004 bash[31878]: cluster 2021-03-10T20:53:37.893981+0000 mgr.gibba009.xiladd (mgr.34457) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:39.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:38 gibba009 bash[26136]: cluster 2021-03-10T20:53:37.893981+0000 mgr.gibba009.xiladd (mgr.34457) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:41.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.844419+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.845070+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.845651+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.847387+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.848575+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.849294+0000 mon.c (mon.1) 703 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.849731+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.849980+0000 mon.c (mon.1) 704 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.850677+0000 mon.c (mon.1) 705 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.851946+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.853444+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[30897]: audit 2021-03-10T20:53:39.854657+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.844419+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.845070+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.845651+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.847387+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.848575+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.849294+0000 mon.c (mon.1) 703 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.849731+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.849980+0000 mon.c (mon.1) 704 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.850677+0000 mon.c (mon.1) 705 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.851946+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.853444+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:40 gibba004 bash[31878]: audit 2021-03-10T20:53:39.854657+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.844419+0000 mon.c (mon.1) 700 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.845070+0000 mon.c (mon.1) 701 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.845651+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.847387+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.848575+0000 mon.c (mon.1) 702 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.849294+0000 mon.c (mon.1) 703 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.849731+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:53:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.849980+0000 mon.c (mon.1) 704 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.850677+0000 mon.c (mon.1) 705 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.851946+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.853444+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:40 gibba009 bash[26136]: audit 2021-03-10T20:53:39.854657+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:53:42.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:41 gibba004 bash[30897]: cluster 2021-03-10T20:53:39.895086+0000 mgr.gibba009.xiladd (mgr.34457) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:42.214 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:41 gibba004 bash[31878]: cluster 2021-03-10T20:53:39.895086+0000 mgr.gibba009.xiladd (mgr.34457) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:42.216 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:41 gibba009 bash[26136]: cluster 2021-03-10T20:53:39.895086+0000 mgr.gibba009.xiladd (mgr.34457) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:43 gibba004 bash[30897]: cluster 2021-03-10T20:53:41.896681+0000 mgr.gibba009.xiladd (mgr.34457) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:43 gibba004 bash[30897]: cephadm 2021-03-10T20:53:42.482465+0000 mgr.gibba009.xiladd (mgr.34457) 2323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:44.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:43 gibba004 bash[31878]: cluster 2021-03-10T20:53:41.896681+0000 mgr.gibba009.xiladd (mgr.34457) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:43 gibba004 bash[31878]: cephadm 2021-03-10T20:53:42.482465+0000 mgr.gibba009.xiladd (mgr.34457) 2323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:44.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:43 gibba009 bash[26136]: cluster 2021-03-10T20:53:41.896681+0000 mgr.gibba009.xiladd (mgr.34457) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:43 gibba009 bash[26136]: cephadm 2021-03-10T20:53:42.482465+0000 mgr.gibba009.xiladd (mgr.34457) 2323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:45 gibba004 bash[30897]: cluster 2021-03-10T20:53:43.897863+0000 mgr.gibba009.xiladd (mgr.34457) 2324 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:46.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:45 gibba004 bash[31878]: cluster 2021-03-10T20:53:43.897863+0000 mgr.gibba009.xiladd (mgr.34457) 2324 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:46.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:45 gibba009 bash[26136]: cluster 2021-03-10T20:53:43.897863+0000 mgr.gibba009.xiladd (mgr.34457) 2324 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:47 gibba004 bash[30897]: cluster 2021-03-10T20:53:45.899691+0000 mgr.gibba009.xiladd (mgr.34457) 2325 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:47 gibba004 bash[31878]: cluster 2021-03-10T20:53:45.899691+0000 mgr.gibba009.xiladd (mgr.34457) 2325 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:47 gibba009 bash[26136]: cluster 2021-03-10T20:53:45.899691+0000 mgr.gibba009.xiladd (mgr.34457) 2325 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.063 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:49 gibba004 bash[31878]: cluster 2021-03-10T20:53:47.901163+0000 mgr.gibba009.xiladd (mgr.34457) 2326 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:49 gibba004 bash[30897]: cluster 2021-03-10T20:53:47.901163+0000 mgr.gibba009.xiladd (mgr.34457) 2326 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:49 gibba009 bash[26136]: cluster 2021-03-10T20:53:47.901163+0000 mgr.gibba009.xiladd (mgr.34457) 2326 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:52.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:51 gibba004 bash[30897]: cluster 2021-03-10T20:53:49.902967+0000 mgr.gibba009.xiladd (mgr.34457) 2327 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:52.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:51 gibba004 bash[31878]: cluster 2021-03-10T20:53:49.902967+0000 mgr.gibba009.xiladd (mgr.34457) 2327 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:52.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:51 gibba009 bash[26136]: cluster 2021-03-10T20:53:49.902967+0000 mgr.gibba009.xiladd (mgr.34457) 2327 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:53 gibba004 bash[30897]: cluster 2021-03-10T20:53:51.904593+0000 mgr.gibba009.xiladd (mgr.34457) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:53 gibba004 bash[31878]: cluster 2021-03-10T20:53:51.904593+0000 mgr.gibba009.xiladd (mgr.34457) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:53 gibba009 bash[26136]: cluster 2021-03-10T20:53:51.904593+0000 mgr.gibba009.xiladd (mgr.34457) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:55.691 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:53:55.924 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:53:55.925 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (42m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:53:55.925 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:53:55.925 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:53:55.926 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:53:55.926 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:53:55.926 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:53:55.926 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:53:55.926 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:53:55.927 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:53:55.927 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:53:55.927 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:53:55.927 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:53:55.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:53:55.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:53:55.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:53:55.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:53:55.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:53:55.929 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:53:55.929 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (47m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:53:55.929 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:55.929 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:56.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:55 gibba004 bash[30897]: cluster 2021-03-10T20:53:53.905885+0000 mgr.gibba009.xiladd (mgr.34457) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:55 gibba004 bash[31878]: cluster 2021-03-10T20:53:53.905885+0000 mgr.gibba009.xiladd (mgr.34457) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:55 gibba009 bash[26136]: cluster 2021-03-10T20:53:53.905885+0000 mgr.gibba009.xiladd (mgr.34457) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.179 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:53:56.179 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:53:56.180 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:56.180 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:56.180 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:53:56.181 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:56.181 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:56.181 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:53:56.182 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:53:56.182 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:53:56.182 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:53:56.183 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:53:56.183 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:53:56.183 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:53:56.183 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:53:57.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:56 gibba004 bash[30897]: audit 2021-03-10T20:53:55.679513+0000 mgr.gibba009.xiladd (mgr.34457) 2330 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:57.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:56 gibba004 bash[30897]: audit 2021-03-10T20:53:56.177749+0000 mon.a (mon.0) 908 : audit [DBG] from='client.? 172.21.2.104:0/168911296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:57.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:56 gibba004 bash[31878]: audit 2021-03-10T20:53:55.679513+0000 mgr.gibba009.xiladd (mgr.34457) 2330 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:57.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:56 gibba004 bash[31878]: audit 2021-03-10T20:53:56.177749+0000 mon.a (mon.0) 908 : audit [DBG] from='client.? 172.21.2.104:0/168911296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:57.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:56 gibba009 bash[26136]: audit 2021-03-10T20:53:55.679513+0000 mgr.gibba009.xiladd (mgr.34457) 2330 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:57.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:56 gibba009 bash[26136]: audit 2021-03-10T20:53:56.177749+0000 mon.a (mon.0) 908 : audit [DBG] from='client.? 172.21.2.104:0/168911296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:57 gibba004 bash[30897]: cluster 2021-03-10T20:53:55.907550+0000 mgr.gibba009.xiladd (mgr.34457) 2331 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:57 gibba004 bash[30897]: audit 2021-03-10T20:53:55.909340+0000 mgr.gibba009.xiladd (mgr.34457) 2332 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:58.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:57 gibba004 bash[31878]: cluster 2021-03-10T20:53:55.907550+0000 mgr.gibba009.xiladd (mgr.34457) 2331 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:57 gibba004 bash[31878]: audit 2021-03-10T20:53:55.909340+0000 mgr.gibba009.xiladd (mgr.34457) 2332 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:58.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:57 gibba009 bash[26136]: cluster 2021-03-10T20:53:55.907550+0000 mgr.gibba009.xiladd (mgr.34457) 2331 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:57 gibba009 bash[26136]: audit 2021-03-10T20:53:55.909340+0000 mgr.gibba009.xiladd (mgr.34457) 2332 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:58 gibba004 bash[30897]: cephadm 2021-03-10T20:53:57.498284+0000 mgr.gibba009.xiladd (mgr.34457) 2333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:59.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:58 gibba004 bash[31878]: cephadm 2021-03-10T20:53:57.498284+0000 mgr.gibba009.xiladd (mgr.34457) 2333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:53:59.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:58 gibba009 bash[26136]: cephadm 2021-03-10T20:53:57.498284+0000 mgr.gibba009.xiladd (mgr.34457) 2333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:00.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:53:59 gibba004 bash[30897]: cluster 2021-03-10T20:53:57.908943+0000 mgr.gibba009.xiladd (mgr.34457) 2334 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:00.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:53:59 gibba004 bash[31878]: cluster 2021-03-10T20:53:57.908943+0000 mgr.gibba009.xiladd (mgr.34457) 2334 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:00.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:53:59 gibba009 bash[26136]: cluster 2021-03-10T20:53:57.908943+0000 mgr.gibba009.xiladd (mgr.34457) 2334 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:01 gibba004 bash[30897]: cluster 2021-03-10T20:53:59.910425+0000 mgr.gibba009.xiladd (mgr.34457) 2335 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:01 gibba004 bash[31878]: cluster 2021-03-10T20:53:59.910425+0000 mgr.gibba009.xiladd (mgr.34457) 2335 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:01 gibba009 bash[26136]: cluster 2021-03-10T20:53:59.910425+0000 mgr.gibba009.xiladd (mgr.34457) 2335 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:03 gibba004 bash[30897]: cluster 2021-03-10T20:54:01.911921+0000 mgr.gibba009.xiladd (mgr.34457) 2336 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:03 gibba004 bash[31878]: cluster 2021-03-10T20:54:01.911921+0000 mgr.gibba009.xiladd (mgr.34457) 2336 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:03 gibba009 bash[26136]: cluster 2021-03-10T20:54:01.911921+0000 mgr.gibba009.xiladd (mgr.34457) 2336 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:06.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:05 gibba004 bash[30897]: cluster 2021-03-10T20:54:03.913406+0000 mgr.gibba009.xiladd (mgr.34457) 2337 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:06.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:05 gibba004 bash[31878]: cluster 2021-03-10T20:54:03.913406+0000 mgr.gibba009.xiladd (mgr.34457) 2337 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:06.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:05 gibba009 bash[26136]: cluster 2021-03-10T20:54:03.913406+0000 mgr.gibba009.xiladd (mgr.34457) 2337 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:07 gibba004 bash[30897]: cluster 2021-03-10T20:54:05.914921+0000 mgr.gibba009.xiladd (mgr.34457) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:07 gibba004 bash[31878]: cluster 2021-03-10T20:54:05.914921+0000 mgr.gibba009.xiladd (mgr.34457) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:07 gibba009 bash[26136]: cluster 2021-03-10T20:54:05.914921+0000 mgr.gibba009.xiladd (mgr.34457) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.063 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:09 gibba004 bash[30897]: cluster 2021-03-10T20:54:07.916588+0000 mgr.gibba009.xiladd (mgr.34457) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:09 gibba004 bash[31878]: cluster 2021-03-10T20:54:07.916588+0000 mgr.gibba009.xiladd (mgr.34457) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:09 gibba009 bash[26136]: cluster 2021-03-10T20:54:07.916588+0000 mgr.gibba009.xiladd (mgr.34457) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:11 gibba009 bash[26136]: cluster 2021-03-10T20:54:09.918114+0000 mgr.gibba009.xiladd (mgr.34457) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:11 gibba004 bash[30897]: cluster 2021-03-10T20:54:09.918114+0000 mgr.gibba009.xiladd (mgr.34457) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:11 gibba004 bash[31878]: cluster 2021-03-10T20:54:09.918114+0000 mgr.gibba009.xiladd (mgr.34457) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:13 gibba009 bash[26136]: cluster 2021-03-10T20:54:11.919768+0000 mgr.gibba009.xiladd (mgr.34457) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:13 gibba009 bash[26136]: cephadm 2021-03-10T20:54:12.514470+0000 mgr.gibba009.xiladd (mgr.34457) 2342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:14.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:13 gibba004 bash[30897]: cluster 2021-03-10T20:54:11.919768+0000 mgr.gibba009.xiladd (mgr.34457) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:13 gibba004 bash[30897]: cephadm 2021-03-10T20:54:12.514470+0000 mgr.gibba009.xiladd (mgr.34457) 2342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:14.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:13 gibba004 bash[31878]: cluster 2021-03-10T20:54:11.919768+0000 mgr.gibba009.xiladd (mgr.34457) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:13 gibba004 bash[31878]: cephadm 2021-03-10T20:54:12.514470+0000 mgr.gibba009.xiladd (mgr.34457) 2342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:16.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:15 gibba004 bash[30897]: cluster 2021-03-10T20:54:13.921271+0000 mgr.gibba009.xiladd (mgr.34457) 2343 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:16.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:15 gibba004 bash[31878]: cluster 2021-03-10T20:54:13.921271+0000 mgr.gibba009.xiladd (mgr.34457) 2343 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:16.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:15 gibba009 bash[26136]: cluster 2021-03-10T20:54:13.921271+0000 mgr.gibba009.xiladd (mgr.34457) 2343 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:17 gibba004 bash[30897]: cluster 2021-03-10T20:54:15.922644+0000 mgr.gibba009.xiladd (mgr.34457) 2344 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:17 gibba004 bash[31878]: cluster 2021-03-10T20:54:15.922644+0000 mgr.gibba009.xiladd (mgr.34457) 2344 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:17 gibba009 bash[26136]: cluster 2021-03-10T20:54:15.922644+0000 mgr.gibba009.xiladd (mgr.34457) 2344 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:20.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:19 gibba004 bash[30897]: cluster 2021-03-10T20:54:17.923669+0000 mgr.gibba009.xiladd (mgr.34457) 2345 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:20.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:19 gibba004 bash[31878]: cluster 2021-03-10T20:54:17.923669+0000 mgr.gibba009.xiladd (mgr.34457) 2345 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:20.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:19 gibba009 bash[26136]: cluster 2021-03-10T20:54:17.923669+0000 mgr.gibba009.xiladd (mgr.34457) 2345 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:21.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:20 gibba004 bash[30897]: cluster 2021-03-10T20:54:19.924478+0000 mgr.gibba009.xiladd (mgr.34457) 2346 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:21.314 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:20 gibba004 bash[31878]: cluster 2021-03-10T20:54:19.924478+0000 mgr.gibba009.xiladd (mgr.34457) 2346 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:21.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:20 gibba009 bash[26136]: cluster 2021-03-10T20:54:19.924478+0000 mgr.gibba009.xiladd (mgr.34457) 2346 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:23.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:22 gibba004 bash[30897]: cluster 2021-03-10T20:54:21.925984+0000 mgr.gibba009.xiladd (mgr.34457) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:23.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:22 gibba004 bash[31878]: cluster 2021-03-10T20:54:21.925984+0000 mgr.gibba009.xiladd (mgr.34457) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:23.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:22 gibba009 bash[26136]: cluster 2021-03-10T20:54:21.925984+0000 mgr.gibba009.xiladd (mgr.34457) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:25 gibba004 bash[30897]: cluster 2021-03-10T20:54:23.927232+0000 mgr.gibba009.xiladd (mgr.34457) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:25 gibba004 bash[31878]: cluster 2021-03-10T20:54:23.927232+0000 mgr.gibba009.xiladd (mgr.34457) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:25 gibba009 bash[26136]: cluster 2021-03-10T20:54:23.927232+0000 mgr.gibba009.xiladd (mgr.34457) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.422 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:54:26.649 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:54:26.650 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (43m) 9m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:54:26.651 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (48m) 8m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:54:26.651 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (43m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:54:26.651 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:54:26.652 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:54:26.652 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (42m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:54:26.653 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:54:26.653 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:54:26.653 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (48m) 9m ago 48m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:54:26.653 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:54:26.653 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:54:26.654 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:54:26.654 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:54:26.654 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:54:26.654 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:54:26.655 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:54:26.655 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:54:26.655 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (38m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:54:26.655 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (48m) 8m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:54:26.656 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:26.656 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:26.907 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:54:26.908 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:54:26.908 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:26.909 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:26.909 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:54:26.909 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:26.910 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:26.910 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:54:26.911 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:54:26.911 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:26.912 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:54:26.912 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:54:26.913 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:54:26.913 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:54:26.913 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:54:28.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[30897]: cluster 2021-03-10T20:54:25.929036+0000 mgr.gibba009.xiladd (mgr.34457) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[30897]: audit 2021-03-10T20:54:26.410096+0000 mgr.gibba009.xiladd (mgr.34457) 2350 : audit [DBG] from='client.45642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[30897]: audit 2021-03-10T20:54:26.633999+0000 mgr.gibba009.xiladd (mgr.34457) 2351 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[30897]: audit 2021-03-10T20:54:26.905661+0000 mon.a (mon.0) 909 : audit [DBG] from='client.? 172.21.2.104:0/3054267145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[30897]: audit 2021-03-10T20:54:27.531670+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[31878]: cluster 2021-03-10T20:54:25.929036+0000 mgr.gibba009.xiladd (mgr.34457) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[31878]: audit 2021-03-10T20:54:26.410096+0000 mgr.gibba009.xiladd (mgr.34457) 2350 : audit [DBG] from='client.45642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[31878]: audit 2021-03-10T20:54:26.633999+0000 mgr.gibba009.xiladd (mgr.34457) 2351 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[31878]: audit 2021-03-10T20:54:26.905661+0000 mon.a (mon.0) 909 : audit [DBG] from='client.? 172.21.2.104:0/3054267145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:28.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:27 gibba004 bash[31878]: audit 2021-03-10T20:54:27.531670+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:27 gibba009 bash[26136]: cluster 2021-03-10T20:54:25.929036+0000 mgr.gibba009.xiladd (mgr.34457) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:27 gibba009 bash[26136]: audit 2021-03-10T20:54:26.410096+0000 mgr.gibba009.xiladd (mgr.34457) 2350 : audit [DBG] from='client.45642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:27 gibba009 bash[26136]: audit 2021-03-10T20:54:26.633999+0000 mgr.gibba009.xiladd (mgr.34457) 2351 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:27 gibba009 bash[26136]: audit 2021-03-10T20:54:26.905661+0000 mon.a (mon.0) 909 : audit [DBG] from='client.? 172.21.2.104:0/3054267145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:28.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:27 gibba009 bash[26136]: audit 2021-03-10T20:54:27.531670+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:29.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.535776+0000 mgr.gibba009.xiladd (mgr.34457) 2352 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:54:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.537891+0000 mgr.gibba009.xiladd (mgr.34457) 2353 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:54:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.756992+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:54:29.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.758885+0000 mgr.gibba009.xiladd (mgr.34457) 2354 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.760849+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.760954+0000 mgr.gibba009.xiladd (mgr.34457) 2355 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:29.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.762408+0000 mgr.gibba009.xiladd (mgr.34457) 2356 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.762446+0000 mgr.gibba009.xiladd (mgr.34457) 2357 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.762614+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.764013+0000 mgr.gibba009.xiladd (mgr.34457) 2358 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:29.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.764049+0000 mgr.gibba009.xiladd (mgr.34457) 2359 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:29.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.764116+0000 mon.c (mon.1) 709 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.765495+0000 mgr.gibba009.xiladd (mgr.34457) 2360 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:29.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.765660+0000 mon.c (mon.1) 710 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.767395+0000 mgr.gibba009.xiladd (mgr.34457) 2361 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:29.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.767433+0000 mgr.gibba009.xiladd (mgr.34457) 2362 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:29.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.768785+0000 mgr.gibba009.xiladd (mgr.34457) 2363 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:29.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.769089+0000 mon.c (mon.1) 711 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.769103+0000 mgr.gibba009.xiladd (mgr.34457) 2364 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:29.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.770312+0000 mgr.gibba009.xiladd (mgr.34457) 2365 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:29.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.770351+0000 mgr.gibba009.xiladd (mgr.34457) 2366 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:29.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: cephadm 2021-03-10T20:54:27.770471+0000 mgr.gibba009.xiladd (mgr.34457) 2367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:29.073 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[30897]: audit 2021-03-10T20:54:27.770594+0000 mon.c (mon.1) 712 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.535776+0000 mgr.gibba009.xiladd (mgr.34457) 2352 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:54:29.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.537891+0000 mgr.gibba009.xiladd (mgr.34457) 2353 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:54:29.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.756992+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:54:29.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.758885+0000 mgr.gibba009.xiladd (mgr.34457) 2354 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:29.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.760849+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:29.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.760954+0000 mgr.gibba009.xiladd (mgr.34457) 2355 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:29.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.762408+0000 mgr.gibba009.xiladd (mgr.34457) 2356 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:29.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.762446+0000 mgr.gibba009.xiladd (mgr.34457) 2357 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:29.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.762614+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.764013+0000 mgr.gibba009.xiladd (mgr.34457) 2358 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:29.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.764049+0000 mgr.gibba009.xiladd (mgr.34457) 2359 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:29.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.764116+0000 mon.c (mon.1) 709 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.077 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.765495+0000 mgr.gibba009.xiladd (mgr.34457) 2360 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:29.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.765660+0000 mon.c (mon.1) 710 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.767395+0000 mgr.gibba009.xiladd (mgr.34457) 2361 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:29.078 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.767433+0000 mgr.gibba009.xiladd (mgr.34457) 2362 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:29.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.768785+0000 mgr.gibba009.xiladd (mgr.34457) 2363 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:29.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.769089+0000 mon.c (mon.1) 711 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.079 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.769103+0000 mgr.gibba009.xiladd (mgr.34457) 2364 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:29.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.770312+0000 mgr.gibba009.xiladd (mgr.34457) 2365 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:29.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.770351+0000 mgr.gibba009.xiladd (mgr.34457) 2366 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:29.080 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: cephadm 2021-03-10T20:54:27.770471+0000 mgr.gibba009.xiladd (mgr.34457) 2367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:29.081 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:28 gibba004 bash[31878]: audit 2021-03-10T20:54:27.770594+0000 mon.c (mon.1) 712 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.535776+0000 mgr.gibba009.xiladd (mgr.34457) 2352 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:54:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.537891+0000 mgr.gibba009.xiladd (mgr.34457) 2353 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:54:29.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.756992+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:54:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.758885+0000 mgr.gibba009.xiladd (mgr.34457) 2354 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.760849+0000 mon.c (mon.1) 707 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.760954+0000 mgr.gibba009.xiladd (mgr.34457) 2355 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.762408+0000 mgr.gibba009.xiladd (mgr.34457) 2356 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:29.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.762446+0000 mgr.gibba009.xiladd (mgr.34457) 2357 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.762614+0000 mon.c (mon.1) 708 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.764013+0000 mgr.gibba009.xiladd (mgr.34457) 2358 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:29.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.764049+0000 mgr.gibba009.xiladd (mgr.34457) 2359 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:29.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.764116+0000 mon.c (mon.1) 709 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.765495+0000 mgr.gibba009.xiladd (mgr.34457) 2360 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:29.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.765660+0000 mon.c (mon.1) 710 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.767395+0000 mgr.gibba009.xiladd (mgr.34457) 2361 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:29.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.767433+0000 mgr.gibba009.xiladd (mgr.34457) 2362 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:29.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.768785+0000 mgr.gibba009.xiladd (mgr.34457) 2363 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:29.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.769089+0000 mon.c (mon.1) 711 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:29.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.769103+0000 mgr.gibba009.xiladd (mgr.34457) 2364 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:29.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.770312+0000 mgr.gibba009.xiladd (mgr.34457) 2365 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:29.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.770351+0000 mgr.gibba009.xiladd (mgr.34457) 2366 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:29.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: cephadm 2021-03-10T20:54:27.770471+0000 mgr.gibba009.xiladd (mgr.34457) 2367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:29.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:28 gibba009 bash[26136]: audit 2021-03-10T20:54:27.770594+0000 mon.c (mon.1) 712 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:30.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:29 gibba004 bash[31878]: cluster 2021-03-10T20:54:27.930419+0000 mgr.gibba009.xiladd (mgr.34457) 2368 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:29 gibba004 bash[30897]: cluster 2021-03-10T20:54:27.930419+0000 mgr.gibba009.xiladd (mgr.34457) 2368 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:29 gibba009 bash[26136]: cluster 2021-03-10T20:54:27.930419+0000 mgr.gibba009.xiladd (mgr.34457) 2368 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:31 gibba004 bash[30897]: cluster 2021-03-10T20:54:29.932260+0000 mgr.gibba009.xiladd (mgr.34457) 2369 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:31 gibba004 bash[31878]: cluster 2021-03-10T20:54:29.932260+0000 mgr.gibba009.xiladd (mgr.34457) 2369 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:31 gibba009 bash[26136]: cluster 2021-03-10T20:54:29.932260+0000 mgr.gibba009.xiladd (mgr.34457) 2369 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:33 gibba004 bash[30897]: cluster 2021-03-10T20:54:31.933777+0000 mgr.gibba009.xiladd (mgr.34457) 2370 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:33 gibba004 bash[31878]: cluster 2021-03-10T20:54:31.933777+0000 mgr.gibba009.xiladd (mgr.34457) 2370 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:33 gibba009 bash[26136]: cluster 2021-03-10T20:54:31.933777+0000 mgr.gibba009.xiladd (mgr.34457) 2370 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:35 gibba004 bash[30897]: cluster 2021-03-10T20:54:33.935165+0000 mgr.gibba009.xiladd (mgr.34457) 2371 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:35 gibba004 bash[31878]: cluster 2021-03-10T20:54:33.935165+0000 mgr.gibba009.xiladd (mgr.34457) 2371 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:35 gibba009 bash[26136]: cluster 2021-03-10T20:54:33.935165+0000 mgr.gibba009.xiladd (mgr.34457) 2371 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:37 gibba004 bash[30897]: cluster 2021-03-10T20:54:35.936859+0000 mgr.gibba009.xiladd (mgr.34457) 2372 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:37 gibba004 bash[31878]: cluster 2021-03-10T20:54:35.936859+0000 mgr.gibba009.xiladd (mgr.34457) 2372 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:37 gibba009 bash[26136]: cluster 2021-03-10T20:54:35.936859+0000 mgr.gibba009.xiladd (mgr.34457) 2372 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:39 gibba009 bash[26136]: cluster 2021-03-10T20:54:37.938480+0000 mgr.gibba009.xiladd (mgr.34457) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:39 gibba004 bash[30897]: cluster 2021-03-10T20:54:37.938480+0000 mgr.gibba009.xiladd (mgr.34457) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:39 gibba004 bash[31878]: cluster 2021-03-10T20:54:37.938480+0000 mgr.gibba009.xiladd (mgr.34457) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.849057+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.849931+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.850327+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.851794+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.855586+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.856331+0000 mon.c (mon.1) 716 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.857203+0000 mon.c (mon.1) 717 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.857601+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.857910+0000 mon.c (mon.1) 718 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.858703+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.859951+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:40 gibba009 bash[26136]: audit 2021-03-10T20:54:39.860735+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.849057+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.849931+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.850327+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.851794+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.855586+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.856331+0000 mon.c (mon.1) 716 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.857203+0000 mon.c (mon.1) 717 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.857601+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.857910+0000 mon.c (mon.1) 718 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.858703+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.859951+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[30897]: audit 2021-03-10T20:54:39.860735+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:41.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.849057+0000 mon.c (mon.1) 713 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.849931+0000 mon.c (mon.1) 714 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.850327+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:41.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.851794+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:41.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.855586+0000 mon.c (mon.1) 715 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.856331+0000 mon.c (mon.1) 716 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.857203+0000 mon.c (mon.1) 717 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.857601+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:54:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.857910+0000 mon.c (mon.1) 718 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.858703+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.859951+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:54:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:40 gibba004 bash[31878]: audit 2021-03-10T20:54:39.860735+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:42.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:41 gibba009 bash[26136]: cluster 2021-03-10T20:54:39.940354+0000 mgr.gibba009.xiladd (mgr.34457) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:42.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:41 gibba004 bash[30897]: cluster 2021-03-10T20:54:39.940354+0000 mgr.gibba009.xiladd (mgr.34457) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:42.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:41 gibba004 bash[31878]: cluster 2021-03-10T20:54:39.940354+0000 mgr.gibba009.xiladd (mgr.34457) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:43 gibba004 bash[30897]: cluster 2021-03-10T20:54:41.941759+0000 mgr.gibba009.xiladd (mgr.34457) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:43 gibba004 bash[30897]: cephadm 2021-03-10T20:54:42.775914+0000 mgr.gibba009.xiladd (mgr.34457) 2376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:43 gibba004 bash[31878]: cluster 2021-03-10T20:54:41.941759+0000 mgr.gibba009.xiladd (mgr.34457) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:43 gibba004 bash[31878]: cephadm 2021-03-10T20:54:42.775914+0000 mgr.gibba009.xiladd (mgr.34457) 2376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:43 gibba009 bash[26136]: cluster 2021-03-10T20:54:41.941759+0000 mgr.gibba009.xiladd (mgr.34457) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:43 gibba009 bash[26136]: cephadm 2021-03-10T20:54:42.775914+0000 mgr.gibba009.xiladd (mgr.34457) 2376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:46.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:45 gibba004 bash[30897]: cluster 2021-03-10T20:54:43.943305+0000 mgr.gibba009.xiladd (mgr.34457) 2377 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:45 gibba004 bash[31878]: cluster 2021-03-10T20:54:43.943305+0000 mgr.gibba009.xiladd (mgr.34457) 2377 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:45 gibba009 bash[26136]: cluster 2021-03-10T20:54:43.943305+0000 mgr.gibba009.xiladd (mgr.34457) 2377 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:48.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:47 gibba004 bash[30897]: cluster 2021-03-10T20:54:45.945160+0000 mgr.gibba009.xiladd (mgr.34457) 2378 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:48.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:47 gibba004 bash[31878]: cluster 2021-03-10T20:54:45.945160+0000 mgr.gibba009.xiladd (mgr.34457) 2378 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:48.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:47 gibba009 bash[26136]: cluster 2021-03-10T20:54:45.945160+0000 mgr.gibba009.xiladd (mgr.34457) 2378 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:49 gibba004 bash[30897]: cluster 2021-03-10T20:54:47.946736+0000 mgr.gibba009.xiladd (mgr.34457) 2379 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:49 gibba004 bash[31878]: cluster 2021-03-10T20:54:47.946736+0000 mgr.gibba009.xiladd (mgr.34457) 2379 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:49 gibba009 bash[26136]: cluster 2021-03-10T20:54:47.946736+0000 mgr.gibba009.xiladd (mgr.34457) 2379 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:51.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:50 gibba004 bash[30897]: cluster 2021-03-10T20:54:49.948137+0000 mgr.gibba009.xiladd (mgr.34457) 2380 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:51.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:50 gibba004 bash[31878]: cluster 2021-03-10T20:54:49.948137+0000 mgr.gibba009.xiladd (mgr.34457) 2380 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:51.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:50 gibba009 bash[26136]: cluster 2021-03-10T20:54:49.948137+0000 mgr.gibba009.xiladd (mgr.34457) 2380 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:53.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:53 gibba004 bash[30897]: cluster 2021-03-10T20:54:51.949659+0000 mgr.gibba009.xiladd (mgr.34457) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:53.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:53 gibba004 bash[31878]: cluster 2021-03-10T20:54:51.949659+0000 mgr.gibba009.xiladd (mgr.34457) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:53.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:53 gibba009 bash[26136]: cluster 2021-03-10T20:54:51.949659+0000 mgr.gibba009.xiladd (mgr.34457) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:55 gibba004 bash[30897]: cluster 2021-03-10T20:54:53.951177+0000 mgr.gibba009.xiladd (mgr.34457) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:55 gibba004 bash[31878]: cluster 2021-03-10T20:54:53.951177+0000 mgr.gibba009.xiladd (mgr.34457) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:55 gibba009 bash[26136]: cluster 2021-03-10T20:54:53.951177+0000 mgr.gibba009.xiladd (mgr.34457) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:57.155 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:54:57.383 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:54:57.384 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (43m) 9m ago 49m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:54:57.384 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:54:57.384 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:54:57.385 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:54:57.385 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:54:57.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:54:57.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:54:57.385 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:54:57.386 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:54:57.386 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:54:57.386 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:54:57.386 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:54:57.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:54:57.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:54:57.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:54:57.387 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:54:57.388 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:54:57.388 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:54:57.388 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (48m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:54:57.389 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:57.389 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:57.633 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:54:57.633 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:54:57.633 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:57.633 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:57.634 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:54:57.634 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:57.634 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:57.634 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:54:57.635 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:54:57.635 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:54:57.635 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:54:57.635 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:54:57.636 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:54:57.636 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:54:57.636 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:54:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:57 gibba004 bash[30897]: cluster 2021-03-10T20:54:55.952875+0000 mgr.gibba009.xiladd (mgr.34457) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:57 gibba004 bash[30897]: audit 2021-03-10T20:54:57.630958+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.2.104:0/3859128743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:57 gibba004 bash[31878]: cluster 2021-03-10T20:54:55.952875+0000 mgr.gibba009.xiladd (mgr.34457) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:57 gibba004 bash[31878]: audit 2021-03-10T20:54:57.630958+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.2.104:0/3859128743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:58.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:57 gibba009 bash[26136]: cluster 2021-03-10T20:54:55.952875+0000 mgr.gibba009.xiladd (mgr.34457) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:57 gibba009 bash[26136]: audit 2021-03-10T20:54:57.630958+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.2.104:0/3859128743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[30897]: audit 2021-03-10T20:54:57.142960+0000 mgr.gibba009.xiladd (mgr.34457) 2384 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[30897]: audit 2021-03-10T20:54:57.367751+0000 mgr.gibba009.xiladd (mgr.34457) 2385 : audit [DBG] from='client.55645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[30897]: cephadm 2021-03-10T20:54:57.791723+0000 mgr.gibba009.xiladd (mgr.34457) 2386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:59.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[31878]: audit 2021-03-10T20:54:57.142960+0000 mgr.gibba009.xiladd (mgr.34457) 2384 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[31878]: audit 2021-03-10T20:54:57.367751+0000 mgr.gibba009.xiladd (mgr.34457) 2385 : audit [DBG] from='client.55645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:58 gibba004 bash[31878]: cephadm 2021-03-10T20:54:57.791723+0000 mgr.gibba009.xiladd (mgr.34457) 2386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:54:59.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:58 gibba009 bash[26136]: audit 2021-03-10T20:54:57.142960+0000 mgr.gibba009.xiladd (mgr.34457) 2384 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:58 gibba009 bash[26136]: audit 2021-03-10T20:54:57.367751+0000 mgr.gibba009.xiladd (mgr.34457) 2385 : audit [DBG] from='client.55645 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:59.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:58 gibba009 bash[26136]: cephadm 2021-03-10T20:54:57.791723+0000 mgr.gibba009.xiladd (mgr.34457) 2386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:00.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:54:59 gibba004 bash[30897]: cluster 2021-03-10T20:54:57.954290+0000 mgr.gibba009.xiladd (mgr.34457) 2387 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:00.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:54:59 gibba004 bash[31878]: cluster 2021-03-10T20:54:57.954290+0000 mgr.gibba009.xiladd (mgr.34457) 2387 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:00.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:54:59 gibba009 bash[26136]: cluster 2021-03-10T20:54:57.954290+0000 mgr.gibba009.xiladd (mgr.34457) 2387 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:01 gibba004 bash[30897]: cluster 2021-03-10T20:54:59.955952+0000 mgr.gibba009.xiladd (mgr.34457) 2388 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:01 gibba004 bash[31878]: cluster 2021-03-10T20:54:59.955952+0000 mgr.gibba009.xiladd (mgr.34457) 2388 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:01 gibba009 bash[26136]: cluster 2021-03-10T20:54:59.955952+0000 mgr.gibba009.xiladd (mgr.34457) 2388 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:03 gibba004 bash[30897]: cluster 2021-03-10T20:55:01.957547+0000 mgr.gibba009.xiladd (mgr.34457) 2389 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.120 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:03 gibba004 bash[31878]: cluster 2021-03-10T20:55:01.957547+0000 mgr.gibba009.xiladd (mgr.34457) 2389 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.121 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:03 gibba009 bash[26136]: cluster 2021-03-10T20:55:01.957547+0000 mgr.gibba009.xiladd (mgr.34457) 2389 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:05 gibba004 bash[30897]: cluster 2021-03-10T20:55:03.958826+0000 mgr.gibba009.xiladd (mgr.34457) 2390 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.663 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:05 gibba004 bash[31878]: cluster 2021-03-10T20:55:03.958826+0000 mgr.gibba009.xiladd (mgr.34457) 2390 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.664 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:05 gibba009 bash[26136]: cluster 2021-03-10T20:55:03.958826+0000 mgr.gibba009.xiladd (mgr.34457) 2390 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:07 gibba004 bash[30897]: cluster 2021-03-10T20:55:05.960563+0000 mgr.gibba009.xiladd (mgr.34457) 2391 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:07 gibba004 bash[31878]: cluster 2021-03-10T20:55:05.960563+0000 mgr.gibba009.xiladd (mgr.34457) 2391 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:07 gibba009 bash[26136]: cluster 2021-03-10T20:55:05.960563+0000 mgr.gibba009.xiladd (mgr.34457) 2391 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:09 gibba004 bash[30897]: cluster 2021-03-10T20:55:07.962159+0000 mgr.gibba009.xiladd (mgr.34457) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:09 gibba004 bash[31878]: cluster 2021-03-10T20:55:07.962159+0000 mgr.gibba009.xiladd (mgr.34457) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:09 gibba009 bash[26136]: cluster 2021-03-10T20:55:07.962159+0000 mgr.gibba009.xiladd (mgr.34457) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:11 gibba004 bash[30897]: cluster 2021-03-10T20:55:09.963617+0000 mgr.gibba009.xiladd (mgr.34457) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:11 gibba004 bash[31878]: cluster 2021-03-10T20:55:09.963617+0000 mgr.gibba009.xiladd (mgr.34457) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:11 gibba009 bash[26136]: cluster 2021-03-10T20:55:09.963617+0000 mgr.gibba009.xiladd (mgr.34457) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:13 gibba004 bash[30897]: cluster 2021-03-10T20:55:11.965180+0000 mgr.gibba009.xiladd (mgr.34457) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:13 gibba004 bash[30897]: cephadm 2021-03-10T20:55:12.805302+0000 mgr.gibba009.xiladd (mgr.34457) 2395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:14.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:13 gibba004 bash[31878]: cluster 2021-03-10T20:55:11.965180+0000 mgr.gibba009.xiladd (mgr.34457) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:13 gibba004 bash[31878]: cephadm 2021-03-10T20:55:12.805302+0000 mgr.gibba009.xiladd (mgr.34457) 2395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:14.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:13 gibba009 bash[26136]: cluster 2021-03-10T20:55:11.965180+0000 mgr.gibba009.xiladd (mgr.34457) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:13 gibba009 bash[26136]: cephadm 2021-03-10T20:55:12.805302+0000 mgr.gibba009.xiladd (mgr.34457) 2395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:15 gibba004 bash[30897]: cluster 2021-03-10T20:55:13.966682+0000 mgr.gibba009.xiladd (mgr.34457) 2396 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:15 gibba004 bash[31878]: cluster 2021-03-10T20:55:13.966682+0000 mgr.gibba009.xiladd (mgr.34457) 2396 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:16.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:15 gibba009 bash[26136]: cluster 2021-03-10T20:55:13.966682+0000 mgr.gibba009.xiladd (mgr.34457) 2396 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:18.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:17 gibba009 bash[26136]: cluster 2021-03-10T20:55:15.968464+0000 mgr.gibba009.xiladd (mgr.34457) 2397 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:18.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:17 gibba004 bash[30897]: cluster 2021-03-10T20:55:15.968464+0000 mgr.gibba009.xiladd (mgr.34457) 2397 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:18.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:17 gibba004 bash[31878]: cluster 2021-03-10T20:55:15.968464+0000 mgr.gibba009.xiladd (mgr.34457) 2397 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:19 gibba009 bash[26136]: cluster 2021-03-10T20:55:17.970142+0000 mgr.gibba009.xiladd (mgr.34457) 2398 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:19 gibba004 bash[30897]: cluster 2021-03-10T20:55:17.970142+0000 mgr.gibba009.xiladd (mgr.34457) 2398 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:19 gibba004 bash[31878]: cluster 2021-03-10T20:55:17.970142+0000 mgr.gibba009.xiladd (mgr.34457) 2398 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:21 gibba009 bash[26136]: cluster 2021-03-10T20:55:19.971785+0000 mgr.gibba009.xiladd (mgr.34457) 2399 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:21 gibba004 bash[30897]: cluster 2021-03-10T20:55:19.971785+0000 mgr.gibba009.xiladd (mgr.34457) 2399 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:21 gibba004 bash[31878]: cluster 2021-03-10T20:55:19.971785+0000 mgr.gibba009.xiladd (mgr.34457) 2399 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:23 gibba004 bash[30897]: cluster 2021-03-10T20:55:21.973349+0000 mgr.gibba009.xiladd (mgr.34457) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:23 gibba004 bash[31878]: cluster 2021-03-10T20:55:21.973349+0000 mgr.gibba009.xiladd (mgr.34457) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:24.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:23 gibba009 bash[26136]: cluster 2021-03-10T20:55:21.973349+0000 mgr.gibba009.xiladd (mgr.34457) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:26.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:25 gibba004 bash[30897]: cluster 2021-03-10T20:55:23.974883+0000 mgr.gibba009.xiladd (mgr.34457) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:26.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:25 gibba004 bash[31878]: cluster 2021-03-10T20:55:23.974883+0000 mgr.gibba009.xiladd (mgr.34457) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:25 gibba009 bash[26136]: cluster 2021-03-10T20:55:23.974883+0000 mgr.gibba009.xiladd (mgr.34457) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:27.877 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:55:28.320 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:55:28.321 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (44m) 10m ago 49m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:55:28.321 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (49m) 9m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:55:28.321 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (44m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:55:28.322 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:55:28.322 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:55:28.322 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (43m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:55:28.322 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:55:28.322 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (43m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:55:28.323 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (49m) 10m ago 49m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:55:28.323 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:55:28.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:55:28.323 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:55:28.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:55:28.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:55:28.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:55:28.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:55:28.324 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:55:28.325 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (39m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:55:28.325 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (49m) 9m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:55:28.325 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:28.325 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:28.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[30897]: cluster 2021-03-10T20:55:25.976516+0000 mgr.gibba009.xiladd (mgr.34457) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[30897]: audit 2021-03-10T20:55:27.807613+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:28.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[30897]: audit 2021-03-10T20:55:27.812489+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:55:28.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[31878]: cluster 2021-03-10T20:55:25.976516+0000 mgr.gibba009.xiladd (mgr.34457) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[31878]: audit 2021-03-10T20:55:27.807613+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:28.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:27 gibba004 bash[31878]: audit 2021-03-10T20:55:27.812489+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:55:28.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:27 gibba009 bash[26136]: cluster 2021-03-10T20:55:25.976516+0000 mgr.gibba009.xiladd (mgr.34457) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:27 gibba009 bash[26136]: audit 2021-03-10T20:55:27.807613+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:27 gibba009 bash[26136]: audit 2021-03-10T20:55:27.812489+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:55:28.377 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:55:28.378 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:55:28.378 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:28.378 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:28.378 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:55:28.379 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:28.379 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:28.379 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:55:28.379 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:55:28.380 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:28.380 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:55:28.380 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:55:28.380 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:55:28.380 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:55:28.381 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:55:29.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[30897]: cephadm 2021-03-10T20:55:27.811442+0000 mgr.gibba009.xiladd (mgr.34457) 2403 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:55:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[30897]: audit 2021-03-10T20:55:27.866421+0000 mgr.gibba009.xiladd (mgr.34457) 2404 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[30897]: audit 2021-03-10T20:55:28.375683+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.104:0/2551416278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:29.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[31878]: cephadm 2021-03-10T20:55:27.811442+0000 mgr.gibba009.xiladd (mgr.34457) 2403 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:55:29.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[31878]: audit 2021-03-10T20:55:27.866421+0000 mgr.gibba009.xiladd (mgr.34457) 2404 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:29.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:28 gibba004 bash[31878]: audit 2021-03-10T20:55:28.375683+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.104:0/2551416278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:29.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:28 gibba009 bash[26136]: cephadm 2021-03-10T20:55:27.811442+0000 mgr.gibba009.xiladd (mgr.34457) 2403 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:55:29.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:28 gibba009 bash[26136]: audit 2021-03-10T20:55:27.866421+0000 mgr.gibba009.xiladd (mgr.34457) 2404 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:29.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:28 gibba009 bash[26136]: audit 2021-03-10T20:55:28.375683+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.104:0/2551416278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:30.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:29 gibba004 bash[30897]: cluster 2021-03-10T20:55:27.977242+0000 mgr.gibba009.xiladd (mgr.34457) 2405 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:29 gibba004 bash[30897]: audit 2021-03-10T20:55:28.099295+0000 mgr.gibba009.xiladd (mgr.34457) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:30.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:29 gibba004 bash[31878]: cluster 2021-03-10T20:55:27.977242+0000 mgr.gibba009.xiladd (mgr.34457) 2405 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:30.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:29 gibba004 bash[31878]: audit 2021-03-10T20:55:28.099295+0000 mgr.gibba009.xiladd (mgr.34457) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:29 gibba009 bash[26136]: cluster 2021-03-10T20:55:27.977242+0000 mgr.gibba009.xiladd (mgr.34457) 2405 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:29 gibba009 bash[26136]: audit 2021-03-10T20:55:28.099295+0000 mgr.gibba009.xiladd (mgr.34457) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:32.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: cluster 2021-03-10T20:55:29.978648+0000 mgr.gibba009.xiladd (mgr.34457) 2407 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.353919+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.595560+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.599872+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.601817+0000 mon.c (mon.1) 722 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.603866+0000 mon.c (mon.1) 723 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.605999+0000 mon.c (mon.1) 724 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.610072+0000 mon.c (mon.1) 725 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[30897]: audit 2021-03-10T20:55:31.612449+0000 mon.c (mon.1) 726 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: cluster 2021-03-10T20:55:29.978648+0000 mgr.gibba009.xiladd (mgr.34457) 2407 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.353919+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.595560+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.599872+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.601817+0000 mon.c (mon.1) 722 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.603866+0000 mon.c (mon.1) 723 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.605999+0000 mon.c (mon.1) 724 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.610072+0000 mon.c (mon.1) 725 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:31 gibba004 bash[31878]: audit 2021-03-10T20:55:31.612449+0000 mon.c (mon.1) 726 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: cluster 2021-03-10T20:55:29.978648+0000 mgr.gibba009.xiladd (mgr.34457) 2407 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.353919+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.595560+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:55:32.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.599872+0000 mon.c (mon.1) 721 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.601817+0000 mon.c (mon.1) 722 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.603866+0000 mon.c (mon.1) 723 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.605999+0000 mon.c (mon.1) 724 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.610072+0000 mon.c (mon.1) 725 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:31 gibba009 bash[26136]: audit 2021-03-10T20:55:31.612449+0000 mon.c (mon.1) 726 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:33.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.355838+0000 mgr.gibba009.xiladd (mgr.34457) 2408 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:55:33.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.597934+0000 mgr.gibba009.xiladd (mgr.34457) 2409 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:33.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.600114+0000 mgr.gibba009.xiladd (mgr.34457) 2410 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:33.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.601898+0000 mgr.gibba009.xiladd (mgr.34457) 2411 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:33.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.601952+0000 mgr.gibba009.xiladd (mgr.34457) 2412 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:33.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.604278+0000 mgr.gibba009.xiladd (mgr.34457) 2413 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:33.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.604334+0000 mgr.gibba009.xiladd (mgr.34457) 2414 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:33.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.605751+0000 mgr.gibba009.xiladd (mgr.34457) 2415 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:33.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.608011+0000 mgr.gibba009.xiladd (mgr.34457) 2416 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:33.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.608222+0000 mgr.gibba009.xiladd (mgr.34457) 2417 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:33.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.610185+0000 mgr.gibba009.xiladd (mgr.34457) 2418 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:33.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.610955+0000 mgr.gibba009.xiladd (mgr.34457) 2419 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:33.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.612177+0000 mgr.gibba009.xiladd (mgr.34457) 2420 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:33.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.612237+0000 mgr.gibba009.xiladd (mgr.34457) 2421 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:33.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cephadm 2021-03-10T20:55:31.612449+0000 mgr.gibba009.xiladd (mgr.34457) 2422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:33.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[30897]: cluster 2021-03-10T20:55:31.980150+0000 mgr.gibba009.xiladd (mgr.34457) 2423 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:33.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.355838+0000 mgr.gibba009.xiladd (mgr.34457) 2408 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:55:33.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.597934+0000 mgr.gibba009.xiladd (mgr.34457) 2409 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:33.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.600114+0000 mgr.gibba009.xiladd (mgr.34457) 2410 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:33.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.601898+0000 mgr.gibba009.xiladd (mgr.34457) 2411 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:33.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.601952+0000 mgr.gibba009.xiladd (mgr.34457) 2412 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:33.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.604278+0000 mgr.gibba009.xiladd (mgr.34457) 2413 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:33.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.604334+0000 mgr.gibba009.xiladd (mgr.34457) 2414 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:33.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.605751+0000 mgr.gibba009.xiladd (mgr.34457) 2415 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:33.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.608011+0000 mgr.gibba009.xiladd (mgr.34457) 2416 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:33.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.608222+0000 mgr.gibba009.xiladd (mgr.34457) 2417 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:33.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.610185+0000 mgr.gibba009.xiladd (mgr.34457) 2418 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:33.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.610955+0000 mgr.gibba009.xiladd (mgr.34457) 2419 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:33.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.612177+0000 mgr.gibba009.xiladd (mgr.34457) 2420 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:33.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.612237+0000 mgr.gibba009.xiladd (mgr.34457) 2421 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:33.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cephadm 2021-03-10T20:55:31.612449+0000 mgr.gibba009.xiladd (mgr.34457) 2422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:33.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:32 gibba004 bash[31878]: cluster 2021-03-10T20:55:31.980150+0000 mgr.gibba009.xiladd (mgr.34457) 2423 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:33.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.355838+0000 mgr.gibba009.xiladd (mgr.34457) 2408 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:55:33.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.597934+0000 mgr.gibba009.xiladd (mgr.34457) 2409 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:33.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.600114+0000 mgr.gibba009.xiladd (mgr.34457) 2410 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:33.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.601898+0000 mgr.gibba009.xiladd (mgr.34457) 2411 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:33.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.601952+0000 mgr.gibba009.xiladd (mgr.34457) 2412 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:33.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.604278+0000 mgr.gibba009.xiladd (mgr.34457) 2413 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:33.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.604334+0000 mgr.gibba009.xiladd (mgr.34457) 2414 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:33.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.605751+0000 mgr.gibba009.xiladd (mgr.34457) 2415 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:33.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.608011+0000 mgr.gibba009.xiladd (mgr.34457) 2416 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:33.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.608222+0000 mgr.gibba009.xiladd (mgr.34457) 2417 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:33.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.610185+0000 mgr.gibba009.xiladd (mgr.34457) 2418 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:33.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.610955+0000 mgr.gibba009.xiladd (mgr.34457) 2419 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:33.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.612177+0000 mgr.gibba009.xiladd (mgr.34457) 2420 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:33.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.612237+0000 mgr.gibba009.xiladd (mgr.34457) 2421 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:33.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cephadm 2021-03-10T20:55:31.612449+0000 mgr.gibba009.xiladd (mgr.34457) 2422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:33.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:32 gibba009 bash[26136]: cluster 2021-03-10T20:55:31.980150+0000 mgr.gibba009.xiladd (mgr.34457) 2423 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:35 gibba004 bash[30897]: cluster 2021-03-10T20:55:33.981693+0000 mgr.gibba009.xiladd (mgr.34457) 2424 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:35 gibba004 bash[31878]: cluster 2021-03-10T20:55:33.981693+0000 mgr.gibba009.xiladd (mgr.34457) 2424 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:35 gibba009 bash[26136]: cluster 2021-03-10T20:55:33.981693+0000 mgr.gibba009.xiladd (mgr.34457) 2424 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:37 gibba004 bash[30897]: cluster 2021-03-10T20:55:35.983317+0000 mgr.gibba009.xiladd (mgr.34457) 2425 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:37 gibba004 bash[31878]: cluster 2021-03-10T20:55:35.983317+0000 mgr.gibba009.xiladd (mgr.34457) 2425 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:37 gibba009 bash[26136]: cluster 2021-03-10T20:55:35.983317+0000 mgr.gibba009.xiladd (mgr.34457) 2425 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:39 gibba004 bash[30897]: cluster 2021-03-10T20:55:37.984866+0000 mgr.gibba009.xiladd (mgr.34457) 2426 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:39 gibba004 bash[31878]: cluster 2021-03-10T20:55:37.984866+0000 mgr.gibba009.xiladd (mgr.34457) 2426 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:39 gibba009 bash[26136]: cluster 2021-03-10T20:55:37.984866+0000 mgr.gibba009.xiladd (mgr.34457) 2426 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.855367+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.856026+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.856484+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.857558+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.862105+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.862843+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.863261+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.863523+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.864501+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.864566+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.865537+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[30897]: audit 2021-03-10T20:55:39.866563+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.855367+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.856026+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.856484+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.857558+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.862105+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.862843+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.863261+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.863523+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.864501+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.864566+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.865537+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:40 gibba004 bash[31878]: audit 2021-03-10T20:55:39.866563+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.855367+0000 mon.c (mon.1) 727 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.856026+0000 mon.c (mon.1) 728 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.856484+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.857558+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.862105+0000 mon.c (mon.1) 729 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.862843+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.863261+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:55:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.863523+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.864501+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:55:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.864566+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.865537+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:40 gibba009 bash[26136]: audit 2021-03-10T20:55:39.866563+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:55:42.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:41 gibba004 bash[30897]: cluster 2021-03-10T20:55:39.986344+0000 mgr.gibba009.xiladd (mgr.34457) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:42.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:41 gibba004 bash[31878]: cluster 2021-03-10T20:55:39.986344+0000 mgr.gibba009.xiladd (mgr.34457) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:42.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:41 gibba009 bash[26136]: cluster 2021-03-10T20:55:39.986344+0000 mgr.gibba009.xiladd (mgr.34457) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:43 gibba004 bash[30897]: cluster 2021-03-10T20:55:41.987841+0000 mgr.gibba009.xiladd (mgr.34457) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:43 gibba004 bash[31878]: cluster 2021-03-10T20:55:41.987841+0000 mgr.gibba009.xiladd (mgr.34457) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:43 gibba009 bash[26136]: cluster 2021-03-10T20:55:41.987841+0000 mgr.gibba009.xiladd (mgr.34457) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:45 gibba004 bash[30897]: cluster 2021-03-10T20:55:43.989314+0000 mgr.gibba009.xiladd (mgr.34457) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:45 gibba004 bash[31878]: cluster 2021-03-10T20:55:43.989314+0000 mgr.gibba009.xiladd (mgr.34457) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:45 gibba009 bash[26136]: cluster 2021-03-10T20:55:43.989314+0000 mgr.gibba009.xiladd (mgr.34457) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:47 gibba004 bash[30897]: cluster 2021-03-10T20:55:45.991360+0000 mgr.gibba009.xiladd (mgr.34457) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:47 gibba004 bash[30897]: cephadm 2021-03-10T20:55:46.622643+0000 mgr.gibba009.xiladd (mgr.34457) 2431 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:47 gibba004 bash[31878]: cluster 2021-03-10T20:55:45.991360+0000 mgr.gibba009.xiladd (mgr.34457) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:47 gibba004 bash[31878]: cephadm 2021-03-10T20:55:46.622643+0000 mgr.gibba009.xiladd (mgr.34457) 2431 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:48.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:47 gibba009 bash[26136]: cluster 2021-03-10T20:55:45.991360+0000 mgr.gibba009.xiladd (mgr.34457) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:47 gibba009 bash[26136]: cephadm 2021-03-10T20:55:46.622643+0000 mgr.gibba009.xiladd (mgr.34457) 2431 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:55:50.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:49 gibba004 bash[30897]: cluster 2021-03-10T20:55:47.992749+0000 mgr.gibba009.xiladd (mgr.34457) 2432 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:50.064 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:49 gibba004 bash[31878]: cluster 2021-03-10T20:55:47.992749+0000 mgr.gibba009.xiladd (mgr.34457) 2432 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:50.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:49 gibba009 bash[26136]: cluster 2021-03-10T20:55:47.992749+0000 mgr.gibba009.xiladd (mgr.34457) 2432 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:51 gibba004 bash[30897]: cluster 2021-03-10T20:55:49.994371+0000 mgr.gibba009.xiladd (mgr.34457) 2433 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.250 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:51 gibba004 bash[31878]: cluster 2021-03-10T20:55:49.994371+0000 mgr.gibba009.xiladd (mgr.34457) 2433 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.252 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:51 gibba009 bash[26136]: cluster 2021-03-10T20:55:49.994371+0000 mgr.gibba009.xiladd (mgr.34457) 2433 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:54.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:53 gibba009 bash[26136]: cluster 2021-03-10T20:55:51.995884+0000 mgr.gibba009.xiladd (mgr.34457) 2434 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:54.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:53 gibba004 bash[30897]: cluster 2021-03-10T20:55:51.995884+0000 mgr.gibba009.xiladd (mgr.34457) 2434 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:54.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:53 gibba004 bash[31878]: cluster 2021-03-10T20:55:51.995884+0000 mgr.gibba009.xiladd (mgr.34457) 2434 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:56.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:55 gibba009 bash[26136]: cluster 2021-03-10T20:55:53.997211+0000 mgr.gibba009.xiladd (mgr.34457) 2435 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:56.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:55 gibba004 bash[30897]: cluster 2021-03-10T20:55:53.997211+0000 mgr.gibba009.xiladd (mgr.34457) 2435 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:56.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:55 gibba004 bash[31878]: cluster 2021-03-10T20:55:53.997211+0000 mgr.gibba009.xiladd (mgr.34457) 2435 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:57 gibba009 bash[26136]: cluster 2021-03-10T20:55:55.998757+0000 mgr.gibba009.xiladd (mgr.34457) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:57 gibba004 bash[30897]: cluster 2021-03-10T20:55:55.998757+0000 mgr.gibba009.xiladd (mgr.34457) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:57 gibba004 bash[31878]: cluster 2021-03-10T20:55:55.998757+0000 mgr.gibba009.xiladd (mgr.34457) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.616 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:55:58.844 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:55:58.844 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (44m) 27s ago 50m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:55:58.844 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:55:58.845 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:55:58.845 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:55:58.845 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (44m) 27s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:55:58.846 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (44m) 27s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:55:58.846 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:55:58.846 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (44m) 27s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:55:58.846 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (50m) 27s ago 50m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:55:58.847 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:55:58.847 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (43m) 27s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:55:58.847 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (42m) 27s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:55:58.848 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (42m) 27s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:55:58.848 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (41m) 27s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:55:58.848 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:55:58.848 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:55:58.849 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:55:58.849 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:55:58.849 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (49m) 9m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:55:58.850 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 27s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:58.851 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:59.094 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:55:59.095 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:55:59.095 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:59.096 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:59.096 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:55:59.096 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:59.097 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:59.097 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:55:59.097 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:55:59.099 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:55:59.100 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:55:59.100 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:55:59.101 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:55:59.101 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:55:59.101 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:56:00.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[30897]: cluster 2021-03-10T20:55:58.000053+0000 mgr.gibba009.xiladd (mgr.34457) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[30897]: audit 2021-03-10T20:55:58.604586+0000 mgr.gibba009.xiladd (mgr.34457) 2438 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[30897]: audit 2021-03-10T20:55:58.828057+0000 mgr.gibba009.xiladd (mgr.34457) 2439 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[30897]: audit 2021-03-10T20:55:59.092055+0000 mon.c (mon.1) 733 : audit [DBG] from='client.? 172.21.2.104:0/3189276804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[31878]: cluster 2021-03-10T20:55:58.000053+0000 mgr.gibba009.xiladd (mgr.34457) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[31878]: audit 2021-03-10T20:55:58.604586+0000 mgr.gibba009.xiladd (mgr.34457) 2438 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[31878]: audit 2021-03-10T20:55:58.828057+0000 mgr.gibba009.xiladd (mgr.34457) 2439 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:55:59 gibba004 bash[31878]: audit 2021-03-10T20:55:59.092055+0000 mon.c (mon.1) 733 : audit [DBG] from='client.? 172.21.2.104:0/3189276804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:59 gibba009 bash[26136]: cluster 2021-03-10T20:55:58.000053+0000 mgr.gibba009.xiladd (mgr.34457) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:59 gibba009 bash[26136]: audit 2021-03-10T20:55:58.604586+0000 mgr.gibba009.xiladd (mgr.34457) 2438 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:59 gibba009 bash[26136]: audit 2021-03-10T20:55:58.828057+0000 mgr.gibba009.xiladd (mgr.34457) 2439 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:00.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:55:59 gibba009 bash[26136]: audit 2021-03-10T20:55:59.092055+0000 mon.c (mon.1) 733 : audit [DBG] from='client.? 172.21.2.104:0/3189276804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:02.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:01 gibba009 bash[26136]: cluster 2021-03-10T20:56:00.001626+0000 mgr.gibba009.xiladd (mgr.34457) 2440 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:02.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:01 gibba004 bash[30897]: cluster 2021-03-10T20:56:00.001626+0000 mgr.gibba009.xiladd (mgr.34457) 2440 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:01 gibba004 bash[31878]: cluster 2021-03-10T20:56:00.001626+0000 mgr.gibba009.xiladd (mgr.34457) 2440 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:03.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:02 gibba004 bash[30897]: cephadm 2021-03-10T20:56:01.638334+0000 mgr.gibba009.xiladd (mgr.34457) 2441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:03.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:02 gibba004 bash[31878]: cephadm 2021-03-10T20:56:01.638334+0000 mgr.gibba009.xiladd (mgr.34457) 2441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:03.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:02 gibba009 bash[26136]: cephadm 2021-03-10T20:56:01.638334+0000 mgr.gibba009.xiladd (mgr.34457) 2441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:04.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:03 gibba004 bash[30897]: cluster 2021-03-10T20:56:02.002987+0000 mgr.gibba009.xiladd (mgr.34457) 2442 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:04.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:03 gibba004 bash[31878]: cluster 2021-03-10T20:56:02.002987+0000 mgr.gibba009.xiladd (mgr.34457) 2442 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:04.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:03 gibba009 bash[26136]: cluster 2021-03-10T20:56:02.002987+0000 mgr.gibba009.xiladd (mgr.34457) 2442 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:05 gibba004 bash[30897]: cluster 2021-03-10T20:56:04.004276+0000 mgr.gibba009.xiladd (mgr.34457) 2443 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:05 gibba004 bash[31878]: cluster 2021-03-10T20:56:04.004276+0000 mgr.gibba009.xiladd (mgr.34457) 2443 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:05 gibba009 bash[26136]: cluster 2021-03-10T20:56:04.004276+0000 mgr.gibba009.xiladd (mgr.34457) 2443 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:07 gibba004 bash[30897]: cluster 2021-03-10T20:56:06.006076+0000 mgr.gibba009.xiladd (mgr.34457) 2444 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:07 gibba004 bash[31878]: cluster 2021-03-10T20:56:06.006076+0000 mgr.gibba009.xiladd (mgr.34457) 2444 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:07 gibba009 bash[26136]: cluster 2021-03-10T20:56:06.006076+0000 mgr.gibba009.xiladd (mgr.34457) 2444 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:09 gibba004 bash[30897]: cluster 2021-03-10T20:56:08.007502+0000 mgr.gibba009.xiladd (mgr.34457) 2445 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:09 gibba004 bash[31878]: cluster 2021-03-10T20:56:08.007502+0000 mgr.gibba009.xiladd (mgr.34457) 2445 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:09 gibba009 bash[26136]: cluster 2021-03-10T20:56:08.007502+0000 mgr.gibba009.xiladd (mgr.34457) 2445 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:11.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:10 gibba004 bash[30897]: cluster 2021-03-10T20:56:10.009048+0000 mgr.gibba009.xiladd (mgr.34457) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:11.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:10 gibba004 bash[31878]: cluster 2021-03-10T20:56:10.009048+0000 mgr.gibba009.xiladd (mgr.34457) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:11.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:10 gibba009 bash[26136]: cluster 2021-03-10T20:56:10.009048+0000 mgr.gibba009.xiladd (mgr.34457) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:13.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:13 gibba009 bash[26136]: cluster 2021-03-10T20:56:12.010535+0000 mgr.gibba009.xiladd (mgr.34457) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:13.564 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:13 gibba004 bash[30897]: cluster 2021-03-10T20:56:12.010535+0000 mgr.gibba009.xiladd (mgr.34457) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:13.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:13 gibba004 bash[31878]: cluster 2021-03-10T20:56:12.010535+0000 mgr.gibba009.xiladd (mgr.34457) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:15 gibba004 bash[30897]: cluster 2021-03-10T20:56:14.012067+0000 mgr.gibba009.xiladd (mgr.34457) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:15 gibba004 bash[31878]: cluster 2021-03-10T20:56:14.012067+0000 mgr.gibba009.xiladd (mgr.34457) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:15 gibba009 bash[26136]: cluster 2021-03-10T20:56:14.012067+0000 mgr.gibba009.xiladd (mgr.34457) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:17 gibba004 bash[30897]: cluster 2021-03-10T20:56:16.013721+0000 mgr.gibba009.xiladd (mgr.34457) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:17 gibba004 bash[30897]: cephadm 2021-03-10T20:56:16.654407+0000 mgr.gibba009.xiladd (mgr.34457) 2450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:17 gibba004 bash[31878]: cluster 2021-03-10T20:56:16.013721+0000 mgr.gibba009.xiladd (mgr.34457) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:17 gibba004 bash[31878]: cephadm 2021-03-10T20:56:16.654407+0000 mgr.gibba009.xiladd (mgr.34457) 2450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:18.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:17 gibba009 bash[26136]: cluster 2021-03-10T20:56:16.013721+0000 mgr.gibba009.xiladd (mgr.34457) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:17 gibba009 bash[26136]: cephadm 2021-03-10T20:56:16.654407+0000 mgr.gibba009.xiladd (mgr.34457) 2450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:20.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:19 gibba004 bash[30897]: cluster 2021-03-10T20:56:18.015124+0000 mgr.gibba009.xiladd (mgr.34457) 2451 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:20.274 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:19 gibba004 bash[31878]: cluster 2021-03-10T20:56:18.015124+0000 mgr.gibba009.xiladd (mgr.34457) 2451 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:20.275 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:19 gibba009 bash[26136]: cluster 2021-03-10T20:56:18.015124+0000 mgr.gibba009.xiladd (mgr.34457) 2451 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:22.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:21 gibba004 bash[30897]: cluster 2021-03-10T20:56:20.015986+0000 mgr.gibba009.xiladd (mgr.34457) 2452 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:22.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:21 gibba004 bash[31878]: cluster 2021-03-10T20:56:20.015986+0000 mgr.gibba009.xiladd (mgr.34457) 2452 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:21 gibba009 bash[26136]: cluster 2021-03-10T20:56:20.015986+0000 mgr.gibba009.xiladd (mgr.34457) 2452 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:24.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:23 gibba004 bash[30897]: cluster 2021-03-10T20:56:22.017538+0000 mgr.gibba009.xiladd (mgr.34457) 2453 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:24.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:23 gibba004 bash[31878]: cluster 2021-03-10T20:56:22.017538+0000 mgr.gibba009.xiladd (mgr.34457) 2453 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:24.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:23 gibba009 bash[26136]: cluster 2021-03-10T20:56:22.017538+0000 mgr.gibba009.xiladd (mgr.34457) 2453 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:25 gibba004 bash[30897]: cluster 2021-03-10T20:56:24.018975+0000 mgr.gibba009.xiladd (mgr.34457) 2454 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:25 gibba004 bash[31878]: cluster 2021-03-10T20:56:24.018975+0000 mgr.gibba009.xiladd (mgr.34457) 2454 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:25 gibba009 bash[26136]: cluster 2021-03-10T20:56:24.018975+0000 mgr.gibba009.xiladd (mgr.34457) 2454 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:27 gibba004 bash[30897]: cluster 2021-03-10T20:56:26.020730+0000 mgr.gibba009.xiladd (mgr.34457) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:27 gibba004 bash[31878]: cluster 2021-03-10T20:56:26.020730+0000 mgr.gibba009.xiladd (mgr.34457) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:27 gibba009 bash[26136]: cluster 2021-03-10T20:56:26.020730+0000 mgr.gibba009.xiladd (mgr.34457) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:29.380 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:56:29.607 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:56:29.608 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (45m) 58s ago 50m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:56:29.608 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (50m) 10m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:56:29.608 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (45m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:56:29.609 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (46m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:56:29.609 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (45m) 58s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:56:29.609 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (44m) 58s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:56:29.609 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:56:29.610 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (44m) 58s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:56:29.610 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (50m) 58s ago 50m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:56:29.610 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (50m) 10m ago 50m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:56:29.610 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (43m) 58s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:56:29.610 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (43m) 58s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:56:29.611 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (42m) 58s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:56:29.611 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (42m) 58s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:56:29.611 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:56:29.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:56:29.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:56:29.612 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (40m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:56:29.612 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (50m) 10m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:56:29.613 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 58s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:29.613 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 10m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:29.860 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:56:29.860 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:56:29.861 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:29.861 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:56:29.861 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:56:29.861 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:29.862 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:56:29.862 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:56:29.862 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:56:29.862 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:56:29.862 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:56:29.863 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:56:29.863 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:56:29.863 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:56:29.863 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:56:30.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:29 gibba004 bash[30897]: cluster 2021-03-10T20:56:28.021975+0000 mgr.gibba009.xiladd (mgr.34457) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:30.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:29 gibba004 bash[31878]: cluster 2021-03-10T20:56:28.021975+0000 mgr.gibba009.xiladd (mgr.34457) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:29 gibba009 bash[26136]: cluster 2021-03-10T20:56:28.021975+0000 mgr.gibba009.xiladd (mgr.34457) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:31.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:30 gibba009 bash[26136]: audit 2021-03-10T20:56:29.367508+0000 mgr.gibba009.xiladd (mgr.34457) 2457 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:30 gibba009 bash[26136]: audit 2021-03-10T20:56:29.591962+0000 mgr.gibba009.xiladd (mgr.34457) 2458 : audit [DBG] from='client.55699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:30 gibba009 bash[26136]: audit 2021-03-10T20:56:29.858416+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.2.104:0/592830454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:31.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[30897]: audit 2021-03-10T20:56:29.367508+0000 mgr.gibba009.xiladd (mgr.34457) 2457 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[30897]: audit 2021-03-10T20:56:29.591962+0000 mgr.gibba009.xiladd (mgr.34457) 2458 : audit [DBG] from='client.55699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[30897]: audit 2021-03-10T20:56:29.858416+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.2.104:0/592830454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:31.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[31878]: audit 2021-03-10T20:56:29.367508+0000 mgr.gibba009.xiladd (mgr.34457) 2457 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[31878]: audit 2021-03-10T20:56:29.591962+0000 mgr.gibba009.xiladd (mgr.34457) 2458 : audit [DBG] from='client.55699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:31.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:30 gibba004 bash[31878]: audit 2021-03-10T20:56:29.858416+0000 mon.a (mon.0) 927 : audit [DBG] from='client.? 172.21.2.104:0/592830454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:31 gibba009 bash[26136]: cluster 2021-03-10T20:56:30.022782+0000 mgr.gibba009.xiladd (mgr.34457) 2459 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:31 gibba009 bash[26136]: audit 2021-03-10T20:56:31.672330+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:31 gibba009 bash[26136]: audit 2021-03-10T20:56:31.680712+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:56:32.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[30897]: cluster 2021-03-10T20:56:30.022782+0000 mgr.gibba009.xiladd (mgr.34457) 2459 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[30897]: audit 2021-03-10T20:56:31.672330+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[30897]: audit 2021-03-10T20:56:31.680712+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:56:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[31878]: cluster 2021-03-10T20:56:30.022782+0000 mgr.gibba009.xiladd (mgr.34457) 2459 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[31878]: audit 2021-03-10T20:56:31.672330+0000 mon.c (mon.1) 734 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:31 gibba004 bash[31878]: audit 2021-03-10T20:56:31.680712+0000 mon.c (mon.1) 735 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:56:33.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:32 gibba009 bash[26136]: cephadm 2021-03-10T20:56:31.676640+0000 mgr.gibba009.xiladd (mgr.34457) 2460 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:56:33.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:32 gibba004 bash[30897]: cephadm 2021-03-10T20:56:31.676640+0000 mgr.gibba009.xiladd (mgr.34457) 2460 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:56:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:32 gibba004 bash[31878]: cephadm 2021-03-10T20:56:31.676640+0000 mgr.gibba009.xiladd (mgr.34457) 2460 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:56:34.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:33 gibba004 bash[30897]: cluster 2021-03-10T20:56:32.024161+0000 mgr.gibba009.xiladd (mgr.34457) 2461 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:33 gibba004 bash[31878]: cluster 2021-03-10T20:56:32.024161+0000 mgr.gibba009.xiladd (mgr.34457) 2461 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:33 gibba009 bash[26136]: cluster 2021-03-10T20:56:32.024161+0000 mgr.gibba009.xiladd (mgr.34457) 2461 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: cluster 2021-03-10T20:56:34.025787+0000 mgr.gibba009.xiladd (mgr.34457) 2462 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.476979+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.732733+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.736455+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.738077+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.739088+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.739893+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.742300+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:35 gibba009 bash[26136]: audit 2021-03-10T20:56:35.743684+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: cluster 2021-03-10T20:56:34.025787+0000 mgr.gibba009.xiladd (mgr.34457) 2462 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.476979+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.732733+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.736455+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.738077+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.739088+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.739893+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.742300+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[30897]: audit 2021-03-10T20:56:35.743684+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: cluster 2021-03-10T20:56:34.025787+0000 mgr.gibba009.xiladd (mgr.34457) 2462 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.476979+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.732733+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:56:36.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.736455+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:36.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.738077+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.739088+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.739893+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.742300+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:36.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:35 gibba004 bash[31878]: audit 2021-03-10T20:56:35.743684+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.478000+0000 mgr.gibba009.xiladd (mgr.34457) 2463 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:56:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.734750+0000 mgr.gibba009.xiladd (mgr.34457) 2464 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.736529+0000 mgr.gibba009.xiladd (mgr.34457) 2465 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.737748+0000 mgr.gibba009.xiladd (mgr.34457) 2466 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.737782+0000 mgr.gibba009.xiladd (mgr.34457) 2467 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.738670+0000 mgr.gibba009.xiladd (mgr.34457) 2468 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.738707+0000 mgr.gibba009.xiladd (mgr.34457) 2469 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.739525+0000 mgr.gibba009.xiladd (mgr.34457) 2470 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.740668+0000 mgr.gibba009.xiladd (mgr.34457) 2471 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.740756+0000 mgr.gibba009.xiladd (mgr.34457) 2472 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.741938+0000 mgr.gibba009.xiladd (mgr.34457) 2473 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.742257+0000 mgr.gibba009.xiladd (mgr.34457) 2474 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:37.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.743357+0000 mgr.gibba009.xiladd (mgr.34457) 2475 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:37.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.743454+0000 mgr.gibba009.xiladd (mgr.34457) 2476 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:37.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[30897]: cephadm 2021-03-10T20:56:35.743687+0000 mgr.gibba009.xiladd (mgr.34457) 2477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:37.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.478000+0000 mgr.gibba009.xiladd (mgr.34457) 2463 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:56:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.734750+0000 mgr.gibba009.xiladd (mgr.34457) 2464 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.736529+0000 mgr.gibba009.xiladd (mgr.34457) 2465 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.737748+0000 mgr.gibba009.xiladd (mgr.34457) 2466 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.737782+0000 mgr.gibba009.xiladd (mgr.34457) 2467 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.738670+0000 mgr.gibba009.xiladd (mgr.34457) 2468 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.738707+0000 mgr.gibba009.xiladd (mgr.34457) 2469 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.739525+0000 mgr.gibba009.xiladd (mgr.34457) 2470 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.740668+0000 mgr.gibba009.xiladd (mgr.34457) 2471 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.740756+0000 mgr.gibba009.xiladd (mgr.34457) 2472 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.741938+0000 mgr.gibba009.xiladd (mgr.34457) 2473 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.742257+0000 mgr.gibba009.xiladd (mgr.34457) 2474 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.743357+0000 mgr.gibba009.xiladd (mgr.34457) 2475 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:37.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.743454+0000 mgr.gibba009.xiladd (mgr.34457) 2476 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:37.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:36 gibba004 bash[31878]: cephadm 2021-03-10T20:56:35.743687+0000 mgr.gibba009.xiladd (mgr.34457) 2477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.478000+0000 mgr.gibba009.xiladd (mgr.34457) 2463 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:56:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.734750+0000 mgr.gibba009.xiladd (mgr.34457) 2464 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.736529+0000 mgr.gibba009.xiladd (mgr.34457) 2465 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.737748+0000 mgr.gibba009.xiladd (mgr.34457) 2466 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.737782+0000 mgr.gibba009.xiladd (mgr.34457) 2467 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.738670+0000 mgr.gibba009.xiladd (mgr.34457) 2468 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.738707+0000 mgr.gibba009.xiladd (mgr.34457) 2469 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.739525+0000 mgr.gibba009.xiladd (mgr.34457) 2470 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.740668+0000 mgr.gibba009.xiladd (mgr.34457) 2471 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:37.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.740756+0000 mgr.gibba009.xiladd (mgr.34457) 2472 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:37.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.741938+0000 mgr.gibba009.xiladd (mgr.34457) 2473 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:37.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.742257+0000 mgr.gibba009.xiladd (mgr.34457) 2474 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:37.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.743357+0000 mgr.gibba009.xiladd (mgr.34457) 2475 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:37.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.743454+0000 mgr.gibba009.xiladd (mgr.34457) 2476 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:37.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:36 gibba009 bash[26136]: cephadm 2021-03-10T20:56:35.743687+0000 mgr.gibba009.xiladd (mgr.34457) 2477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:38.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:37 gibba004 bash[30897]: cluster 2021-03-10T20:56:36.027416+0000 mgr.gibba009.xiladd (mgr.34457) 2478 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:38.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:37 gibba004 bash[31878]: cluster 2021-03-10T20:56:36.027416+0000 mgr.gibba009.xiladd (mgr.34457) 2478 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:37 gibba009 bash[26136]: cluster 2021-03-10T20:56:36.027416+0000 mgr.gibba009.xiladd (mgr.34457) 2478 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: cluster 2021-03-10T20:56:38.028945+0000 mgr.gibba009.xiladd (mgr.34457) 2479 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.860830+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.861434+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.861946+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.863076+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.868182+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.868922+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.869332+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.869615+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.870489+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.870972+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[30897]: audit 2021-03-10T20:56:39.872001+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: cluster 2021-03-10T20:56:38.028945+0000 mgr.gibba009.xiladd (mgr.34457) 2479 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.860830+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.861434+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.861946+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.863076+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.868182+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.868922+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.869332+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.869615+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.870489+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.870972+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:39 gibba004 bash[31878]: audit 2021-03-10T20:56:39.872001+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: cluster 2021-03-10T20:56:38.028945+0000 mgr.gibba009.xiladd (mgr.34457) 2479 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.860830+0000 mon.c (mon.1) 742 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.861434+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.861946+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.863076+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.868182+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.868922+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.869332+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:56:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.869615+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.870489+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.870972+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:56:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:39 gibba009 bash[26136]: audit 2021-03-10T20:56:39.872001+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:56:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:40 gibba004 bash[30897]: audit 2021-03-10T20:56:39.874166+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:41.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:40 gibba004 bash[31878]: audit 2021-03-10T20:56:39.874166+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:41.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:40 gibba009 bash[26136]: audit 2021-03-10T20:56:39.874166+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:56:42.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:41 gibba004 bash[30897]: cluster 2021-03-10T20:56:40.029809+0000 mgr.gibba009.xiladd (mgr.34457) 2480 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:42.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:41 gibba004 bash[31878]: cluster 2021-03-10T20:56:40.029809+0000 mgr.gibba009.xiladd (mgr.34457) 2480 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:42.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:41 gibba009 bash[26136]: cluster 2021-03-10T20:56:40.029809+0000 mgr.gibba009.xiladd (mgr.34457) 2480 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:43 gibba004 bash[30897]: cluster 2021-03-10T20:56:42.031169+0000 mgr.gibba009.xiladd (mgr.34457) 2481 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:43 gibba004 bash[31878]: cluster 2021-03-10T20:56:42.031169+0000 mgr.gibba009.xiladd (mgr.34457) 2481 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:43 gibba009 bash[26136]: cluster 2021-03-10T20:56:42.031169+0000 mgr.gibba009.xiladd (mgr.34457) 2481 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:45 gibba004 bash[30897]: cluster 2021-03-10T20:56:44.032708+0000 mgr.gibba009.xiladd (mgr.34457) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:45 gibba004 bash[31878]: cluster 2021-03-10T20:56:44.032708+0000 mgr.gibba009.xiladd (mgr.34457) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:45 gibba009 bash[26136]: cluster 2021-03-10T20:56:44.032708+0000 mgr.gibba009.xiladd (mgr.34457) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:47 gibba004 bash[30897]: cluster 2021-03-10T20:56:46.034320+0000 mgr.gibba009.xiladd (mgr.34457) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:47 gibba004 bash[31878]: cluster 2021-03-10T20:56:46.034320+0000 mgr.gibba009.xiladd (mgr.34457) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:47 gibba009 bash[26136]: cluster 2021-03-10T20:56:46.034320+0000 mgr.gibba009.xiladd (mgr.34457) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:49 gibba004 bash[30897]: cluster 2021-03-10T20:56:48.035550+0000 mgr.gibba009.xiladd (mgr.34457) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:49 gibba004 bash[31878]: cluster 2021-03-10T20:56:48.035550+0000 mgr.gibba009.xiladd (mgr.34457) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.089 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:49 gibba009 bash[26136]: cluster 2021-03-10T20:56:48.035550+0000 mgr.gibba009.xiladd (mgr.34457) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:51 gibba004 bash[30897]: cluster 2021-03-10T20:56:50.036734+0000 mgr.gibba009.xiladd (mgr.34457) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:51 gibba004 bash[30897]: cephadm 2021-03-10T20:56:50.753629+0000 mgr.gibba009.xiladd (mgr.34457) 2486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:52.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:51 gibba004 bash[31878]: cluster 2021-03-10T20:56:50.036734+0000 mgr.gibba009.xiladd (mgr.34457) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:51 gibba004 bash[31878]: cephadm 2021-03-10T20:56:50.753629+0000 mgr.gibba009.xiladd (mgr.34457) 2486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:52.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:51 gibba009 bash[26136]: cluster 2021-03-10T20:56:50.036734+0000 mgr.gibba009.xiladd (mgr.34457) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:51 gibba009 bash[26136]: cephadm 2021-03-10T20:56:50.753629+0000 mgr.gibba009.xiladd (mgr.34457) 2486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:56:54.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:53 gibba009 bash[26136]: cluster 2021-03-10T20:56:52.038313+0000 mgr.gibba009.xiladd (mgr.34457) 2487 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:54.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:53 gibba004 bash[30897]: cluster 2021-03-10T20:56:52.038313+0000 mgr.gibba009.xiladd (mgr.34457) 2487 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:54.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:53 gibba004 bash[31878]: cluster 2021-03-10T20:56:52.038313+0000 mgr.gibba009.xiladd (mgr.34457) 2487 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:56.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:55 gibba009 bash[26136]: cluster 2021-03-10T20:56:54.039732+0000 mgr.gibba009.xiladd (mgr.34457) 2488 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:55 gibba004 bash[30897]: cluster 2021-03-10T20:56:54.039732+0000 mgr.gibba009.xiladd (mgr.34457) 2488 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:55 gibba004 bash[31878]: cluster 2021-03-10T20:56:54.039732+0000 mgr.gibba009.xiladd (mgr.34457) 2488 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:57 gibba009 bash[26136]: cluster 2021-03-10T20:56:56.041659+0000 mgr.gibba009.xiladd (mgr.34457) 2489 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:57 gibba004 bash[30897]: cluster 2021-03-10T20:56:56.041659+0000 mgr.gibba009.xiladd (mgr.34457) 2489 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:57 gibba004 bash[31878]: cluster 2021-03-10T20:56:56.041659+0000 mgr.gibba009.xiladd (mgr.34457) 2489 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.105 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:57:00.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:56:59 gibba004 bash[30897]: cluster 2021-03-10T20:56:58.043194+0000 mgr.gibba009.xiladd (mgr.34457) 2490 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:56:59 gibba004 bash[31878]: cluster 2021-03-10T20:56:58.043194+0000 mgr.gibba009.xiladd (mgr.34457) 2490 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:56:59 gibba009 bash[26136]: cluster 2021-03-10T20:56:58.043194+0000 mgr.gibba009.xiladd (mgr.34457) 2490 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.365 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:57:00.366 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (45m) 88s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:57:00.366 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (51m) 24s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:57:00.366 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (46m) 24s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:57:00.367 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (46m) 24s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:57:00.367 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (45m) 89s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:57:00.367 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (45m) 89s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:57:00.367 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (45m) 24s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:57:00.367 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (45m) 88s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:57:00.368 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (51m) 88s ago 51m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:57:00.368 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (51m) 24s ago 51m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:57:00.368 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (44m) 88s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:57:00.368 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (43m) 88s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:57:00.369 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (43m) 88s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:57:00.369 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (43m) 88s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:57:00.369 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (42m) 24s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:57:00.369 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (42m) 24s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:57:00.369 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (41m) 24s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:57:00.370 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (41m) 24s ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:57:00.370 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (50m) 24s ago 51m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:57:00.370 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 88s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:00.370 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 24s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:00.624 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:57:00.624 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:57:00.625 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:00.625 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:00.626 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:57:00.626 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:00.626 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:00.627 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:57:00.627 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:57:00.628 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:00.628 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:57:00.628 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:57:00.629 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:57:00.629 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:57:00.630 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:57:01.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:00 gibba004 bash[30897]: audit 2021-03-10T20:57:00.621816+0000 mon.c (mon.1) 748 : audit [DBG] from='client.? 172.21.2.104:0/1060407369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:01.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:00 gibba004 bash[31878]: audit 2021-03-10T20:57:00.621816+0000 mon.c (mon.1) 748 : audit [DBG] from='client.? 172.21.2.104:0/1060407369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:01.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:00 gibba009 bash[26136]: audit 2021-03-10T20:57:00.621816+0000 mon.c (mon.1) 748 : audit [DBG] from='client.? 172.21.2.104:0/1060407369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[30897]: cluster 2021-03-10T20:57:00.044031+0000 mgr.gibba009.xiladd (mgr.34457) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[30897]: audit 2021-03-10T20:57:00.093033+0000 mgr.gibba009.xiladd (mgr.34457) 2492 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:02.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[30897]: audit 2021-03-10T20:57:00.319769+0000 mgr.gibba009.xiladd (mgr.34457) 2493 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[31878]: cluster 2021-03-10T20:57:00.044031+0000 mgr.gibba009.xiladd (mgr.34457) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[31878]: audit 2021-03-10T20:57:00.093033+0000 mgr.gibba009.xiladd (mgr.34457) 2492 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:01 gibba004 bash[31878]: audit 2021-03-10T20:57:00.319769+0000 mgr.gibba009.xiladd (mgr.34457) 2493 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:01 gibba009 bash[26136]: cluster 2021-03-10T20:57:00.044031+0000 mgr.gibba009.xiladd (mgr.34457) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:01 gibba009 bash[26136]: audit 2021-03-10T20:57:00.093033+0000 mgr.gibba009.xiladd (mgr.34457) 2492 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:02.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:01 gibba009 bash[26136]: audit 2021-03-10T20:57:00.319769+0000 mgr.gibba009.xiladd (mgr.34457) 2493 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:03 gibba004 bash[30897]: cluster 2021-03-10T20:57:02.045331+0000 mgr.gibba009.xiladd (mgr.34457) 2494 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:04.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:03 gibba004 bash[31878]: cluster 2021-03-10T20:57:02.045331+0000 mgr.gibba009.xiladd (mgr.34457) 2494 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:04.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:03 gibba009 bash[26136]: cluster 2021-03-10T20:57:02.045331+0000 mgr.gibba009.xiladd (mgr.34457) 2494 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:05 gibba009 bash[26136]: cluster 2021-03-10T20:57:04.046721+0000 mgr.gibba009.xiladd (mgr.34457) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:05 gibba004 bash[30897]: cluster 2021-03-10T20:57:04.046721+0000 mgr.gibba009.xiladd (mgr.34457) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:05 gibba004 bash[31878]: cluster 2021-03-10T20:57:04.046721+0000 mgr.gibba009.xiladd (mgr.34457) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:07.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:06 gibba004 bash[30897]: cephadm 2021-03-10T20:57:05.769733+0000 mgr.gibba009.xiladd (mgr.34457) 2496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:07.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:06 gibba004 bash[31878]: cephadm 2021-03-10T20:57:05.769733+0000 mgr.gibba009.xiladd (mgr.34457) 2496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:07.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:06 gibba009 bash[26136]: cephadm 2021-03-10T20:57:05.769733+0000 mgr.gibba009.xiladd (mgr.34457) 2496 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:08.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:07 gibba004 bash[30897]: cluster 2021-03-10T20:57:06.048586+0000 mgr.gibba009.xiladd (mgr.34457) 2497 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:08.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:07 gibba004 bash[31878]: cluster 2021-03-10T20:57:06.048586+0000 mgr.gibba009.xiladd (mgr.34457) 2497 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:07 gibba009 bash[26136]: cluster 2021-03-10T20:57:06.048586+0000 mgr.gibba009.xiladd (mgr.34457) 2497 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:09 gibba004 bash[30897]: cluster 2021-03-10T20:57:08.050224+0000 mgr.gibba009.xiladd (mgr.34457) 2498 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:09 gibba004 bash[31878]: cluster 2021-03-10T20:57:08.050224+0000 mgr.gibba009.xiladd (mgr.34457) 2498 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:09 gibba009 bash[26136]: cluster 2021-03-10T20:57:08.050224+0000 mgr.gibba009.xiladd (mgr.34457) 2498 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:11 gibba004 bash[30897]: cluster 2021-03-10T20:57:10.050898+0000 mgr.gibba009.xiladd (mgr.34457) 2499 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:11 gibba004 bash[31878]: cluster 2021-03-10T20:57:10.050898+0000 mgr.gibba009.xiladd (mgr.34457) 2499 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:11 gibba009 bash[26136]: cluster 2021-03-10T20:57:10.050898+0000 mgr.gibba009.xiladd (mgr.34457) 2499 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:13.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:12 gibba004 bash[30897]: cluster 2021-03-10T20:57:12.052295+0000 mgr.gibba009.xiladd (mgr.34457) 2500 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:13.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:12 gibba004 bash[31878]: cluster 2021-03-10T20:57:12.052295+0000 mgr.gibba009.xiladd (mgr.34457) 2500 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:13.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:12 gibba009 bash[26136]: cluster 2021-03-10T20:57:12.052295+0000 mgr.gibba009.xiladd (mgr.34457) 2500 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:15 gibba004 bash[30897]: cluster 2021-03-10T20:57:14.053688+0000 mgr.gibba009.xiladd (mgr.34457) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:15 gibba004 bash[31878]: cluster 2021-03-10T20:57:14.053688+0000 mgr.gibba009.xiladd (mgr.34457) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:15 gibba009 bash[26136]: cluster 2021-03-10T20:57:14.053688+0000 mgr.gibba009.xiladd (mgr.34457) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:17 gibba004 bash[30897]: cluster 2021-03-10T20:57:16.055330+0000 mgr.gibba009.xiladd (mgr.34457) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:17 gibba004 bash[31878]: cluster 2021-03-10T20:57:16.055330+0000 mgr.gibba009.xiladd (mgr.34457) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:17 gibba009 bash[26136]: cluster 2021-03-10T20:57:16.055330+0000 mgr.gibba009.xiladd (mgr.34457) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.064 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:19 gibba004 bash[30897]: cluster 2021-03-10T20:57:18.056864+0000 mgr.gibba009.xiladd (mgr.34457) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.065 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:19 gibba004 bash[31878]: cluster 2021-03-10T20:57:18.056864+0000 mgr.gibba009.xiladd (mgr.34457) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:19 gibba009 bash[26136]: cluster 2021-03-10T20:57:18.056864+0000 mgr.gibba009.xiladd (mgr.34457) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:21 gibba009 bash[26136]: cluster 2021-03-10T20:57:20.057763+0000 mgr.gibba009.xiladd (mgr.34457) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:21 gibba009 bash[26136]: cephadm 2021-03-10T20:57:20.785751+0000 mgr.gibba009.xiladd (mgr.34457) 2505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:22.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:21 gibba004 bash[30897]: cluster 2021-03-10T20:57:20.057763+0000 mgr.gibba009.xiladd (mgr.34457) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:21 gibba004 bash[30897]: cephadm 2021-03-10T20:57:20.785751+0000 mgr.gibba009.xiladd (mgr.34457) 2505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:21 gibba004 bash[31878]: cluster 2021-03-10T20:57:20.057763+0000 mgr.gibba009.xiladd (mgr.34457) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:21 gibba004 bash[31878]: cephadm 2021-03-10T20:57:20.785751+0000 mgr.gibba009.xiladd (mgr.34457) 2505 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:24.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:23 gibba009 bash[26136]: cluster 2021-03-10T20:57:22.059346+0000 mgr.gibba009.xiladd (mgr.34457) 2506 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:24.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:23 gibba004 bash[30897]: cluster 2021-03-10T20:57:22.059346+0000 mgr.gibba009.xiladd (mgr.34457) 2506 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:23 gibba004 bash[31878]: cluster 2021-03-10T20:57:22.059346+0000 mgr.gibba009.xiladd (mgr.34457) 2506 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:26.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:25 gibba009 bash[26136]: cluster 2021-03-10T20:57:24.060758+0000 mgr.gibba009.xiladd (mgr.34457) 2507 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:25 gibba004 bash[30897]: cluster 2021-03-10T20:57:24.060758+0000 mgr.gibba009.xiladd (mgr.34457) 2507 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:26.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:25 gibba004 bash[31878]: cluster 2021-03-10T20:57:24.060758+0000 mgr.gibba009.xiladd (mgr.34457) 2507 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:27 gibba004 bash[30897]: cluster 2021-03-10T20:57:26.062600+0000 mgr.gibba009.xiladd (mgr.34457) 2508 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:28.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:27 gibba004 bash[31878]: cluster 2021-03-10T20:57:26.062600+0000 mgr.gibba009.xiladd (mgr.34457) 2508 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:27 gibba009 bash[26136]: cluster 2021-03-10T20:57:26.062600+0000 mgr.gibba009.xiladd (mgr.34457) 2508 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:29 gibba004 bash[30897]: cluster 2021-03-10T20:57:28.063854+0000 mgr.gibba009.xiladd (mgr.34457) 2509 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:30.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:29 gibba004 bash[31878]: cluster 2021-03-10T20:57:28.063854+0000 mgr.gibba009.xiladd (mgr.34457) 2509 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:29 gibba009 bash[26136]: cluster 2021-03-10T20:57:28.063854+0000 mgr.gibba009.xiladd (mgr.34457) 2509 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:30.868 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:57:31.094 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:57:31.095 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (46m) 119s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:57:31.095 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (51m) 55s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:57:31.095 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (46m) 55s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:57:31.096 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (47m) 55s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:57:31.096 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (46m) 119s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:57:31.096 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (45m) 119s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:57:31.096 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (45m) 55s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:57:31.097 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (45m) 119s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:57:31.097 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (51m) 119s ago 51m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:57:31.097 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (51m) 55s ago 51m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:57:31.097 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (44m) 119s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:57:31.097 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (44m) 119s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:57:31.098 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (43m) 119s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:57:31.098 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (43m) 119s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:57:31.099 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (43m) 55s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:57:31.099 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (42m) 55s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:57:31.099 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (42m) 55s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:57:31.099 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (41m) 55s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:57:31.100 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (51m) 55s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:57:31.100 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 119s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:31.100 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 55s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:31.344 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:57:31.345 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:57:31.345 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:31.346 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:31.346 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:57:31.347 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:31.347 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:31.347 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:57:31.348 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:57:31.348 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:57:31.350 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:57:31.350 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:57:31.351 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:57:31.351 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:57:31.351 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:57:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[30897]: cluster 2021-03-10T20:57:30.064905+0000 mgr.gibba009.xiladd (mgr.34457) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[30897]: audit 2021-03-10T20:57:30.856955+0000 mgr.gibba009.xiladd (mgr.34457) 2511 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[30897]: audit 2021-03-10T20:57:31.342190+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.2.104:0/1758824834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[31878]: cluster 2021-03-10T20:57:30.064905+0000 mgr.gibba009.xiladd (mgr.34457) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[31878]: audit 2021-03-10T20:57:30.856955+0000 mgr.gibba009.xiladd (mgr.34457) 2511 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:31 gibba004 bash[31878]: audit 2021-03-10T20:57:31.342190+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.2.104:0/1758824834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:31 gibba009 bash[26136]: cluster 2021-03-10T20:57:30.064905+0000 mgr.gibba009.xiladd (mgr.34457) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:31 gibba009 bash[26136]: audit 2021-03-10T20:57:30.856955+0000 mgr.gibba009.xiladd (mgr.34457) 2511 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:32.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:31 gibba009 bash[26136]: audit 2021-03-10T20:57:31.342190+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.2.104:0/1758824834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:33.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:32 gibba004 bash[30897]: audit 2021-03-10T20:57:31.078730+0000 mgr.gibba009.xiladd (mgr.34457) 2512 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:32 gibba004 bash[31878]: audit 2021-03-10T20:57:31.078730+0000 mgr.gibba009.xiladd (mgr.34457) 2512 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:33.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:32 gibba009 bash[26136]: audit 2021-03-10T20:57:31.078730+0000 mgr.gibba009.xiladd (mgr.34457) 2512 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:33 gibba004 bash[30897]: cluster 2021-03-10T20:57:32.066260+0000 mgr.gibba009.xiladd (mgr.34457) 2513 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:33 gibba004 bash[31878]: cluster 2021-03-10T20:57:32.066260+0000 mgr.gibba009.xiladd (mgr.34457) 2513 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:34.339 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:33 gibba009 bash[26136]: cluster 2021-03-10T20:57:32.066260+0000 mgr.gibba009.xiladd (mgr.34457) 2513 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:35 gibba004 bash[30897]: cluster 2021-03-10T20:57:34.067755+0000 mgr.gibba009.xiladd (mgr.34457) 2514 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:35 gibba004 bash[30897]: audit 2021-03-10T20:57:35.795032+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:35 gibba004 bash[31878]: cluster 2021-03-10T20:57:34.067755+0000 mgr.gibba009.xiladd (mgr.34457) 2514 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:35 gibba004 bash[31878]: audit 2021-03-10T20:57:35.795032+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:35 gibba009 bash[26136]: cluster 2021-03-10T20:57:34.067755+0000 mgr.gibba009.xiladd (mgr.34457) 2514 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:35 gibba009 bash[26136]: audit 2021-03-10T20:57:35.795032+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: cephadm 2021-03-10T20:57:35.799360+0000 mgr.gibba009.xiladd (mgr.34457) 2515 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:57:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: cephadm 2021-03-10T20:57:35.801168+0000 mgr.gibba009.xiladd (mgr.34457) 2516 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:57:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.026193+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:57:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.030521+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.031781+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.033087+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.034242+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.037699+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[30897]: audit 2021-03-10T20:57:36.039036+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: cephadm 2021-03-10T20:57:35.799360+0000 mgr.gibba009.xiladd (mgr.34457) 2515 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:57:37.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: cephadm 2021-03-10T20:57:35.801168+0000 mgr.gibba009.xiladd (mgr.34457) 2516 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:57:37.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.026193+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:57:37.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.030521+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:37.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.031781+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.033087+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.034242+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.037699+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:36 gibba004 bash[31878]: audit 2021-03-10T20:57:36.039036+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: cephadm 2021-03-10T20:57:35.799360+0000 mgr.gibba009.xiladd (mgr.34457) 2515 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:57:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: cephadm 2021-03-10T20:57:35.801168+0000 mgr.gibba009.xiladd (mgr.34457) 2516 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:57:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.026193+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:57:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.030521+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.031781+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.033087+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.034242+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.037699+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:36 gibba009 bash[26136]: audit 2021-03-10T20:57:36.039036+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:38.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.028836+0000 mgr.gibba009.xiladd (mgr.34457) 2517 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:38.634 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.030511+0000 mgr.gibba009.xiladd (mgr.34457) 2518 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:38.635 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.031584+0000 mgr.gibba009.xiladd (mgr.34457) 2519 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:38.636 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.031633+0000 mgr.gibba009.xiladd (mgr.34457) 2520 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:38.636 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.032849+0000 mgr.gibba009.xiladd (mgr.34457) 2521 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:38.636 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.032899+0000 mgr.gibba009.xiladd (mgr.34457) 2522 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:38.637 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.034400+0000 mgr.gibba009.xiladd (mgr.34457) 2523 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:38.637 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.036120+0000 mgr.gibba009.xiladd (mgr.34457) 2524 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:38.637 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.036175+0000 mgr.gibba009.xiladd (mgr.34457) 2525 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:38.638 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.037456+0000 mgr.gibba009.xiladd (mgr.34457) 2526 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:38.638 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.037894+0000 mgr.gibba009.xiladd (mgr.34457) 2527 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:38.639 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.039091+0000 mgr.gibba009.xiladd (mgr.34457) 2528 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:38.639 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.039143+0000 mgr.gibba009.xiladd (mgr.34457) 2529 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:38.640 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cephadm 2021-03-10T20:57:36.039309+0000 mgr.gibba009.xiladd (mgr.34457) 2530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:38.640 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[30897]: cluster 2021-03-10T20:57:36.068936+0000 mgr.gibba009.xiladd (mgr.34457) 2531 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:38.641 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.028836+0000 mgr.gibba009.xiladd (mgr.34457) 2517 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:38.641 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.030511+0000 mgr.gibba009.xiladd (mgr.34457) 2518 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:38.641 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.031584+0000 mgr.gibba009.xiladd (mgr.34457) 2519 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:38.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.031633+0000 mgr.gibba009.xiladd (mgr.34457) 2520 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:38.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.032849+0000 mgr.gibba009.xiladd (mgr.34457) 2521 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:38.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.032899+0000 mgr.gibba009.xiladd (mgr.34457) 2522 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:38.642 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.034400+0000 mgr.gibba009.xiladd (mgr.34457) 2523 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:38.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.036120+0000 mgr.gibba009.xiladd (mgr.34457) 2524 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:38.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.036175+0000 mgr.gibba009.xiladd (mgr.34457) 2525 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:38.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.037456+0000 mgr.gibba009.xiladd (mgr.34457) 2526 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:38.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.037894+0000 mgr.gibba009.xiladd (mgr.34457) 2527 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:38.643 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.039091+0000 mgr.gibba009.xiladd (mgr.34457) 2528 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:38.644 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.039143+0000 mgr.gibba009.xiladd (mgr.34457) 2529 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:38.644 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cephadm 2021-03-10T20:57:36.039309+0000 mgr.gibba009.xiladd (mgr.34457) 2530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:38.644 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:37 gibba004 bash[31878]: cluster 2021-03-10T20:57:36.068936+0000 mgr.gibba009.xiladd (mgr.34457) 2531 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:38.645 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.028836+0000 mgr.gibba009.xiladd (mgr.34457) 2517 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:38.645 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.030511+0000 mgr.gibba009.xiladd (mgr.34457) 2518 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:38.645 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.031584+0000 mgr.gibba009.xiladd (mgr.34457) 2519 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:38.645 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.031633+0000 mgr.gibba009.xiladd (mgr.34457) 2520 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:38.646 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.032849+0000 mgr.gibba009.xiladd (mgr.34457) 2521 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:38.646 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.032899+0000 mgr.gibba009.xiladd (mgr.34457) 2522 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:38.646 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.034400+0000 mgr.gibba009.xiladd (mgr.34457) 2523 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:38.647 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.036120+0000 mgr.gibba009.xiladd (mgr.34457) 2524 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:38.647 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.036175+0000 mgr.gibba009.xiladd (mgr.34457) 2525 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:38.647 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.037456+0000 mgr.gibba009.xiladd (mgr.34457) 2526 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:38.647 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.037894+0000 mgr.gibba009.xiladd (mgr.34457) 2527 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:38.647 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.039091+0000 mgr.gibba009.xiladd (mgr.34457) 2528 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:38.648 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.039143+0000 mgr.gibba009.xiladd (mgr.34457) 2529 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:38.648 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cephadm 2021-03-10T20:57:36.039309+0000 mgr.gibba009.xiladd (mgr.34457) 2530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:38.648 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:37 gibba009 bash[26136]: cluster 2021-03-10T20:57:36.068936+0000 mgr.gibba009.xiladd (mgr.34457) 2531 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: cluster 2021-03-10T20:57:38.070400+0000 mgr.gibba009.xiladd (mgr.34457) 2532 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.865830+0000 mon.c (mon.1) 756 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.866285+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.866445+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.866896+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.876128+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.877205+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.877501+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.878322+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.878584+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.879560+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.879809+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[30897]: audit 2021-03-10T20:57:39.880849+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: cluster 2021-03-10T20:57:38.070400+0000 mgr.gibba009.xiladd (mgr.34457) 2532 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.865830+0000 mon.c (mon.1) 756 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.866285+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.866445+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.866896+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.876128+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.877205+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.877501+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.878322+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.878584+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.879560+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.879809+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:39 gibba004 bash[31878]: audit 2021-03-10T20:57:39.880849+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: cluster 2021-03-10T20:57:38.070400+0000 mgr.gibba009.xiladd (mgr.34457) 2532 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.865830+0000 mon.c (mon.1) 756 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.866285+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.866445+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.866896+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.876128+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.877205+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.877501+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:57:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.878322+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.878584+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.879560+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:57:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.879809+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:39 gibba009 bash[26136]: audit 2021-03-10T20:57:39.880849+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:57:42.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:41 gibba004 bash[30897]: cluster 2021-03-10T20:57:40.071650+0000 mgr.gibba009.xiladd (mgr.34457) 2533 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:42.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:41 gibba004 bash[31878]: cluster 2021-03-10T20:57:40.071650+0000 mgr.gibba009.xiladd (mgr.34457) 2533 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:42.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:41 gibba009 bash[26136]: cluster 2021-03-10T20:57:40.071650+0000 mgr.gibba009.xiladd (mgr.34457) 2533 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:43 gibba004 bash[30897]: cluster 2021-03-10T20:57:42.073169+0000 mgr.gibba009.xiladd (mgr.34457) 2534 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:43 gibba004 bash[31878]: cluster 2021-03-10T20:57:42.073169+0000 mgr.gibba009.xiladd (mgr.34457) 2534 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:43 gibba009 bash[26136]: cluster 2021-03-10T20:57:42.073169+0000 mgr.gibba009.xiladd (mgr.34457) 2534 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:45 gibba004 bash[30897]: cluster 2021-03-10T20:57:44.074616+0000 mgr.gibba009.xiladd (mgr.34457) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:45 gibba004 bash[31878]: cluster 2021-03-10T20:57:44.074616+0000 mgr.gibba009.xiladd (mgr.34457) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:45 gibba009 bash[26136]: cluster 2021-03-10T20:57:44.074616+0000 mgr.gibba009.xiladd (mgr.34457) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:47.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:46 gibba004 bash[30897]: cluster 2021-03-10T20:57:46.076634+0000 mgr.gibba009.xiladd (mgr.34457) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:47.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:46 gibba004 bash[31878]: cluster 2021-03-10T20:57:46.076634+0000 mgr.gibba009.xiladd (mgr.34457) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:47.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:46 gibba009 bash[26136]: cluster 2021-03-10T20:57:46.076634+0000 mgr.gibba009.xiladd (mgr.34457) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:49.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:49 gibba004 bash[30897]: cluster 2021-03-10T20:57:48.077893+0000 mgr.gibba009.xiladd (mgr.34457) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:49.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:49 gibba004 bash[31878]: cluster 2021-03-10T20:57:48.077893+0000 mgr.gibba009.xiladd (mgr.34457) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:49.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:49 gibba009 bash[26136]: cluster 2021-03-10T20:57:48.077893+0000 mgr.gibba009.xiladd (mgr.34457) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:51 gibba009 bash[26136]: cluster 2021-03-10T20:57:50.078445+0000 mgr.gibba009.xiladd (mgr.34457) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:51 gibba004 bash[30897]: cluster 2021-03-10T20:57:50.078445+0000 mgr.gibba009.xiladd (mgr.34457) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:51 gibba004 bash[31878]: cluster 2021-03-10T20:57:50.078445+0000 mgr.gibba009.xiladd (mgr.34457) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:53.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:52 gibba009 bash[26136]: cephadm 2021-03-10T20:57:51.055315+0000 mgr.gibba009.xiladd (mgr.34457) 2539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:53.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:52 gibba004 bash[30897]: cephadm 2021-03-10T20:57:51.055315+0000 mgr.gibba009.xiladd (mgr.34457) 2539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:53.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:52 gibba004 bash[31878]: cephadm 2021-03-10T20:57:51.055315+0000 mgr.gibba009.xiladd (mgr.34457) 2539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:57:54.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:53 gibba009 bash[26136]: cluster 2021-03-10T20:57:52.079683+0000 mgr.gibba009.xiladd (mgr.34457) 2540 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:54.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:53 gibba004 bash[30897]: cluster 2021-03-10T20:57:52.079683+0000 mgr.gibba009.xiladd (mgr.34457) 2540 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:54.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:53 gibba004 bash[31878]: cluster 2021-03-10T20:57:52.079683+0000 mgr.gibba009.xiladd (mgr.34457) 2540 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:55 gibba004 bash[30897]: cluster 2021-03-10T20:57:54.080940+0000 mgr.gibba009.xiladd (mgr.34457) 2541 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:55 gibba004 bash[31878]: cluster 2021-03-10T20:57:54.080940+0000 mgr.gibba009.xiladd (mgr.34457) 2541 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:55 gibba009 bash[26136]: cluster 2021-03-10T20:57:54.080940+0000 mgr.gibba009.xiladd (mgr.34457) 2541 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:57 gibba004 bash[30897]: cluster 2021-03-10T20:57:56.082545+0000 mgr.gibba009.xiladd (mgr.34457) 2542 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:58.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:57 gibba004 bash[31878]: cluster 2021-03-10T20:57:56.082545+0000 mgr.gibba009.xiladd (mgr.34457) 2542 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:57 gibba009 bash[26136]: cluster 2021-03-10T20:57:56.082545+0000 mgr.gibba009.xiladd (mgr.34457) 2542 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:57:59 gibba004 bash[30897]: cluster 2021-03-10T20:57:58.083928+0000 mgr.gibba009.xiladd (mgr.34457) 2543 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:57:59 gibba004 bash[31878]: cluster 2021-03-10T20:57:58.083928+0000 mgr.gibba009.xiladd (mgr.34457) 2543 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:57:59 gibba009 bash[26136]: cluster 2021-03-10T20:57:58.083928+0000 mgr.gibba009.xiladd (mgr.34457) 2543 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:01.586 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:58:01.821 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:58:01.821 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (46m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:58:01.822 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (52m) 86s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:58:01.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (47m) 86s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:58:01.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (47m) 86s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:58:01.822 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:58:01.822 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:58:01.823 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (46m) 86s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:58:01.823 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:58:01.823 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (52m) 2m ago 52m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:58:01.823 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (52m) 86s ago 52m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:58:01.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:58:01.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:58:01.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:58:01.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:58:01.824 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (43m) 86s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:58:01.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (43m) 86s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:58:01.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (42m) 86s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:58:01.825 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (42m) 86s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:58:01.825 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (51m) 86s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:58:01.826 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:01.826 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 86s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:02.075 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:58:02.076 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:58:02.076 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:02.076 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:02.076 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:58:02.077 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:02.077 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:02.077 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:58:02.077 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:58:02.078 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:02.078 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:58:02.078 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:58:02.078 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:58:02.078 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:58:02.079 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:58:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:01 gibba004 bash[30897]: cluster 2021-03-10T20:58:00.085070+0000 mgr.gibba009.xiladd (mgr.34457) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:02.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:01 gibba004 bash[31878]: cluster 2021-03-10T20:58:00.085070+0000 mgr.gibba009.xiladd (mgr.34457) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:01 gibba009 bash[26136]: cluster 2021-03-10T20:58:00.085070+0000 mgr.gibba009.xiladd (mgr.34457) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:03.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[30897]: audit 2021-03-10T20:58:01.573690+0000 mgr.gibba009.xiladd (mgr.34457) 2545 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[30897]: audit 2021-03-10T20:58:01.805102+0000 mgr.gibba009.xiladd (mgr.34457) 2546 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[30897]: audit 2021-03-10T20:58:02.073189+0000 mon.c (mon.1) 762 : audit [DBG] from='client.? 172.21.2.104:0/3859699992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[31878]: audit 2021-03-10T20:58:01.573690+0000 mgr.gibba009.xiladd (mgr.34457) 2545 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[31878]: audit 2021-03-10T20:58:01.805102+0000 mgr.gibba009.xiladd (mgr.34457) 2546 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:02 gibba004 bash[31878]: audit 2021-03-10T20:58:02.073189+0000 mon.c (mon.1) 762 : audit [DBG] from='client.? 172.21.2.104:0/3859699992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:03.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:02 gibba009 bash[26136]: audit 2021-03-10T20:58:01.573690+0000 mgr.gibba009.xiladd (mgr.34457) 2545 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:02 gibba009 bash[26136]: audit 2021-03-10T20:58:01.805102+0000 mgr.gibba009.xiladd (mgr.34457) 2546 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:03.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:02 gibba009 bash[26136]: audit 2021-03-10T20:58:02.073189+0000 mon.c (mon.1) 762 : audit [DBG] from='client.? 172.21.2.104:0/3859699992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:03 gibba004 bash[30897]: cluster 2021-03-10T20:58:02.086484+0000 mgr.gibba009.xiladd (mgr.34457) 2547 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:04.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:03 gibba004 bash[31878]: cluster 2021-03-10T20:58:02.086484+0000 mgr.gibba009.xiladd (mgr.34457) 2547 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:03 gibba009 bash[26136]: cluster 2021-03-10T20:58:02.086484+0000 mgr.gibba009.xiladd (mgr.34457) 2547 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:05 gibba004 bash[30897]: cluster 2021-03-10T20:58:04.087872+0000 mgr.gibba009.xiladd (mgr.34457) 2548 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:05 gibba004 bash[31878]: cluster 2021-03-10T20:58:04.087872+0000 mgr.gibba009.xiladd (mgr.34457) 2548 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:05 gibba009 bash[26136]: cluster 2021-03-10T20:58:04.087872+0000 mgr.gibba009.xiladd (mgr.34457) 2548 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:07 gibba004 bash[30897]: cephadm 2021-03-10T20:58:06.069377+0000 mgr.gibba009.xiladd (mgr.34457) 2549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:07 gibba004 bash[30897]: cluster 2021-03-10T20:58:06.089669+0000 mgr.gibba009.xiladd (mgr.34457) 2550 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:07 gibba004 bash[31878]: cephadm 2021-03-10T20:58:06.069377+0000 mgr.gibba009.xiladd (mgr.34457) 2549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:07 gibba004 bash[31878]: cluster 2021-03-10T20:58:06.089669+0000 mgr.gibba009.xiladd (mgr.34457) 2550 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:07 gibba009 bash[26136]: cephadm 2021-03-10T20:58:06.069377+0000 mgr.gibba009.xiladd (mgr.34457) 2549 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:07 gibba009 bash[26136]: cluster 2021-03-10T20:58:06.089669+0000 mgr.gibba009.xiladd (mgr.34457) 2550 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:09 gibba004 bash[30897]: cluster 2021-03-10T20:58:08.091123+0000 mgr.gibba009.xiladd (mgr.34457) 2551 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:09 gibba004 bash[31878]: cluster 2021-03-10T20:58:08.091123+0000 mgr.gibba009.xiladd (mgr.34457) 2551 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:09 gibba009 bash[26136]: cluster 2021-03-10T20:58:08.091123+0000 mgr.gibba009.xiladd (mgr.34457) 2551 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:11 gibba004 bash[30897]: cluster 2021-03-10T20:58:10.092732+0000 mgr.gibba009.xiladd (mgr.34457) 2552 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:11 gibba004 bash[31878]: cluster 2021-03-10T20:58:10.092732+0000 mgr.gibba009.xiladd (mgr.34457) 2552 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:11 gibba009 bash[26136]: cluster 2021-03-10T20:58:10.092732+0000 mgr.gibba009.xiladd (mgr.34457) 2552 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:13 gibba004 bash[30897]: cluster 2021-03-10T20:58:12.094361+0000 mgr.gibba009.xiladd (mgr.34457) 2553 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:13 gibba004 bash[31878]: cluster 2021-03-10T20:58:12.094361+0000 mgr.gibba009.xiladd (mgr.34457) 2553 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:13 gibba009 bash[26136]: cluster 2021-03-10T20:58:12.094361+0000 mgr.gibba009.xiladd (mgr.34457) 2553 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:15 gibba004 bash[30897]: cluster 2021-03-10T20:58:14.095772+0000 mgr.gibba009.xiladd (mgr.34457) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:15 gibba004 bash[31878]: cluster 2021-03-10T20:58:14.095772+0000 mgr.gibba009.xiladd (mgr.34457) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:15 gibba009 bash[26136]: cluster 2021-03-10T20:58:14.095772+0000 mgr.gibba009.xiladd (mgr.34457) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:17.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:16 gibba004 bash[30897]: cluster 2021-03-10T20:58:16.097689+0000 mgr.gibba009.xiladd (mgr.34457) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:17.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:16 gibba004 bash[31878]: cluster 2021-03-10T20:58:16.097689+0000 mgr.gibba009.xiladd (mgr.34457) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:17.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:16 gibba009 bash[26136]: cluster 2021-03-10T20:58:16.097689+0000 mgr.gibba009.xiladd (mgr.34457) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:19.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:19 gibba004 bash[30897]: cluster 2021-03-10T20:58:18.099063+0000 mgr.gibba009.xiladd (mgr.34457) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:19.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:19 gibba004 bash[31878]: cluster 2021-03-10T20:58:18.099063+0000 mgr.gibba009.xiladd (mgr.34457) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:19.589 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:19 gibba009 bash[26136]: cluster 2021-03-10T20:58:18.099063+0000 mgr.gibba009.xiladd (mgr.34457) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:21 gibba009 bash[26136]: cluster 2021-03-10T20:58:20.100846+0000 mgr.gibba009.xiladd (mgr.34457) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:21 gibba004 bash[30897]: cluster 2021-03-10T20:58:20.100846+0000 mgr.gibba009.xiladd (mgr.34457) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:21 gibba004 bash[31878]: cluster 2021-03-10T20:58:20.100846+0000 mgr.gibba009.xiladd (mgr.34457) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:23.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:22 gibba004 bash[30897]: cephadm 2021-03-10T20:58:21.085224+0000 mgr.gibba009.xiladd (mgr.34457) 2558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:23.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:22 gibba004 bash[31878]: cephadm 2021-03-10T20:58:21.085224+0000 mgr.gibba009.xiladd (mgr.34457) 2558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:23.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:22 gibba009 bash[26136]: cephadm 2021-03-10T20:58:21.085224+0000 mgr.gibba009.xiladd (mgr.34457) 2558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:23 gibba004 bash[30897]: cluster 2021-03-10T20:58:22.102277+0000 mgr.gibba009.xiladd (mgr.34457) 2559 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:24.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:23 gibba004 bash[31878]: cluster 2021-03-10T20:58:22.102277+0000 mgr.gibba009.xiladd (mgr.34457) 2559 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:23 gibba009 bash[26136]: cluster 2021-03-10T20:58:22.102277+0000 mgr.gibba009.xiladd (mgr.34457) 2559 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:25 gibba004 bash[30897]: cluster 2021-03-10T20:58:24.103974+0000 mgr.gibba009.xiladd (mgr.34457) 2560 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:25 gibba004 bash[31878]: cluster 2021-03-10T20:58:24.103974+0000 mgr.gibba009.xiladd (mgr.34457) 2560 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:25 gibba009 bash[26136]: cluster 2021-03-10T20:58:24.103974+0000 mgr.gibba009.xiladd (mgr.34457) 2560 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:27 gibba004 bash[30897]: cluster 2021-03-10T20:58:26.105809+0000 mgr.gibba009.xiladd (mgr.34457) 2561 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:28.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:27 gibba004 bash[31878]: cluster 2021-03-10T20:58:26.105809+0000 mgr.gibba009.xiladd (mgr.34457) 2561 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:27 gibba009 bash[26136]: cluster 2021-03-10T20:58:26.105809+0000 mgr.gibba009.xiladd (mgr.34457) 2561 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:29 gibba004 bash[30897]: cluster 2021-03-10T20:58:28.107400+0000 mgr.gibba009.xiladd (mgr.34457) 2562 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:30.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:29 gibba004 bash[31878]: cluster 2021-03-10T20:58:28.107400+0000 mgr.gibba009.xiladd (mgr.34457) 2562 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:29 gibba009 bash[26136]: cluster 2021-03-10T20:58:28.107400+0000 mgr.gibba009.xiladd (mgr.34457) 2562 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:31 gibba004 bash[30897]: cluster 2021-03-10T20:58:30.109121+0000 mgr.gibba009.xiladd (mgr.34457) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:31 gibba004 bash[31878]: cluster 2021-03-10T20:58:30.109121+0000 mgr.gibba009.xiladd (mgr.34457) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.320 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:58:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:31 gibba009 bash[26136]: cluster 2021-03-10T20:58:30.109121+0000 mgr.gibba009.xiladd (mgr.34457) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.551 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:58:32.551 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (47m) 3m ago 52m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:58:32.551 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (52m) 117s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:58:32.551 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (47m) 117s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:58:32.552 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (48m) 117s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:58:32.552 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:58:32.552 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:58:32.552 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (46m) 117s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:58:32.552 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:58:32.553 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (52m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:58:32.553 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (52m) 117s ago 53m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:58:32.553 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:58:32.553 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:58:32.554 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:58:32.554 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (44m) 3m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:58:32.554 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (44m) 117s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:58:32.554 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (43m) 117s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:58:32.554 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (43m) 117s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:58:32.555 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (42m) 117s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:58:32.555 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (52m) 117s ago 53m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:58:32.555 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:32.555 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 117s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:32.799 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:58:32.799 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:58:32.800 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:32.800 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:32.800 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:58:32.800 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:32.801 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:32.801 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:58:32.801 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:58:32.801 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:58:32.801 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:58:32.802 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:58:32.802 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:58:32.802 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:58:32.802 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:58:33.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:32 gibba004 bash[30897]: audit 2021-03-10T20:58:32.796563+0000 mon.a (mon.0) 944 : audit [DBG] from='client.? 172.21.2.104:0/1257703477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:33.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:32 gibba004 bash[31878]: audit 2021-03-10T20:58:32.796563+0000 mon.a (mon.0) 944 : audit [DBG] from='client.? 172.21.2.104:0/1257703477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:33.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:32 gibba009 bash[26136]: audit 2021-03-10T20:58:32.796563+0000 mon.a (mon.0) 944 : audit [DBG] from='client.? 172.21.2.104:0/1257703477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[30897]: cluster 2021-03-10T20:58:32.110506+0000 mgr.gibba009.xiladd (mgr.34457) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[30897]: audit 2021-03-10T20:58:32.308166+0000 mgr.gibba009.xiladd (mgr.34457) 2565 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:34.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[30897]: audit 2021-03-10T20:58:32.534882+0000 mgr.gibba009.xiladd (mgr.34457) 2566 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:34.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[31878]: cluster 2021-03-10T20:58:32.110506+0000 mgr.gibba009.xiladd (mgr.34457) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:34.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[31878]: audit 2021-03-10T20:58:32.308166+0000 mgr.gibba009.xiladd (mgr.34457) 2565 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:34.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:33 gibba004 bash[31878]: audit 2021-03-10T20:58:32.534882+0000 mgr.gibba009.xiladd (mgr.34457) 2566 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:33 gibba009 bash[26136]: cluster 2021-03-10T20:58:32.110506+0000 mgr.gibba009.xiladd (mgr.34457) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:33 gibba009 bash[26136]: audit 2021-03-10T20:58:32.308166+0000 mgr.gibba009.xiladd (mgr.34457) 2565 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:33 gibba009 bash[26136]: audit 2021-03-10T20:58:32.534882+0000 mgr.gibba009.xiladd (mgr.34457) 2566 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:36.314 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:35 gibba004 bash[30897]: cluster 2021-03-10T20:58:34.111968+0000 mgr.gibba009.xiladd (mgr.34457) 2567 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:36.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:35 gibba004 bash[31878]: cluster 2021-03-10T20:58:34.111968+0000 mgr.gibba009.xiladd (mgr.34457) 2567 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:35 gibba009 bash[26136]: cluster 2021-03-10T20:58:34.111968+0000 mgr.gibba009.xiladd (mgr.34457) 2567 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.099026+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.333134+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:58:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.337270+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.339006+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.340528+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.341708+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.344618+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[30897]: audit 2021-03-10T20:58:36.346489+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.099026+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.333134+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:58:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.337270+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.339006+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.340528+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.341708+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.344618+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:36 gibba004 bash[31878]: audit 2021-03-10T20:58:36.346489+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.099026+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.333134+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:58:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.337270+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.339006+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.340528+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.341708+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.344618+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:37.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:36 gibba009 bash[26136]: audit 2021-03-10T20:58:36.346489+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.103241+0000 mgr.gibba009.xiladd (mgr.34457) 2568 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:58:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.105129+0000 mgr.gibba009.xiladd (mgr.34457) 2569 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:58:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cluster 2021-03-10T20:58:36.113532+0000 mgr.gibba009.xiladd (mgr.34457) 2570 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.335529+0000 mgr.gibba009.xiladd (mgr.34457) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.337616+0000 mgr.gibba009.xiladd (mgr.34457) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.338979+0000 mgr.gibba009.xiladd (mgr.34457) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.339020+0000 mgr.gibba009.xiladd (mgr.34457) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.340408+0000 mgr.gibba009.xiladd (mgr.34457) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.340447+0000 mgr.gibba009.xiladd (mgr.34457) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.341528+0000 mgr.gibba009.xiladd (mgr.34457) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.343266+0000 mgr.gibba009.xiladd (mgr.34457) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.343309+0000 mgr.gibba009.xiladd (mgr.34457) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.344764+0000 mgr.gibba009.xiladd (mgr.34457) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.345154+0000 mgr.gibba009.xiladd (mgr.34457) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.346624+0000 mgr.gibba009.xiladd (mgr.34457) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.346744+0000 mgr.gibba009.xiladd (mgr.34457) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[30897]: cephadm 2021-03-10T20:58:36.346918+0000 mgr.gibba009.xiladd (mgr.34457) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.103241+0000 mgr.gibba009.xiladd (mgr.34457) 2568 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:58:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.105129+0000 mgr.gibba009.xiladd (mgr.34457) 2569 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:58:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cluster 2021-03-10T20:58:36.113532+0000 mgr.gibba009.xiladd (mgr.34457) 2570 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.335529+0000 mgr.gibba009.xiladd (mgr.34457) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.337616+0000 mgr.gibba009.xiladd (mgr.34457) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.338979+0000 mgr.gibba009.xiladd (mgr.34457) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.339020+0000 mgr.gibba009.xiladd (mgr.34457) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.340408+0000 mgr.gibba009.xiladd (mgr.34457) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.340447+0000 mgr.gibba009.xiladd (mgr.34457) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.341528+0000 mgr.gibba009.xiladd (mgr.34457) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.343266+0000 mgr.gibba009.xiladd (mgr.34457) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.343309+0000 mgr.gibba009.xiladd (mgr.34457) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.344764+0000 mgr.gibba009.xiladd (mgr.34457) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.345154+0000 mgr.gibba009.xiladd (mgr.34457) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.346624+0000 mgr.gibba009.xiladd (mgr.34457) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.346744+0000 mgr.gibba009.xiladd (mgr.34457) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:37 gibba004 bash[31878]: cephadm 2021-03-10T20:58:36.346918+0000 mgr.gibba009.xiladd (mgr.34457) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.103241+0000 mgr.gibba009.xiladd (mgr.34457) 2568 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:58:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.105129+0000 mgr.gibba009.xiladd (mgr.34457) 2569 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:58:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cluster 2021-03-10T20:58:36.113532+0000 mgr.gibba009.xiladd (mgr.34457) 2570 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.335529+0000 mgr.gibba009.xiladd (mgr.34457) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.337616+0000 mgr.gibba009.xiladd (mgr.34457) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:38.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.338979+0000 mgr.gibba009.xiladd (mgr.34457) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:38.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.339020+0000 mgr.gibba009.xiladd (mgr.34457) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:38.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.340408+0000 mgr.gibba009.xiladd (mgr.34457) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:38.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.340447+0000 mgr.gibba009.xiladd (mgr.34457) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.341528+0000 mgr.gibba009.xiladd (mgr.34457) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.343266+0000 mgr.gibba009.xiladd (mgr.34457) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.343309+0000 mgr.gibba009.xiladd (mgr.34457) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.344764+0000 mgr.gibba009.xiladd (mgr.34457) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.345154+0000 mgr.gibba009.xiladd (mgr.34457) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.346624+0000 mgr.gibba009.xiladd (mgr.34457) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.346744+0000 mgr.gibba009.xiladd (mgr.34457) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:37 gibba009 bash[26136]: cephadm 2021-03-10T20:58:36.346918+0000 mgr.gibba009.xiladd (mgr.34457) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: cluster 2021-03-10T20:58:38.114996+0000 mgr.gibba009.xiladd (mgr.34457) 2585 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.871287+0000 mon.c (mon.1) 770 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.871461+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.871778+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.871944+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.884781+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885000+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885219+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885308+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885420+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885685+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.885978+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[30897]: audit 2021-03-10T20:58:39.886207+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: cluster 2021-03-10T20:58:38.114996+0000 mgr.gibba009.xiladd (mgr.34457) 2585 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.871287+0000 mon.c (mon.1) 770 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.871461+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.871778+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.871944+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.884781+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885000+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885219+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885308+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885420+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885685+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.885978+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:39 gibba004 bash[31878]: audit 2021-03-10T20:58:39.886207+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: cluster 2021-03-10T20:58:38.114996+0000 mgr.gibba009.xiladd (mgr.34457) 2585 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.871287+0000 mon.c (mon.1) 770 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.871461+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.871778+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.871944+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.884781+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885000+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885219+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885308+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:58:40.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885420+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:40.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885685+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.885978+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:58:40.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:39 gibba009 bash[26136]: audit 2021-03-10T20:58:39.886207+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:58:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:40 gibba004 bash[30897]: cluster 2021-03-10T20:58:40.116817+0000 mgr.gibba009.xiladd (mgr.34457) 2586 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:41.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:40 gibba004 bash[31878]: cluster 2021-03-10T20:58:40.116817+0000 mgr.gibba009.xiladd (mgr.34457) 2586 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:41.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:40 gibba009 bash[26136]: cluster 2021-03-10T20:58:40.116817+0000 mgr.gibba009.xiladd (mgr.34457) 2586 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:43.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:43 gibba004 bash[30897]: cluster 2021-03-10T20:58:42.118490+0000 mgr.gibba009.xiladd (mgr.34457) 2587 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:43.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:43 gibba004 bash[31878]: cluster 2021-03-10T20:58:42.118490+0000 mgr.gibba009.xiladd (mgr.34457) 2587 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:43.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:43 gibba009 bash[26136]: cluster 2021-03-10T20:58:42.118490+0000 mgr.gibba009.xiladd (mgr.34457) 2587 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:45 gibba004 bash[30897]: cluster 2021-03-10T20:58:44.120019+0000 mgr.gibba009.xiladd (mgr.34457) 2588 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:45 gibba004 bash[31878]: cluster 2021-03-10T20:58:44.120019+0000 mgr.gibba009.xiladd (mgr.34457) 2588 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:45 gibba009 bash[26136]: cluster 2021-03-10T20:58:44.120019+0000 mgr.gibba009.xiladd (mgr.34457) 2588 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:47 gibba004 bash[30897]: cluster 2021-03-10T20:58:46.121968+0000 mgr.gibba009.xiladd (mgr.34457) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:47 gibba004 bash[31878]: cluster 2021-03-10T20:58:46.121968+0000 mgr.gibba009.xiladd (mgr.34457) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:47 gibba009 bash[26136]: cluster 2021-03-10T20:58:46.121968+0000 mgr.gibba009.xiladd (mgr.34457) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:49 gibba004 bash[30897]: cluster 2021-03-10T20:58:48.123293+0000 mgr.gibba009.xiladd (mgr.34457) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:49 gibba004 bash[31878]: cluster 2021-03-10T20:58:48.123293+0000 mgr.gibba009.xiladd (mgr.34457) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:49 gibba009 bash[26136]: cluster 2021-03-10T20:58:48.123293+0000 mgr.gibba009.xiladd (mgr.34457) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:51 gibba004 bash[30897]: cluster 2021-03-10T20:58:50.124181+0000 mgr.gibba009.xiladd (mgr.34457) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:51 gibba004 bash[31878]: cluster 2021-03-10T20:58:50.124181+0000 mgr.gibba009.xiladd (mgr.34457) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:51 gibba009 bash[26136]: cluster 2021-03-10T20:58:50.124181+0000 mgr.gibba009.xiladd (mgr.34457) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:53.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:52 gibba004 bash[30897]: cephadm 2021-03-10T20:58:51.354408+0000 mgr.gibba009.xiladd (mgr.34457) 2592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:53.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:52 gibba004 bash[31878]: cephadm 2021-03-10T20:58:51.354408+0000 mgr.gibba009.xiladd (mgr.34457) 2592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:53.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:52 gibba009 bash[26136]: cephadm 2021-03-10T20:58:51.354408+0000 mgr.gibba009.xiladd (mgr.34457) 2592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:58:54.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:53 gibba004 bash[30897]: cluster 2021-03-10T20:58:52.125578+0000 mgr.gibba009.xiladd (mgr.34457) 2593 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:54.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:53 gibba004 bash[31878]: cluster 2021-03-10T20:58:52.125578+0000 mgr.gibba009.xiladd (mgr.34457) 2593 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:53 gibba009 bash[26136]: cluster 2021-03-10T20:58:52.125578+0000 mgr.gibba009.xiladd (mgr.34457) 2593 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:55 gibba004 bash[30897]: cluster 2021-03-10T20:58:54.126981+0000 mgr.gibba009.xiladd (mgr.34457) 2594 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:55 gibba004 bash[31878]: cluster 2021-03-10T20:58:54.126981+0000 mgr.gibba009.xiladd (mgr.34457) 2594 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:55 gibba009 bash[26136]: cluster 2021-03-10T20:58:54.126981+0000 mgr.gibba009.xiladd (mgr.34457) 2594 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:57 gibba004 bash[30897]: cluster 2021-03-10T20:58:56.128765+0000 mgr.gibba009.xiladd (mgr.34457) 2595 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:58.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:57 gibba004 bash[31878]: cluster 2021-03-10T20:58:56.128765+0000 mgr.gibba009.xiladd (mgr.34457) 2595 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:57 gibba009 bash[26136]: cluster 2021-03-10T20:58:56.128765+0000 mgr.gibba009.xiladd (mgr.34457) 2595 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:58:59 gibba004 bash[30897]: cluster 2021-03-10T20:58:58.130160+0000 mgr.gibba009.xiladd (mgr.34457) 2596 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:58:59 gibba004 bash[31878]: cluster 2021-03-10T20:58:58.130160+0000 mgr.gibba009.xiladd (mgr.34457) 2596 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:58:59 gibba009 bash[26136]: cluster 2021-03-10T20:58:58.130160+0000 mgr.gibba009.xiladd (mgr.34457) 2596 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:01 gibba004 bash[30897]: cluster 2021-03-10T20:59:00.131889+0000 mgr.gibba009.xiladd (mgr.34457) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:01 gibba004 bash[31878]: cluster 2021-03-10T20:59:00.131889+0000 mgr.gibba009.xiladd (mgr.34457) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:01 gibba009 bash[26136]: cluster 2021-03-10T20:59:00.131889+0000 mgr.gibba009.xiladd (mgr.34457) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:03.042 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:59:03.271 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:59:03.271 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (47m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:59:03.271 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:59:03.272 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:59:03.272 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:59:03.272 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:59:03.272 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:59:03.272 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:59:03.273 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:59:03.273 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (53m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:59:03.273 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:59:03.273 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:59:03.274 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:59:03.274 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:59:03.274 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:59:03.275 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:59:03.275 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:59:03.275 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:59:03.275 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (43m) 2m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:59:03.276 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (52m) 2m ago 53m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:59:03.276 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:03.276 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:03.518 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:59:03.519 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:59:03.519 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:03.519 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:03.520 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:59:03.520 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:03.520 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:03.520 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:59:03.520 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:59:03.521 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:03.521 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:59:03.521 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:59:03.521 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:59:03.522 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:59:03.522 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:59:04.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:03 gibba004 bash[30897]: cluster 2021-03-10T20:59:02.133561+0000 mgr.gibba009.xiladd (mgr.34457) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:04.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:03 gibba004 bash[30897]: audit 2021-03-10T20:59:03.516187+0000 mon.a (mon.0) 952 : audit [DBG] from='client.? 172.21.2.104:0/1963176742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:04.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:03 gibba004 bash[31878]: cluster 2021-03-10T20:59:02.133561+0000 mgr.gibba009.xiladd (mgr.34457) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:04.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:03 gibba004 bash[31878]: audit 2021-03-10T20:59:03.516187+0000 mon.a (mon.0) 952 : audit [DBG] from='client.? 172.21.2.104:0/1963176742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:04.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:03 gibba009 bash[26136]: cluster 2021-03-10T20:59:02.133561+0000 mgr.gibba009.xiladd (mgr.34457) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:04.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:03 gibba009 bash[26136]: audit 2021-03-10T20:59:03.516187+0000 mon.a (mon.0) 952 : audit [DBG] from='client.? 172.21.2.104:0/1963176742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:05.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:04 gibba004 bash[30897]: audit 2021-03-10T20:59:03.029775+0000 mgr.gibba009.xiladd (mgr.34457) 2599 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:05.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:04 gibba004 bash[30897]: audit 2021-03-10T20:59:03.255432+0000 mgr.gibba009.xiladd (mgr.34457) 2600 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:05.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:04 gibba004 bash[31878]: audit 2021-03-10T20:59:03.029775+0000 mgr.gibba009.xiladd (mgr.34457) 2599 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:05.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:04 gibba004 bash[31878]: audit 2021-03-10T20:59:03.255432+0000 mgr.gibba009.xiladd (mgr.34457) 2600 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:05.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:04 gibba009 bash[26136]: audit 2021-03-10T20:59:03.029775+0000 mgr.gibba009.xiladd (mgr.34457) 2599 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:05.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:04 gibba009 bash[26136]: audit 2021-03-10T20:59:03.255432+0000 mgr.gibba009.xiladd (mgr.34457) 2600 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:06.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:05 gibba004 bash[30897]: cluster 2021-03-10T20:59:04.135070+0000 mgr.gibba009.xiladd (mgr.34457) 2601 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:06.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:05 gibba004 bash[31878]: cluster 2021-03-10T20:59:04.135070+0000 mgr.gibba009.xiladd (mgr.34457) 2601 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:05 gibba009 bash[26136]: cluster 2021-03-10T20:59:04.135070+0000 mgr.gibba009.xiladd (mgr.34457) 2601 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:07 gibba004 bash[30897]: cluster 2021-03-10T20:59:06.136856+0000 mgr.gibba009.xiladd (mgr.34457) 2602 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:07 gibba004 bash[30897]: cephadm 2021-03-10T20:59:06.370342+0000 mgr.gibba009.xiladd (mgr.34457) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:07 gibba004 bash[31878]: cluster 2021-03-10T20:59:06.136856+0000 mgr.gibba009.xiladd (mgr.34457) 2602 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:07 gibba004 bash[31878]: cephadm 2021-03-10T20:59:06.370342+0000 mgr.gibba009.xiladd (mgr.34457) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:07 gibba009 bash[26136]: cluster 2021-03-10T20:59:06.136856+0000 mgr.gibba009.xiladd (mgr.34457) 2602 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:07 gibba009 bash[26136]: cephadm 2021-03-10T20:59:06.370342+0000 mgr.gibba009.xiladd (mgr.34457) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:09.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:08 gibba004 bash[30897]: cluster 2021-03-10T20:59:08.138404+0000 mgr.gibba009.xiladd (mgr.34457) 2604 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:09.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:08 gibba004 bash[31878]: cluster 2021-03-10T20:59:08.138404+0000 mgr.gibba009.xiladd (mgr.34457) 2604 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:09.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:08 gibba009 bash[26136]: cluster 2021-03-10T20:59:08.138404+0000 mgr.gibba009.xiladd (mgr.34457) 2604 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:11 gibba004 bash[30897]: cluster 2021-03-10T20:59:10.140210+0000 mgr.gibba009.xiladd (mgr.34457) 2605 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:11 gibba004 bash[31878]: cluster 2021-03-10T20:59:10.140210+0000 mgr.gibba009.xiladd (mgr.34457) 2605 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:11 gibba009 bash[26136]: cluster 2021-03-10T20:59:10.140210+0000 mgr.gibba009.xiladd (mgr.34457) 2605 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:13 gibba004 bash[30897]: cluster 2021-03-10T20:59:12.141731+0000 mgr.gibba009.xiladd (mgr.34457) 2606 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:13 gibba004 bash[31878]: cluster 2021-03-10T20:59:12.141731+0000 mgr.gibba009.xiladd (mgr.34457) 2606 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:13 gibba009 bash[26136]: cluster 2021-03-10T20:59:12.141731+0000 mgr.gibba009.xiladd (mgr.34457) 2606 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:15 gibba004 bash[30897]: cluster 2021-03-10T20:59:14.143175+0000 mgr.gibba009.xiladd (mgr.34457) 2607 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:15 gibba004 bash[31878]: cluster 2021-03-10T20:59:14.143175+0000 mgr.gibba009.xiladd (mgr.34457) 2607 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:15 gibba009 bash[26136]: cluster 2021-03-10T20:59:14.143175+0000 mgr.gibba009.xiladd (mgr.34457) 2607 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:17 gibba004 bash[30897]: cluster 2021-03-10T20:59:16.145172+0000 mgr.gibba009.xiladd (mgr.34457) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:17 gibba004 bash[31878]: cluster 2021-03-10T20:59:16.145172+0000 mgr.gibba009.xiladd (mgr.34457) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:17 gibba009 bash[26136]: cluster 2021-03-10T20:59:16.145172+0000 mgr.gibba009.xiladd (mgr.34457) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:19 gibba004 bash[30897]: cluster 2021-03-10T20:59:18.146715+0000 mgr.gibba009.xiladd (mgr.34457) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:19 gibba004 bash[31878]: cluster 2021-03-10T20:59:18.146715+0000 mgr.gibba009.xiladd (mgr.34457) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:19 gibba009 bash[26136]: cluster 2021-03-10T20:59:18.146715+0000 mgr.gibba009.xiladd (mgr.34457) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:21 gibba004 bash[30897]: cluster 2021-03-10T20:59:20.148419+0000 mgr.gibba009.xiladd (mgr.34457) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:21 gibba004 bash[31878]: cluster 2021-03-10T20:59:20.148419+0000 mgr.gibba009.xiladd (mgr.34457) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:21 gibba009 bash[26136]: cluster 2021-03-10T20:59:20.148419+0000 mgr.gibba009.xiladd (mgr.34457) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:23.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:22 gibba004 bash[30897]: cephadm 2021-03-10T20:59:21.386406+0000 mgr.gibba009.xiladd (mgr.34457) 2611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:23.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:22 gibba004 bash[31878]: cephadm 2021-03-10T20:59:21.386406+0000 mgr.gibba009.xiladd (mgr.34457) 2611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:23.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:22 gibba009 bash[26136]: cephadm 2021-03-10T20:59:21.386406+0000 mgr.gibba009.xiladd (mgr.34457) 2611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:23 gibba004 bash[30897]: cluster 2021-03-10T20:59:22.150239+0000 mgr.gibba009.xiladd (mgr.34457) 2612 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:23 gibba004 bash[31878]: cluster 2021-03-10T20:59:22.150239+0000 mgr.gibba009.xiladd (mgr.34457) 2612 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:23 gibba009 bash[26136]: cluster 2021-03-10T20:59:22.150239+0000 mgr.gibba009.xiladd (mgr.34457) 2612 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:25 gibba004 bash[30897]: cluster 2021-03-10T20:59:24.150827+0000 mgr.gibba009.xiladd (mgr.34457) 2613 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:25 gibba004 bash[31878]: cluster 2021-03-10T20:59:24.150827+0000 mgr.gibba009.xiladd (mgr.34457) 2613 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:25 gibba009 bash[26136]: cluster 2021-03-10T20:59:24.150827+0000 mgr.gibba009.xiladd (mgr.34457) 2613 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:27 gibba004 bash[30897]: cluster 2021-03-10T20:59:26.152710+0000 mgr.gibba009.xiladd (mgr.34457) 2614 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:27 gibba004 bash[31878]: cluster 2021-03-10T20:59:26.152710+0000 mgr.gibba009.xiladd (mgr.34457) 2614 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:27 gibba009 bash[26136]: cluster 2021-03-10T20:59:26.152710+0000 mgr.gibba009.xiladd (mgr.34457) 2614 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:29 gibba004 bash[30897]: cluster 2021-03-10T20:59:28.154441+0000 mgr.gibba009.xiladd (mgr.34457) 2615 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:30.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:29 gibba004 bash[31878]: cluster 2021-03-10T20:59:28.154441+0000 mgr.gibba009.xiladd (mgr.34457) 2615 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:29 gibba009 bash[26136]: cluster 2021-03-10T20:59:28.154441+0000 mgr.gibba009.xiladd (mgr.34457) 2615 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:31 gibba004 bash[30897]: cluster 2021-03-10T20:59:30.156245+0000 mgr.gibba009.xiladd (mgr.34457) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:31 gibba004 bash[31878]: cluster 2021-03-10T20:59:30.156245+0000 mgr.gibba009.xiladd (mgr.34457) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:31 gibba009 bash[26136]: cluster 2021-03-10T20:59:30.156245+0000 mgr.gibba009.xiladd (mgr.34457) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:33.760 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T20:59:33.985 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:59:33.985 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (48m) 4m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T20:59:33.985 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T20:59:33.985 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T20:59:33.986 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (49m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T20:59:33.986 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T20:59:33.986 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T20:59:33.986 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T20:59:33.987 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T20:59:33.987 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T20:59:33.987 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (54m) 2m ago 54m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T20:59:33.987 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T20:59:33.988 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T20:59:33.988 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T20:59:33.988 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T20:59:33.988 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T20:59:33.988 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T20:59:33.989 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T20:59:33.989 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T20:59:33.989 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (53m) 2m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T20:59:33.989 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:33.989 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:34.235 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T20:59:34.235 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T20:59:34.235 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:34.236 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:34.236 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T20:59:34.236 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:34.236 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:34.236 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T20:59:34.237 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:59:34.237 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T20:59:34.237 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T20:59:34.237 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T20:59:34.238 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:59:34.238 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T20:59:34.238 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T20:59:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:33 gibba004 bash[30897]: cluster 2021-03-10T20:59:32.158039+0000 mgr.gibba009.xiladd (mgr.34457) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:34.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:33 gibba004 bash[31878]: cluster 2021-03-10T20:59:32.158039+0000 mgr.gibba009.xiladd (mgr.34457) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:33 gibba009 bash[26136]: cluster 2021-03-10T20:59:32.158039+0000 mgr.gibba009.xiladd (mgr.34457) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[30897]: audit 2021-03-10T20:59:33.747699+0000 mgr.gibba009.xiladd (mgr.34457) 2618 : audit [DBG] from='client.55801 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.551 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[30897]: audit 2021-03-10T20:59:33.972416+0000 mgr.gibba009.xiladd (mgr.34457) 2619 : audit [DBG] from='client.55807 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.552 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[30897]: cluster 2021-03-10T20:59:34.158588+0000 mgr.gibba009.xiladd (mgr.34457) 2620 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.552 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[30897]: audit 2021-03-10T20:59:34.232434+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.2.104:0/2152718714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:35.552 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[31878]: audit 2021-03-10T20:59:33.747699+0000 mgr.gibba009.xiladd (mgr.34457) 2618 : audit [DBG] from='client.55801 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.552 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[31878]: audit 2021-03-10T20:59:33.972416+0000 mgr.gibba009.xiladd (mgr.34457) 2619 : audit [DBG] from='client.55807 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.553 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[31878]: cluster 2021-03-10T20:59:34.158588+0000 mgr.gibba009.xiladd (mgr.34457) 2620 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.553 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:34 gibba004 bash[31878]: audit 2021-03-10T20:59:34.232434+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.2.104:0/2152718714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:35.554 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:34 gibba009 bash[26136]: audit 2021-03-10T20:59:33.747699+0000 mgr.gibba009.xiladd (mgr.34457) 2618 : audit [DBG] from='client.55801 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.554 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:34 gibba009 bash[26136]: audit 2021-03-10T20:59:33.972416+0000 mgr.gibba009.xiladd (mgr.34457) 2619 : audit [DBG] from='client.55807 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:35.554 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:34 gibba009 bash[26136]: cluster 2021-03-10T20:59:34.158588+0000 mgr.gibba009.xiladd (mgr.34457) 2620 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.554 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:34 gibba009 bash[26136]: audit 2021-03-10T20:59:34.232434+0000 mon.a (mon.0) 953 : audit [DBG] from='client.? 172.21.2.104:0/2152718714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cluster 2021-03-10T20:59:36.160330+0000 mgr.gibba009.xiladd (mgr.34457) 2621 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:37.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.395009+0000 mon.c (mon.1) 776 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.399442+0000 mgr.gibba009.xiladd (mgr.34457) 2622 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:59:37.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.401305+0000 mgr.gibba009.xiladd (mgr.34457) 2623 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:59:37.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.628728+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:59:37.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.631337+0000 mgr.gibba009.xiladd (mgr.34457) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:37.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.633003+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.633419+0000 mgr.gibba009.xiladd (mgr.34457) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:37.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.634560+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.634708+0000 mgr.gibba009.xiladd (mgr.34457) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:37.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.634750+0000 mgr.gibba009.xiladd (mgr.34457) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:37.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.636168+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.636422+0000 mgr.gibba009.xiladd (mgr.34457) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:37.574 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.636459+0000 mgr.gibba009.xiladd (mgr.34457) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:37.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.637687+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.638201+0000 mgr.gibba009.xiladd (mgr.34457) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:37.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.640425+0000 mgr.gibba009.xiladd (mgr.34457) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:37.575 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.640466+0000 mgr.gibba009.xiladd (mgr.34457) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:37.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.641800+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.576 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.641943+0000 mgr.gibba009.xiladd (mgr.34457) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:37.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cluster 2021-03-10T20:59:36.160330+0000 mgr.gibba009.xiladd (mgr.34457) 2621 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:37.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.395009+0000 mon.c (mon.1) 776 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.399442+0000 mgr.gibba009.xiladd (mgr.34457) 2622 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:59:37.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.401305+0000 mgr.gibba009.xiladd (mgr.34457) 2623 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:59:37.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.628728+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:59:37.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.631337+0000 mgr.gibba009.xiladd (mgr.34457) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:37.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.633003+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.633419+0000 mgr.gibba009.xiladd (mgr.34457) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:37.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.634560+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.634708+0000 mgr.gibba009.xiladd (mgr.34457) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:37.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.634750+0000 mgr.gibba009.xiladd (mgr.34457) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:37.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.636168+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.636422+0000 mgr.gibba009.xiladd (mgr.34457) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:37.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.636459+0000 mgr.gibba009.xiladd (mgr.34457) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:37.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.637687+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.638201+0000 mgr.gibba009.xiladd (mgr.34457) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:37.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.640425+0000 mgr.gibba009.xiladd (mgr.34457) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:37.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.640466+0000 mgr.gibba009.xiladd (mgr.34457) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:37.581 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.641800+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.581 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.641943+0000 mgr.gibba009.xiladd (mgr.34457) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:37.581 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.642399+0000 mgr.gibba009.xiladd (mgr.34457) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:37.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: audit 2021-03-10T20:59:36.643625+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.643957+0000 mgr.gibba009.xiladd (mgr.34457) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:37.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.644004+0000 mgr.gibba009.xiladd (mgr.34457) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:37.582 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[30897]: cephadm 2021-03-10T20:59:36.644163+0000 mgr.gibba009.xiladd (mgr.34457) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:37.583 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.642399+0000 mgr.gibba009.xiladd (mgr.34457) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:37.583 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: audit 2021-03-10T20:59:36.643625+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.583 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.643957+0000 mgr.gibba009.xiladd (mgr.34457) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:37.584 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.644004+0000 mgr.gibba009.xiladd (mgr.34457) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:37.584 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:37 gibba004 bash[31878]: cephadm 2021-03-10T20:59:36.644163+0000 mgr.gibba009.xiladd (mgr.34457) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:37.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cluster 2021-03-10T20:59:36.160330+0000 mgr.gibba009.xiladd (mgr.34457) 2621 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:37.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.395009+0000 mon.c (mon.1) 776 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.399442+0000 mgr.gibba009.xiladd (mgr.34457) 2622 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T20:59:37.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.401305+0000 mgr.gibba009.xiladd (mgr.34457) 2623 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T20:59:37.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.628728+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T20:59:37.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.631337+0000 mgr.gibba009.xiladd (mgr.34457) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:37.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.633003+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:37.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.633419+0000 mgr.gibba009.xiladd (mgr.34457) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:37.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.634560+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.634708+0000 mgr.gibba009.xiladd (mgr.34457) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:37.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.634750+0000 mgr.gibba009.xiladd (mgr.34457) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:37.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.636168+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.636422+0000 mgr.gibba009.xiladd (mgr.34457) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:37.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.636459+0000 mgr.gibba009.xiladd (mgr.34457) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:37.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.637687+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.638201+0000 mgr.gibba009.xiladd (mgr.34457) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:37.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.640425+0000 mgr.gibba009.xiladd (mgr.34457) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:37.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.640466+0000 mgr.gibba009.xiladd (mgr.34457) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:37.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.641800+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.641943+0000 mgr.gibba009.xiladd (mgr.34457) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:37.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.642399+0000 mgr.gibba009.xiladd (mgr.34457) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:37.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: audit 2021-03-10T20:59:36.643625+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:37.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.643957+0000 mgr.gibba009.xiladd (mgr.34457) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:37.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.644004+0000 mgr.gibba009.xiladd (mgr.34457) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:37.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:37 gibba009 bash[26136]: cephadm 2021-03-10T20:59:36.644163+0000 mgr.gibba009.xiladd (mgr.34457) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:39.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:39 gibba004 bash[30897]: cluster 2021-03-10T20:59:38.161757+0000 mgr.gibba009.xiladd (mgr.34457) 2638 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:39.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:39 gibba004 bash[31878]: cluster 2021-03-10T20:59:38.161757+0000 mgr.gibba009.xiladd (mgr.34457) 2638 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:39.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:39 gibba009 bash[26136]: cluster 2021-03-10T20:59:38.161757+0000 mgr.gibba009.xiladd (mgr.34457) 2638 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.874009+0000 mon.c (mon.1) 783 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.874244+0000 mon.c (mon.1) 784 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.874403+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.874592+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.888851+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889035+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889211+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889363+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889381+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889610+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.889849+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[30897]: audit 2021-03-10T20:59:39.890032+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.874009+0000 mon.c (mon.1) 783 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.874244+0000 mon.c (mon.1) 784 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.874403+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.874592+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.888851+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889035+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889211+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889363+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889381+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889610+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.889849+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:40 gibba004 bash[31878]: audit 2021-03-10T20:59:39.890032+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.874009+0000 mon.c (mon.1) 783 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.874244+0000 mon.c (mon.1) 784 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.874403+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:41.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.874592+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:41.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.888851+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889035+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889211+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889363+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:41.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889381+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889610+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:59:41.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.889849+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:59:41.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:40 gibba009 bash[26136]: audit 2021-03-10T20:59:39.890032+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:42.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:41 gibba004 bash[30897]: cluster 2021-03-10T20:59:40.163541+0000 mgr.gibba009.xiladd (mgr.34457) 2639 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:42.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:41 gibba004 bash[31878]: cluster 2021-03-10T20:59:40.163541+0000 mgr.gibba009.xiladd (mgr.34457) 2639 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:42.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:41 gibba009 bash[26136]: cluster 2021-03-10T20:59:40.163541+0000 mgr.gibba009.xiladd (mgr.34457) 2639 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:44.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:43 gibba004 bash[30897]: cluster 2021-03-10T20:59:42.165090+0000 mgr.gibba009.xiladd (mgr.34457) 2640 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:44.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:43 gibba004 bash[31878]: cluster 2021-03-10T20:59:42.165090+0000 mgr.gibba009.xiladd (mgr.34457) 2640 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:43 gibba009 bash[26136]: cluster 2021-03-10T20:59:42.165090+0000 mgr.gibba009.xiladd (mgr.34457) 2640 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:45 gibba004 bash[30897]: cluster 2021-03-10T20:59:44.165743+0000 mgr.gibba009.xiladd (mgr.34457) 2641 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:45 gibba004 bash[31878]: cluster 2021-03-10T20:59:44.165743+0000 mgr.gibba009.xiladd (mgr.34457) 2641 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:45 gibba009 bash[26136]: cluster 2021-03-10T20:59:44.165743+0000 mgr.gibba009.xiladd (mgr.34457) 2641 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:47 gibba004 bash[30897]: cluster 2021-03-10T20:59:46.167452+0000 mgr.gibba009.xiladd (mgr.34457) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:47 gibba004 bash[31878]: cluster 2021-03-10T20:59:46.167452+0000 mgr.gibba009.xiladd (mgr.34457) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:47 gibba009 bash[26136]: cluster 2021-03-10T20:59:46.167452+0000 mgr.gibba009.xiladd (mgr.34457) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:49 gibba004 bash[30897]: cluster 2021-03-10T20:59:48.168873+0000 mgr.gibba009.xiladd (mgr.34457) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:49 gibba004 bash[31878]: cluster 2021-03-10T20:59:48.168873+0000 mgr.gibba009.xiladd (mgr.34457) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:49 gibba009 bash[26136]: cluster 2021-03-10T20:59:48.168873+0000 mgr.gibba009.xiladd (mgr.34457) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:51 gibba004 bash[30897]: cluster 2021-03-10T20:59:50.172395+0000 mgr.gibba009.xiladd (mgr.34457) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:51 gibba004 bash[31878]: cluster 2021-03-10T20:59:50.172395+0000 mgr.gibba009.xiladd (mgr.34457) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:51 gibba009 bash[26136]: cluster 2021-03-10T20:59:50.172395+0000 mgr.gibba009.xiladd (mgr.34457) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:53.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:52 gibba004 bash[30897]: cephadm 2021-03-10T20:59:51.645104+0000 mgr.gibba009.xiladd (mgr.34457) 2645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:53.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:52 gibba004 bash[31878]: cephadm 2021-03-10T20:59:51.645104+0000 mgr.gibba009.xiladd (mgr.34457) 2645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:53.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:52 gibba009 bash[26136]: cephadm 2021-03-10T20:59:51.645104+0000 mgr.gibba009.xiladd (mgr.34457) 2645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T20:59:54.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:53 gibba004 bash[30897]: cluster 2021-03-10T20:59:52.173772+0000 mgr.gibba009.xiladd (mgr.34457) 2646 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:54.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:53 gibba004 bash[31878]: cluster 2021-03-10T20:59:52.173772+0000 mgr.gibba009.xiladd (mgr.34457) 2646 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:53 gibba009 bash[26136]: cluster 2021-03-10T20:59:52.173772+0000 mgr.gibba009.xiladd (mgr.34457) 2646 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:55 gibba004 bash[30897]: cluster 2021-03-10T20:59:54.174286+0000 mgr.gibba009.xiladd (mgr.34457) 2647 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:55 gibba004 bash[31878]: cluster 2021-03-10T20:59:54.174286+0000 mgr.gibba009.xiladd (mgr.34457) 2647 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:55 gibba009 bash[26136]: cluster 2021-03-10T20:59:54.174286+0000 mgr.gibba009.xiladd (mgr.34457) 2647 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:57 gibba004 bash[30897]: cluster 2021-03-10T20:59:56.175888+0000 mgr.gibba009.xiladd (mgr.34457) 2648 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:57 gibba004 bash[31878]: cluster 2021-03-10T20:59:56.175888+0000 mgr.gibba009.xiladd (mgr.34457) 2648 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:57 gibba009 bash[26136]: cluster 2021-03-10T20:59:56.175888+0000 mgr.gibba009.xiladd (mgr.34457) 2648 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 20:59:59 gibba004 bash[30897]: cluster 2021-03-10T20:59:58.177439+0000 mgr.gibba009.xiladd (mgr.34457) 2649 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:00 gibba004 bash[30897]: debug 2021-03-10T20:59:59.997+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 20:59:59 gibba004 bash[31878]: cluster 2021-03-10T20:59:58.177439+0000 mgr.gibba009.xiladd (mgr.34457) 2649 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 20:59:59 gibba009 bash[26136]: cluster 2021-03-10T20:59:58.177439+0000 mgr.gibba009.xiladd (mgr.34457) 2649 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:01.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:00 gibba004 bash[30897]: cluster 2021-03-10T21:00:00.000212+0000 mon.a (mon.0) 961 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:01.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:00 gibba004 bash[31878]: cluster 2021-03-10T21:00:00.000212+0000 mon.a (mon.0) 961 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:01.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:00 gibba009 bash[26136]: cluster 2021-03-10T21:00:00.000212+0000 mon.a (mon.0) 961 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:01 gibba004 bash[30897]: cluster 2021-03-10T21:00:00.178241+0000 mgr.gibba009.xiladd (mgr.34457) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:02.348 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:01 gibba004 bash[31878]: cluster 2021-03-10T21:00:00.178241+0000 mgr.gibba009.xiladd (mgr.34457) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:02.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:01 gibba009 bash[26136]: cluster 2021-03-10T21:00:00.178241+0000 mgr.gibba009.xiladd (mgr.34457) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:03.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:02 gibba004 bash[30897]: cluster 2021-03-10T21:00:02.179693+0000 mgr.gibba009.xiladd (mgr.34457) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:03.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:02 gibba004 bash[31878]: cluster 2021-03-10T21:00:02.179693+0000 mgr.gibba009.xiladd (mgr.34457) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:03.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:02 gibba009 bash[26136]: cluster 2021-03-10T21:00:02.179693+0000 mgr.gibba009.xiladd (mgr.34457) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:04.479 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:00:04.736 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:00:04.736 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (48m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:00:04.737 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:00:04.737 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:00:04.737 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:00:04.737 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:00:04.738 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:00:04.738 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:00:04.738 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:00:04.738 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:00:04.739 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:00:04.739 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:00:04.739 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:00:04.739 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:00:04.739 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:00:04.740 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:00:04.740 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:00:04.740 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:00:04.740 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (44m) 3m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:00:04.741 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (53m) 3m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:00:04.741 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:04.742 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:04.987 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:00:04.987 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:00:04.987 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:04.988 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:04.988 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:00:04.988 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:04.988 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:04.988 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:00:04.989 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:00:04.989 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:04.989 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:00:04.989 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:00:04.990 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:00:04.990 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:00:04.990 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:00:06.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[30897]: cluster 2021-03-10T21:00:04.181003+0000 mgr.gibba009.xiladd (mgr.34457) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[30897]: audit 2021-03-10T21:00:04.466250+0000 mgr.gibba009.xiladd (mgr.34457) 2653 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[30897]: audit 2021-03-10T21:00:04.690940+0000 mgr.gibba009.xiladd (mgr.34457) 2654 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[30897]: audit 2021-03-10T21:00:04.984291+0000 mon.c (mon.1) 789 : audit [DBG] from='client.? 172.21.2.104:0/2087034437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:06.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[31878]: cluster 2021-03-10T21:00:04.181003+0000 mgr.gibba009.xiladd (mgr.34457) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:06.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[31878]: audit 2021-03-10T21:00:04.466250+0000 mgr.gibba009.xiladd (mgr.34457) 2653 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[31878]: audit 2021-03-10T21:00:04.690940+0000 mgr.gibba009.xiladd (mgr.34457) 2654 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:05 gibba004 bash[31878]: audit 2021-03-10T21:00:04.984291+0000 mon.c (mon.1) 789 : audit [DBG] from='client.? 172.21.2.104:0/2087034437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:05 gibba009 bash[26136]: cluster 2021-03-10T21:00:04.181003+0000 mgr.gibba009.xiladd (mgr.34457) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:06.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:05 gibba009 bash[26136]: audit 2021-03-10T21:00:04.466250+0000 mgr.gibba009.xiladd (mgr.34457) 2653 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:05 gibba009 bash[26136]: audit 2021-03-10T21:00:04.690940+0000 mgr.gibba009.xiladd (mgr.34457) 2654 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:06.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:05 gibba009 bash[26136]: audit 2021-03-10T21:00:04.984291+0000 mon.c (mon.1) 789 : audit [DBG] from='client.? 172.21.2.104:0/2087034437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:07 gibba004 bash[30897]: cluster 2021-03-10T21:00:06.182861+0000 mgr.gibba009.xiladd (mgr.34457) 2655 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:07 gibba004 bash[30897]: cephadm 2021-03-10T21:00:06.661276+0000 mgr.gibba009.xiladd (mgr.34457) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:07 gibba004 bash[31878]: cluster 2021-03-10T21:00:06.182861+0000 mgr.gibba009.xiladd (mgr.34457) 2655 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:07 gibba004 bash[31878]: cephadm 2021-03-10T21:00:06.661276+0000 mgr.gibba009.xiladd (mgr.34457) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:07 gibba009 bash[26136]: cluster 2021-03-10T21:00:06.182861+0000 mgr.gibba009.xiladd (mgr.34457) 2655 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:07 gibba009 bash[26136]: cephadm 2021-03-10T21:00:06.661276+0000 mgr.gibba009.xiladd (mgr.34457) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:09 gibba004 bash[30897]: cluster 2021-03-10T21:00:08.184368+0000 mgr.gibba009.xiladd (mgr.34457) 2657 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:10.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:09 gibba004 bash[31878]: cluster 2021-03-10T21:00:08.184368+0000 mgr.gibba009.xiladd (mgr.34457) 2657 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:09 gibba009 bash[26136]: cluster 2021-03-10T21:00:08.184368+0000 mgr.gibba009.xiladd (mgr.34457) 2657 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:12.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:11 gibba004 bash[30897]: cluster 2021-03-10T21:00:10.185273+0000 mgr.gibba009.xiladd (mgr.34457) 2658 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:12.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:11 gibba004 bash[31878]: cluster 2021-03-10T21:00:10.185273+0000 mgr.gibba009.xiladd (mgr.34457) 2658 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:11 gibba009 bash[26136]: cluster 2021-03-10T21:00:10.185273+0000 mgr.gibba009.xiladd (mgr.34457) 2658 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:14.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:13 gibba004 bash[30897]: cluster 2021-03-10T21:00:12.186721+0000 mgr.gibba009.xiladd (mgr.34457) 2659 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:14.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:13 gibba004 bash[31878]: cluster 2021-03-10T21:00:12.186721+0000 mgr.gibba009.xiladd (mgr.34457) 2659 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:14.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:13 gibba009 bash[26136]: cluster 2021-03-10T21:00:12.186721+0000 mgr.gibba009.xiladd (mgr.34457) 2659 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:16.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:15 gibba004 bash[30897]: cluster 2021-03-10T21:00:14.187988+0000 mgr.gibba009.xiladd (mgr.34457) 2660 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:16.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:15 gibba004 bash[31878]: cluster 2021-03-10T21:00:14.187988+0000 mgr.gibba009.xiladd (mgr.34457) 2660 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:15 gibba009 bash[26136]: cluster 2021-03-10T21:00:14.187988+0000 mgr.gibba009.xiladd (mgr.34457) 2660 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:17 gibba004 bash[30897]: cluster 2021-03-10T21:00:16.189995+0000 mgr.gibba009.xiladd (mgr.34457) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:17 gibba004 bash[31878]: cluster 2021-03-10T21:00:16.189995+0000 mgr.gibba009.xiladd (mgr.34457) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:17 gibba009 bash[26136]: cluster 2021-03-10T21:00:16.189995+0000 mgr.gibba009.xiladd (mgr.34457) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:19 gibba004 bash[30897]: cluster 2021-03-10T21:00:18.191525+0000 mgr.gibba009.xiladd (mgr.34457) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:20.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:19 gibba004 bash[31878]: cluster 2021-03-10T21:00:18.191525+0000 mgr.gibba009.xiladd (mgr.34457) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:19 gibba009 bash[26136]: cluster 2021-03-10T21:00:18.191525+0000 mgr.gibba009.xiladd (mgr.34457) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:21 gibba004 bash[30897]: cluster 2021-03-10T21:00:20.192221+0000 mgr.gibba009.xiladd (mgr.34457) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:22.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:21 gibba004 bash[31878]: cluster 2021-03-10T21:00:20.192221+0000 mgr.gibba009.xiladd (mgr.34457) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:21 gibba009 bash[26136]: cluster 2021-03-10T21:00:20.192221+0000 mgr.gibba009.xiladd (mgr.34457) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:23.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:22 gibba004 bash[30897]: cephadm 2021-03-10T21:00:21.671581+0000 mgr.gibba009.xiladd (mgr.34457) 2664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:23.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:22 gibba004 bash[31878]: cephadm 2021-03-10T21:00:21.671581+0000 mgr.gibba009.xiladd (mgr.34457) 2664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:23.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:22 gibba009 bash[26136]: cephadm 2021-03-10T21:00:21.671581+0000 mgr.gibba009.xiladd (mgr.34457) 2664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:23 gibba004 bash[30897]: cluster 2021-03-10T21:00:22.193742+0000 mgr.gibba009.xiladd (mgr.34457) 2665 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:24.684 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:23 gibba004 bash[31878]: cluster 2021-03-10T21:00:22.193742+0000 mgr.gibba009.xiladd (mgr.34457) 2665 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:24.685 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:23 gibba009 bash[26136]: cluster 2021-03-10T21:00:22.193742+0000 mgr.gibba009.xiladd (mgr.34457) 2665 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:25 gibba004 bash[30897]: cluster 2021-03-10T21:00:24.194781+0000 mgr.gibba009.xiladd (mgr.34457) 2666 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:25 gibba004 bash[31878]: cluster 2021-03-10T21:00:24.194781+0000 mgr.gibba009.xiladd (mgr.34457) 2666 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:25 gibba009 bash[26136]: cluster 2021-03-10T21:00:24.194781+0000 mgr.gibba009.xiladd (mgr.34457) 2666 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:27 gibba004 bash[30897]: cluster 2021-03-10T21:00:26.196721+0000 mgr.gibba009.xiladd (mgr.34457) 2667 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:27 gibba004 bash[31878]: cluster 2021-03-10T21:00:26.196721+0000 mgr.gibba009.xiladd (mgr.34457) 2667 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:28.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:27 gibba009 bash[26136]: cluster 2021-03-10T21:00:26.196721+0000 mgr.gibba009.xiladd (mgr.34457) 2667 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:29.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:29 gibba004 bash[30897]: cluster 2021-03-10T21:00:28.198226+0000 mgr.gibba009.xiladd (mgr.34457) 2668 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:29.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:29 gibba004 bash[31878]: cluster 2021-03-10T21:00:28.198226+0000 mgr.gibba009.xiladd (mgr.34457) 2668 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:29.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:29 gibba009 bash[26136]: cluster 2021-03-10T21:00:28.198226+0000 mgr.gibba009.xiladd (mgr.34457) 2668 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:31 gibba004 bash[30897]: cluster 2021-03-10T21:00:30.199200+0000 mgr.gibba009.xiladd (mgr.34457) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:31 gibba004 bash[31878]: cluster 2021-03-10T21:00:30.199200+0000 mgr.gibba009.xiladd (mgr.34457) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:31 gibba009 bash[26136]: cluster 2021-03-10T21:00:30.199200+0000 mgr.gibba009.xiladd (mgr.34457) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:33 gibba004 bash[30897]: cluster 2021-03-10T21:00:32.200842+0000 mgr.gibba009.xiladd (mgr.34457) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:33 gibba004 bash[31878]: cluster 2021-03-10T21:00:32.200842+0000 mgr.gibba009.xiladd (mgr.34457) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:33 gibba009 bash[26136]: cluster 2021-03-10T21:00:32.200842+0000 mgr.gibba009.xiladd (mgr.34457) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:35.232 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:00:35.495 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:00:35.496 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (49m) 5m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:00:35.496 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (54m) 4m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:00:35.496 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (49m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:00:35.496 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:00:35.497 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:00:35.497 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:00:35.497 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:00:35.497 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:00:35.498 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:00:35.498 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:00:35.498 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:00:35.498 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:00:35.498 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:00:35.499 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:00:35.499 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:00:35.499 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:00:35.499 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:00:35.500 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (44m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:00:35.500 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (54m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:00:35.500 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:35.500 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:35.747 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:00:35.747 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:00:35.747 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:35.747 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:35.748 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:00:35.748 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:35.748 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:35.748 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:00:35.749 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:00:35.749 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:00:35.749 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:00:35.749 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:00:35.749 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:00:35.750 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:00:35.750 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:00:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:35 gibba004 bash[30897]: cluster 2021-03-10T21:00:34.201506+0000 mgr.gibba009.xiladd (mgr.34457) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:35 gibba004 bash[30897]: audit 2021-03-10T21:00:35.744166+0000 mon.c (mon.1) 790 : audit [DBG] from='client.? 172.21.2.104:0/1149703264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:35 gibba004 bash[31878]: cluster 2021-03-10T21:00:34.201506+0000 mgr.gibba009.xiladd (mgr.34457) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:35 gibba004 bash[31878]: audit 2021-03-10T21:00:35.744166+0000 mon.c (mon.1) 790 : audit [DBG] from='client.? 172.21.2.104:0/1149703264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:35 gibba009 bash[26136]: cluster 2021-03-10T21:00:34.201506+0000 mgr.gibba009.xiladd (mgr.34457) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:35 gibba009 bash[26136]: audit 2021-03-10T21:00:35.744166+0000 mon.c (mon.1) 790 : audit [DBG] from='client.? 172.21.2.104:0/1149703264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:37.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[30897]: audit 2021-03-10T21:00:35.220828+0000 mgr.gibba009.xiladd (mgr.34457) 2672 : audit [DBG] from='client.45858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[30897]: audit 2021-03-10T21:00:35.450313+0000 mgr.gibba009.xiladd (mgr.34457) 2673 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[30897]: audit 2021-03-10T21:00:36.689272+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:37.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[31878]: audit 2021-03-10T21:00:35.220828+0000 mgr.gibba009.xiladd (mgr.34457) 2672 : audit [DBG] from='client.45858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[31878]: audit 2021-03-10T21:00:35.450313+0000 mgr.gibba009.xiladd (mgr.34457) 2673 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:36 gibba004 bash[31878]: audit 2021-03-10T21:00:36.689272+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:37.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:36 gibba009 bash[26136]: audit 2021-03-10T21:00:35.220828+0000 mgr.gibba009.xiladd (mgr.34457) 2672 : audit [DBG] from='client.45858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:36 gibba009 bash[26136]: audit 2021-03-10T21:00:35.450313+0000 mgr.gibba009.xiladd (mgr.34457) 2673 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:37.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:36 gibba009 bash[26136]: audit 2021-03-10T21:00:36.689272+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cluster 2021-03-10T21:00:36.203290+0000 mgr.gibba009.xiladd (mgr.34457) 2674 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.693778+0000 mgr.gibba009.xiladd (mgr.34457) 2675 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:00:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.695542+0000 mgr.gibba009.xiladd (mgr.34457) 2676 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:00:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.924388+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:00:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.926713+0000 mgr.gibba009.xiladd (mgr.34457) 2677 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.928108+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.928593+0000 mgr.gibba009.xiladd (mgr.34457) 2678 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:38.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.929815+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.929978+0000 mgr.gibba009.xiladd (mgr.34457) 2679 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:38.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.930018+0000 mgr.gibba009.xiladd (mgr.34457) 2680 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:38.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.931222+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.931636+0000 mgr.gibba009.xiladd (mgr.34457) 2681 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:38.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.931701+0000 mgr.gibba009.xiladd (mgr.34457) 2682 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:38.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.932791+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.933151+0000 mgr.gibba009.xiladd (mgr.34457) 2683 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:38.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.934804+0000 mgr.gibba009.xiladd (mgr.34457) 2684 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:38.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.934845+0000 mgr.gibba009.xiladd (mgr.34457) 2685 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:38.326 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.936173+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.936348+0000 mgr.gibba009.xiladd (mgr.34457) 2686 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:38.327 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.936716+0000 mgr.gibba009.xiladd (mgr.34457) 2687 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:38.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cluster 2021-03-10T21:00:36.203290+0000 mgr.gibba009.xiladd (mgr.34457) 2674 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.693778+0000 mgr.gibba009.xiladd (mgr.34457) 2675 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:00:38.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.695542+0000 mgr.gibba009.xiladd (mgr.34457) 2676 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:00:38.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.924388+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:00:38.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.926713+0000 mgr.gibba009.xiladd (mgr.34457) 2677 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:38.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.928108+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:38.332 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.928593+0000 mgr.gibba009.xiladd (mgr.34457) 2678 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:38.332 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.929815+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.332 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.929978+0000 mgr.gibba009.xiladd (mgr.34457) 2679 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:38.334 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.930018+0000 mgr.gibba009.xiladd (mgr.34457) 2680 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:38.334 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.931222+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.931636+0000 mgr.gibba009.xiladd (mgr.34457) 2681 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:38.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.931701+0000 mgr.gibba009.xiladd (mgr.34457) 2682 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:38.335 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.932791+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.933151+0000 mgr.gibba009.xiladd (mgr.34457) 2683 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:38.336 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.934804+0000 mgr.gibba009.xiladd (mgr.34457) 2684 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:38.337 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.934845+0000 mgr.gibba009.xiladd (mgr.34457) 2685 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:38.337 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.936173+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.338 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.936348+0000 mgr.gibba009.xiladd (mgr.34457) 2686 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:38.338 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.936716+0000 mgr.gibba009.xiladd (mgr.34457) 2687 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:38.339 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: audit 2021-03-10T21:00:36.937837+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.339 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.938366+0000 mgr.gibba009.xiladd (mgr.34457) 2688 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:38.340 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.938415+0000 mgr.gibba009.xiladd (mgr.34457) 2689 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:38.340 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[30897]: cephadm 2021-03-10T21:00:36.938567+0000 mgr.gibba009.xiladd (mgr.34457) 2690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:38.341 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: audit 2021-03-10T21:00:36.937837+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.342 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.938366+0000 mgr.gibba009.xiladd (mgr.34457) 2688 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:38.343 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.938415+0000 mgr.gibba009.xiladd (mgr.34457) 2689 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:38.343 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:37 gibba004 bash[31878]: cephadm 2021-03-10T21:00:36.938567+0000 mgr.gibba009.xiladd (mgr.34457) 2690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:38.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cluster 2021-03-10T21:00:36.203290+0000 mgr.gibba009.xiladd (mgr.34457) 2674 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.693778+0000 mgr.gibba009.xiladd (mgr.34457) 2675 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:00:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.695542+0000 mgr.gibba009.xiladd (mgr.34457) 2676 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:00:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.924388+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:00:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.926713+0000 mgr.gibba009.xiladd (mgr.34457) 2677 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:38.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.928108+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.928593+0000 mgr.gibba009.xiladd (mgr.34457) 2678 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.929815+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.929978+0000 mgr.gibba009.xiladd (mgr.34457) 2679 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.930018+0000 mgr.gibba009.xiladd (mgr.34457) 2680 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:38.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.931222+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.931636+0000 mgr.gibba009.xiladd (mgr.34457) 2681 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.931701+0000 mgr.gibba009.xiladd (mgr.34457) 2682 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.932791+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.933151+0000 mgr.gibba009.xiladd (mgr.34457) 2683 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.934804+0000 mgr.gibba009.xiladd (mgr.34457) 2684 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.934845+0000 mgr.gibba009.xiladd (mgr.34457) 2685 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.936173+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.936348+0000 mgr.gibba009.xiladd (mgr.34457) 2686 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:38.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.936716+0000 mgr.gibba009.xiladd (mgr.34457) 2687 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:38.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: audit 2021-03-10T21:00:36.937837+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:38.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.938366+0000 mgr.gibba009.xiladd (mgr.34457) 2688 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:38.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.938415+0000 mgr.gibba009.xiladd (mgr.34457) 2689 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:38.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:37 gibba009 bash[26136]: cephadm 2021-03-10T21:00:36.938567+0000 mgr.gibba009.xiladd (mgr.34457) 2690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: cluster 2021-03-10T21:00:38.204726+0000 mgr.gibba009.xiladd (mgr.34457) 2691 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.882043+0000 mon.c (mon.1) 798 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.882905+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.883145+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.884258+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.896839+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.897048+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.897194+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.897402+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.897856+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.897863+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.898306+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[30897]: audit 2021-03-10T21:00:39.898606+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: cluster 2021-03-10T21:00:38.204726+0000 mgr.gibba009.xiladd (mgr.34457) 2691 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.882043+0000 mon.c (mon.1) 798 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.882905+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.883145+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.884258+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.896839+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.897048+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.897194+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.897402+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.897856+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.897863+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.898306+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:39 gibba004 bash[31878]: audit 2021-03-10T21:00:39.898606+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: cluster 2021-03-10T21:00:38.204726+0000 mgr.gibba009.xiladd (mgr.34457) 2691 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.882043+0000 mon.c (mon.1) 798 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.882905+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.883145+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.884258+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.896839+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.897048+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.897194+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:00:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.897402+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.897856+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.897863+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.898306+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:39 gibba009 bash[26136]: audit 2021-03-10T21:00:39.898606+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:00:42.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:41 gibba004 bash[30897]: cluster 2021-03-10T21:00:40.206505+0000 mgr.gibba009.xiladd (mgr.34457) 2692 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:42.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:41 gibba004 bash[31878]: cluster 2021-03-10T21:00:40.206505+0000 mgr.gibba009.xiladd (mgr.34457) 2692 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:42.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:41 gibba009 bash[26136]: cluster 2021-03-10T21:00:40.206505+0000 mgr.gibba009.xiladd (mgr.34457) 2692 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:44.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:43 gibba004 bash[30897]: cluster 2021-03-10T21:00:42.208101+0000 mgr.gibba009.xiladd (mgr.34457) 2693 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:44.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:43 gibba004 bash[31878]: cluster 2021-03-10T21:00:42.208101+0000 mgr.gibba009.xiladd (mgr.34457) 2693 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:43 gibba009 bash[26136]: cluster 2021-03-10T21:00:42.208101+0000 mgr.gibba009.xiladd (mgr.34457) 2693 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:45 gibba004 bash[30897]: cluster 2021-03-10T21:00:44.209409+0000 mgr.gibba009.xiladd (mgr.34457) 2694 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:45 gibba004 bash[31878]: cluster 2021-03-10T21:00:44.209409+0000 mgr.gibba009.xiladd (mgr.34457) 2694 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:45 gibba009 bash[26136]: cluster 2021-03-10T21:00:44.209409+0000 mgr.gibba009.xiladd (mgr.34457) 2694 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:47 gibba004 bash[30897]: cluster 2021-03-10T21:00:46.210966+0000 mgr.gibba009.xiladd (mgr.34457) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:47 gibba004 bash[31878]: cluster 2021-03-10T21:00:46.210966+0000 mgr.gibba009.xiladd (mgr.34457) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:47 gibba009 bash[26136]: cluster 2021-03-10T21:00:46.210966+0000 mgr.gibba009.xiladd (mgr.34457) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:49 gibba004 bash[30897]: cluster 2021-03-10T21:00:48.212354+0000 mgr.gibba009.xiladd (mgr.34457) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:49 gibba004 bash[31878]: cluster 2021-03-10T21:00:48.212354+0000 mgr.gibba009.xiladd (mgr.34457) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:49 gibba009 bash[26136]: cluster 2021-03-10T21:00:48.212354+0000 mgr.gibba009.xiladd (mgr.34457) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:51 gibba004 bash[30897]: cluster 2021-03-10T21:00:50.213317+0000 mgr.gibba009.xiladd (mgr.34457) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:51 gibba004 bash[31878]: cluster 2021-03-10T21:00:50.213317+0000 mgr.gibba009.xiladd (mgr.34457) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:51 gibba009 bash[26136]: cluster 2021-03-10T21:00:50.213317+0000 mgr.gibba009.xiladd (mgr.34457) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:52 gibba004 bash[30897]: cephadm 2021-03-10T21:00:51.954580+0000 mgr.gibba009.xiladd (mgr.34457) 2698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:52 gibba004 bash[31878]: cephadm 2021-03-10T21:00:51.954580+0000 mgr.gibba009.xiladd (mgr.34457) 2698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:52 gibba009 bash[26136]: cephadm 2021-03-10T21:00:51.954580+0000 mgr.gibba009.xiladd (mgr.34457) 2698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:00:53.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:53 gibba004 bash[30897]: cluster 2021-03-10T21:00:52.214877+0000 mgr.gibba009.xiladd (mgr.34457) 2699 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:53.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:53 gibba004 bash[31878]: cluster 2021-03-10T21:00:52.214877+0000 mgr.gibba009.xiladd (mgr.34457) 2699 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:53.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:53 gibba009 bash[26136]: cluster 2021-03-10T21:00:52.214877+0000 mgr.gibba009.xiladd (mgr.34457) 2699 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:55 gibba004 bash[30897]: cluster 2021-03-10T21:00:54.216279+0000 mgr.gibba009.xiladd (mgr.34457) 2700 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:55 gibba004 bash[31878]: cluster 2021-03-10T21:00:54.216279+0000 mgr.gibba009.xiladd (mgr.34457) 2700 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:55 gibba009 bash[26136]: cluster 2021-03-10T21:00:54.216279+0000 mgr.gibba009.xiladd (mgr.34457) 2700 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:57 gibba004 bash[30897]: cluster 2021-03-10T21:00:56.218223+0000 mgr.gibba009.xiladd (mgr.34457) 2701 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:57 gibba004 bash[31878]: cluster 2021-03-10T21:00:56.218223+0000 mgr.gibba009.xiladd (mgr.34457) 2701 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:57 gibba009 bash[26136]: cluster 2021-03-10T21:00:56.218223+0000 mgr.gibba009.xiladd (mgr.34457) 2701 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:00:59 gibba004 bash[30897]: cluster 2021-03-10T21:00:58.219496+0000 mgr.gibba009.xiladd (mgr.34457) 2702 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:00:59 gibba004 bash[31878]: cluster 2021-03-10T21:00:58.219496+0000 mgr.gibba009.xiladd (mgr.34457) 2702 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:00:59 gibba009 bash[26136]: cluster 2021-03-10T21:00:58.219496+0000 mgr.gibba009.xiladd (mgr.34457) 2702 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:01 gibba004 bash[30897]: cluster 2021-03-10T21:01:00.221289+0000 mgr.gibba009.xiladd (mgr.34457) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:01 gibba004 bash[31878]: cluster 2021-03-10T21:01:00.221289+0000 mgr.gibba009.xiladd (mgr.34457) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:01 gibba009 bash[26136]: cluster 2021-03-10T21:01:00.221289+0000 mgr.gibba009.xiladd (mgr.34457) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:03 gibba004 bash[30897]: cluster 2021-03-10T21:01:02.222914+0000 mgr.gibba009.xiladd (mgr.34457) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:04.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:03 gibba004 bash[31878]: cluster 2021-03-10T21:01:02.222914+0000 mgr.gibba009.xiladd (mgr.34457) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:03 gibba009 bash[26136]: cluster 2021-03-10T21:01:02.222914+0000 mgr.gibba009.xiladd (mgr.34457) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:05.992 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:01:06.221 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:01:06.221 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:01:06.221 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:01:06.222 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:01:06.222 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:01:06.222 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:01:06.222 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:01:06.223 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:01:06.223 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:01:06.223 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:01:06.223 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:01:06.223 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:01:06.224 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:01:06.224 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:01:06.224 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:01:06.224 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:01:06.225 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:01:06.225 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:01:06.225 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:01:06.225 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (54m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:01:06.226 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:06.226 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:06.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:05 gibba004 bash[30897]: cluster 2021-03-10T21:01:04.224181+0000 mgr.gibba009.xiladd (mgr.34457) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:06.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:05 gibba004 bash[31878]: cluster 2021-03-10T21:01:04.224181+0000 mgr.gibba009.xiladd (mgr.34457) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:05 gibba009 bash[26136]: cluster 2021-03-10T21:01:04.224181+0000 mgr.gibba009.xiladd (mgr.34457) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:06.471 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:01:06.471 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:01:06.471 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:06.472 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:06.472 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:01:06.472 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:06.472 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:06.473 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:01:06.473 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:01:06.473 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:06.473 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:01:06.473 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:01:06.474 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:01:06.474 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:01:06.474 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:01:07.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:06 gibba004 bash[30897]: audit 2021-03-10T21:01:06.468117+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.2.104:0/2732798013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:07.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:06 gibba004 bash[31878]: audit 2021-03-10T21:01:06.468117+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.2.104:0/2732798013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:07.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:06 gibba009 bash[26136]: audit 2021-03-10T21:01:06.468117+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.2.104:0/2732798013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[30897]: audit 2021-03-10T21:01:05.980509+0000 mgr.gibba009.xiladd (mgr.34457) 2706 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[30897]: audit 2021-03-10T21:01:06.204224+0000 mgr.gibba009.xiladd (mgr.34457) 2707 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[30897]: cluster 2021-03-10T21:01:06.225007+0000 mgr.gibba009.xiladd (mgr.34457) 2708 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[30897]: cephadm 2021-03-10T21:01:06.969153+0000 mgr.gibba009.xiladd (mgr.34457) 2709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[31878]: audit 2021-03-10T21:01:05.980509+0000 mgr.gibba009.xiladd (mgr.34457) 2706 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[31878]: audit 2021-03-10T21:01:06.204224+0000 mgr.gibba009.xiladd (mgr.34457) 2707 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[31878]: cluster 2021-03-10T21:01:06.225007+0000 mgr.gibba009.xiladd (mgr.34457) 2708 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:08.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:07 gibba004 bash[31878]: cephadm 2021-03-10T21:01:06.969153+0000 mgr.gibba009.xiladd (mgr.34457) 2709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:07 gibba009 bash[26136]: audit 2021-03-10T21:01:05.980509+0000 mgr.gibba009.xiladd (mgr.34457) 2706 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:07 gibba009 bash[26136]: audit 2021-03-10T21:01:06.204224+0000 mgr.gibba009.xiladd (mgr.34457) 2707 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:07 gibba009 bash[26136]: cluster 2021-03-10T21:01:06.225007+0000 mgr.gibba009.xiladd (mgr.34457) 2708 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:08.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:07 gibba009 bash[26136]: cephadm 2021-03-10T21:01:06.969153+0000 mgr.gibba009.xiladd (mgr.34457) 2709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:09 gibba004 bash[30897]: cluster 2021-03-10T21:01:08.226119+0000 mgr.gibba009.xiladd (mgr.34457) 2710 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:10.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:09 gibba004 bash[31878]: cluster 2021-03-10T21:01:08.226119+0000 mgr.gibba009.xiladd (mgr.34457) 2710 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:09 gibba009 bash[26136]: cluster 2021-03-10T21:01:08.226119+0000 mgr.gibba009.xiladd (mgr.34457) 2710 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:12.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:11 gibba004 bash[30897]: cluster 2021-03-10T21:01:10.227055+0000 mgr.gibba009.xiladd (mgr.34457) 2711 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:12.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:11 gibba004 bash[31878]: cluster 2021-03-10T21:01:10.227055+0000 mgr.gibba009.xiladd (mgr.34457) 2711 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:11 gibba009 bash[26136]: cluster 2021-03-10T21:01:10.227055+0000 mgr.gibba009.xiladd (mgr.34457) 2711 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:14.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:13 gibba004 bash[30897]: cluster 2021-03-10T21:01:12.228605+0000 mgr.gibba009.xiladd (mgr.34457) 2712 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:14.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:13 gibba004 bash[31878]: cluster 2021-03-10T21:01:12.228605+0000 mgr.gibba009.xiladd (mgr.34457) 2712 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:14.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:13 gibba009 bash[26136]: cluster 2021-03-10T21:01:12.228605+0000 mgr.gibba009.xiladd (mgr.34457) 2712 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:16.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:15 gibba004 bash[30897]: cluster 2021-03-10T21:01:14.229873+0000 mgr.gibba009.xiladd (mgr.34457) 2713 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:15 gibba004 bash[31878]: cluster 2021-03-10T21:01:14.229873+0000 mgr.gibba009.xiladd (mgr.34457) 2713 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:15 gibba009 bash[26136]: cluster 2021-03-10T21:01:14.229873+0000 mgr.gibba009.xiladd (mgr.34457) 2713 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:18.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:17 gibba004 bash[30897]: cluster 2021-03-10T21:01:16.231727+0000 mgr.gibba009.xiladd (mgr.34457) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:17 gibba004 bash[31878]: cluster 2021-03-10T21:01:16.231727+0000 mgr.gibba009.xiladd (mgr.34457) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:17 gibba009 bash[26136]: cluster 2021-03-10T21:01:16.231727+0000 mgr.gibba009.xiladd (mgr.34457) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:19 gibba004 bash[30897]: cluster 2021-03-10T21:01:18.233263+0000 mgr.gibba009.xiladd (mgr.34457) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:20.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:19 gibba004 bash[31878]: cluster 2021-03-10T21:01:18.233263+0000 mgr.gibba009.xiladd (mgr.34457) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:19 gibba009 bash[26136]: cluster 2021-03-10T21:01:18.233263+0000 mgr.gibba009.xiladd (mgr.34457) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:21 gibba004 bash[30897]: cluster 2021-03-10T21:01:20.234191+0000 mgr.gibba009.xiladd (mgr.34457) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:21 gibba004 bash[31878]: cluster 2021-03-10T21:01:20.234191+0000 mgr.gibba009.xiladd (mgr.34457) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:21 gibba009 bash[26136]: cluster 2021-03-10T21:01:20.234191+0000 mgr.gibba009.xiladd (mgr.34457) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:23.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:22 gibba004 bash[30897]: cephadm 2021-03-10T21:01:21.970300+0000 mgr.gibba009.xiladd (mgr.34457) 2717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:23.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:22 gibba004 bash[31878]: cephadm 2021-03-10T21:01:21.970300+0000 mgr.gibba009.xiladd (mgr.34457) 2717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:23.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:22 gibba009 bash[26136]: cephadm 2021-03-10T21:01:21.970300+0000 mgr.gibba009.xiladd (mgr.34457) 2717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:23 gibba004 bash[30897]: cluster 2021-03-10T21:01:22.235729+0000 mgr.gibba009.xiladd (mgr.34457) 2718 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:23 gibba004 bash[31878]: cluster 2021-03-10T21:01:22.235729+0000 mgr.gibba009.xiladd (mgr.34457) 2718 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:23 gibba009 bash[26136]: cluster 2021-03-10T21:01:22.235729+0000 mgr.gibba009.xiladd (mgr.34457) 2718 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:25 gibba004 bash[30897]: cluster 2021-03-10T21:01:24.237045+0000 mgr.gibba009.xiladd (mgr.34457) 2719 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:25 gibba004 bash[31878]: cluster 2021-03-10T21:01:24.237045+0000 mgr.gibba009.xiladd (mgr.34457) 2719 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:25 gibba009 bash[26136]: cluster 2021-03-10T21:01:24.237045+0000 mgr.gibba009.xiladd (mgr.34457) 2719 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:27 gibba004 bash[30897]: cluster 2021-03-10T21:01:26.238879+0000 mgr.gibba009.xiladd (mgr.34457) 2720 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:27 gibba004 bash[31878]: cluster 2021-03-10T21:01:26.238879+0000 mgr.gibba009.xiladd (mgr.34457) 2720 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:27 gibba009 bash[26136]: cluster 2021-03-10T21:01:26.238879+0000 mgr.gibba009.xiladd (mgr.34457) 2720 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:29 gibba004 bash[30897]: cluster 2021-03-10T21:01:28.240334+0000 mgr.gibba009.xiladd (mgr.34457) 2721 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:30.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:29 gibba004 bash[31878]: cluster 2021-03-10T21:01:28.240334+0000 mgr.gibba009.xiladd (mgr.34457) 2721 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:29 gibba009 bash[26136]: cluster 2021-03-10T21:01:28.240334+0000 mgr.gibba009.xiladd (mgr.34457) 2721 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:31 gibba004 bash[30897]: cluster 2021-03-10T21:01:30.241289+0000 mgr.gibba009.xiladd (mgr.34457) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:31 gibba004 bash[31878]: cluster 2021-03-10T21:01:30.241289+0000 mgr.gibba009.xiladd (mgr.34457) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:31 gibba009 bash[26136]: cluster 2021-03-10T21:01:30.241289+0000 mgr.gibba009.xiladd (mgr.34457) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:33.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:33 gibba004 bash[30897]: cluster 2021-03-10T21:01:32.242797+0000 mgr.gibba009.xiladd (mgr.34457) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:33.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:33 gibba004 bash[31878]: cluster 2021-03-10T21:01:32.242797+0000 mgr.gibba009.xiladd (mgr.34457) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:33.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:33 gibba009 bash[26136]: cluster 2021-03-10T21:01:32.242797+0000 mgr.gibba009.xiladd (mgr.34457) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:35 gibba004 bash[30897]: cluster 2021-03-10T21:01:34.244064+0000 mgr.gibba009.xiladd (mgr.34457) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:35 gibba004 bash[31878]: cluster 2021-03-10T21:01:34.244064+0000 mgr.gibba009.xiladd (mgr.34457) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:35 gibba009 bash[26136]: cluster 2021-03-10T21:01:34.244064+0000 mgr.gibba009.xiladd (mgr.34457) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:36.712 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:01:36.943 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:01:36.944 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (50m) 6m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:01:36.944 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (55m) 5m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:01:36.945 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (50m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:01:36.945 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:01:36.945 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:01:36.946 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:01:36.946 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:01:36.947 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:01:36.947 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:01:36.947 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:01:36.948 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:01:36.948 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:01:36.948 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:01:36.949 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:01:36.949 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:01:36.949 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:01:36.949 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:01:36.950 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (45m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:01:36.950 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (55m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:01:36.950 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:36.950 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:37.199 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:01:37.199 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:01:37.199 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:37.200 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:37.200 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:01:37.200 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:37.200 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:37.201 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:01:37.201 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:01:37.201 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:01:37.201 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:01:37.202 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:01:37.202 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:01:37.202 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:01:37.202 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:01:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: cluster 2021-03-10T21:01:36.245959+0000 mgr.gibba009.xiladd (mgr.34457) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:36.698993+0000 mgr.gibba009.xiladd (mgr.34457) 2726 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:36.928898+0000 mgr.gibba009.xiladd (mgr.34457) 2727 : audit [DBG] from='client.55879 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:36.986594+0000 mon.c (mon.1) 804 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.184513+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:01:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.188437+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.189705+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.190695+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.191631+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.193705+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.194833+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[30897]: audit 2021-03-10T21:01:37.196185+0000 mon.a (mon.0) 971 : audit [DBG] from='client.? 172.21.2.104:0/3465095616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: cluster 2021-03-10T21:01:36.245959+0000 mgr.gibba009.xiladd (mgr.34457) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:36.698993+0000 mgr.gibba009.xiladd (mgr.34457) 2726 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:36.928898+0000 mgr.gibba009.xiladd (mgr.34457) 2727 : audit [DBG] from='client.55879 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:36.986594+0000 mon.c (mon.1) 804 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.184513+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:01:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.188437+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.189705+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.190695+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.191631+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.193705+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.194833+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:37 gibba004 bash[31878]: audit 2021-03-10T21:01:37.196185+0000 mon.a (mon.0) 971 : audit [DBG] from='client.? 172.21.2.104:0/3465095616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: cluster 2021-03-10T21:01:36.245959+0000 mgr.gibba009.xiladd (mgr.34457) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:36.698993+0000 mgr.gibba009.xiladd (mgr.34457) 2726 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:36.928898+0000 mgr.gibba009.xiladd (mgr.34457) 2727 : audit [DBG] from='client.55879 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:36.986594+0000 mon.c (mon.1) 804 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.184513+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:01:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.188437+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.189705+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.190695+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.191631+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.193705+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.194833+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:37 gibba009 bash[26136]: audit 2021-03-10T21:01:37.196185+0000 mon.a (mon.0) 971 : audit [DBG] from='client.? 172.21.2.104:0/3465095616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:36.988120+0000 mgr.gibba009.xiladd (mgr.34457) 2728 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:01:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:36.988817+0000 mgr.gibba009.xiladd (mgr.34457) 2729 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:01:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.187096+0000 mgr.gibba009.xiladd (mgr.34457) 2730 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.188637+0000 mgr.gibba009.xiladd (mgr.34457) 2731 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.189727+0000 mgr.gibba009.xiladd (mgr.34457) 2732 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.189767+0000 mgr.gibba009.xiladd (mgr.34457) 2733 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.190739+0000 mgr.gibba009.xiladd (mgr.34457) 2734 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.190778+0000 mgr.gibba009.xiladd (mgr.34457) 2735 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.191576+0000 mgr.gibba009.xiladd (mgr.34457) 2736 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.192607+0000 mgr.gibba009.xiladd (mgr.34457) 2737 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.192653+0000 mgr.gibba009.xiladd (mgr.34457) 2738 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.193684+0000 mgr.gibba009.xiladd (mgr.34457) 2739 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.193997+0000 mgr.gibba009.xiladd (mgr.34457) 2740 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.194785+0000 mgr.gibba009.xiladd (mgr.34457) 2741 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.194824+0000 mgr.gibba009.xiladd (mgr.34457) 2742 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[30897]: cephadm 2021-03-10T21:01:37.194950+0000 mgr.gibba009.xiladd (mgr.34457) 2743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:36.988120+0000 mgr.gibba009.xiladd (mgr.34457) 2728 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:01:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:36.988817+0000 mgr.gibba009.xiladd (mgr.34457) 2729 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:01:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.187096+0000 mgr.gibba009.xiladd (mgr.34457) 2730 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.188637+0000 mgr.gibba009.xiladd (mgr.34457) 2731 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.189727+0000 mgr.gibba009.xiladd (mgr.34457) 2732 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.189767+0000 mgr.gibba009.xiladd (mgr.34457) 2733 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.190739+0000 mgr.gibba009.xiladd (mgr.34457) 2734 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.190778+0000 mgr.gibba009.xiladd (mgr.34457) 2735 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.191576+0000 mgr.gibba009.xiladd (mgr.34457) 2736 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.192607+0000 mgr.gibba009.xiladd (mgr.34457) 2737 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.192653+0000 mgr.gibba009.xiladd (mgr.34457) 2738 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.193684+0000 mgr.gibba009.xiladd (mgr.34457) 2739 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.193997+0000 mgr.gibba009.xiladd (mgr.34457) 2740 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.194785+0000 mgr.gibba009.xiladd (mgr.34457) 2741 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.194824+0000 mgr.gibba009.xiladd (mgr.34457) 2742 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:38 gibba004 bash[31878]: cephadm 2021-03-10T21:01:37.194950+0000 mgr.gibba009.xiladd (mgr.34457) 2743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:39.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:36.988120+0000 mgr.gibba009.xiladd (mgr.34457) 2728 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:01:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:36.988817+0000 mgr.gibba009.xiladd (mgr.34457) 2729 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:01:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.187096+0000 mgr.gibba009.xiladd (mgr.34457) 2730 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.188637+0000 mgr.gibba009.xiladd (mgr.34457) 2731 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.189727+0000 mgr.gibba009.xiladd (mgr.34457) 2732 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.189767+0000 mgr.gibba009.xiladd (mgr.34457) 2733 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.190739+0000 mgr.gibba009.xiladd (mgr.34457) 2734 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.190778+0000 mgr.gibba009.xiladd (mgr.34457) 2735 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.191576+0000 mgr.gibba009.xiladd (mgr.34457) 2736 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.192607+0000 mgr.gibba009.xiladd (mgr.34457) 2737 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.192653+0000 mgr.gibba009.xiladd (mgr.34457) 2738 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.193684+0000 mgr.gibba009.xiladd (mgr.34457) 2739 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.193997+0000 mgr.gibba009.xiladd (mgr.34457) 2740 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.194785+0000 mgr.gibba009.xiladd (mgr.34457) 2741 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.194824+0000 mgr.gibba009.xiladd (mgr.34457) 2742 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:38 gibba009 bash[26136]: cephadm 2021-03-10T21:01:37.194950+0000 mgr.gibba009.xiladd (mgr.34457) 2743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: cluster 2021-03-10T21:01:38.247514+0000 mgr.gibba009.xiladd (mgr.34457) 2744 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.889519+0000 mon.c (mon.1) 811 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.890510+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.890797+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.891866+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.901460+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.902642+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.902901+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.903717+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.903917+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.904966+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.905216+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[30897]: audit 2021-03-10T21:01:39.906472+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: cluster 2021-03-10T21:01:38.247514+0000 mgr.gibba009.xiladd (mgr.34457) 2744 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.889519+0000 mon.c (mon.1) 811 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.890510+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.890797+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.891866+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.901460+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.902642+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.902901+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.903717+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.903917+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.904966+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.905216+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:39 gibba004 bash[31878]: audit 2021-03-10T21:01:39.906472+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: cluster 2021-03-10T21:01:38.247514+0000 mgr.gibba009.xiladd (mgr.34457) 2744 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.889519+0000 mon.c (mon.1) 811 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.890510+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.890797+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.891866+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.901460+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.902642+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.902901+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.903717+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.903917+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.904966+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.905216+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:39 gibba009 bash[26136]: audit 2021-03-10T21:01:39.906472+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:01:42.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:41 gibba004 bash[30897]: cluster 2021-03-10T21:01:40.249168+0000 mgr.gibba009.xiladd (mgr.34457) 2745 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:42.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:41 gibba004 bash[31878]: cluster 2021-03-10T21:01:40.249168+0000 mgr.gibba009.xiladd (mgr.34457) 2745 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:42.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:41 gibba009 bash[26136]: cluster 2021-03-10T21:01:40.249168+0000 mgr.gibba009.xiladd (mgr.34457) 2745 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:44.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:43 gibba004 bash[30897]: cluster 2021-03-10T21:01:42.250717+0000 mgr.gibba009.xiladd (mgr.34457) 2746 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:44.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:43 gibba004 bash[31878]: cluster 2021-03-10T21:01:42.250717+0000 mgr.gibba009.xiladd (mgr.34457) 2746 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:43 gibba009 bash[26136]: cluster 2021-03-10T21:01:42.250717+0000 mgr.gibba009.xiladd (mgr.34457) 2746 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:45 gibba004 bash[30897]: cluster 2021-03-10T21:01:44.251902+0000 mgr.gibba009.xiladd (mgr.34457) 2747 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:45 gibba004 bash[31878]: cluster 2021-03-10T21:01:44.251902+0000 mgr.gibba009.xiladd (mgr.34457) 2747 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:45 gibba009 bash[26136]: cluster 2021-03-10T21:01:44.251902+0000 mgr.gibba009.xiladd (mgr.34457) 2747 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:47 gibba004 bash[30897]: cluster 2021-03-10T21:01:46.253799+0000 mgr.gibba009.xiladd (mgr.34457) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:47 gibba004 bash[31878]: cluster 2021-03-10T21:01:46.253799+0000 mgr.gibba009.xiladd (mgr.34457) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:47 gibba009 bash[26136]: cluster 2021-03-10T21:01:46.253799+0000 mgr.gibba009.xiladd (mgr.34457) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:49 gibba004 bash[30897]: cluster 2021-03-10T21:01:48.255313+0000 mgr.gibba009.xiladd (mgr.34457) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:49 gibba004 bash[31878]: cluster 2021-03-10T21:01:48.255313+0000 mgr.gibba009.xiladd (mgr.34457) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:49 gibba009 bash[26136]: cluster 2021-03-10T21:01:48.255313+0000 mgr.gibba009.xiladd (mgr.34457) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:51 gibba004 bash[30897]: cluster 2021-03-10T21:01:50.256255+0000 mgr.gibba009.xiladd (mgr.34457) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:51 gibba004 bash[31878]: cluster 2021-03-10T21:01:50.256255+0000 mgr.gibba009.xiladd (mgr.34457) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:51 gibba009 bash[26136]: cluster 2021-03-10T21:01:50.256255+0000 mgr.gibba009.xiladd (mgr.34457) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:53.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:53 gibba004 bash[30897]: cephadm 2021-03-10T21:01:52.210975+0000 mgr.gibba009.xiladd (mgr.34457) 2751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:53.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:53 gibba004 bash[30897]: cluster 2021-03-10T21:01:52.257694+0000 mgr.gibba009.xiladd (mgr.34457) 2752 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:53.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:53 gibba004 bash[31878]: cephadm 2021-03-10T21:01:52.210975+0000 mgr.gibba009.xiladd (mgr.34457) 2751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:53.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:53 gibba004 bash[31878]: cluster 2021-03-10T21:01:52.257694+0000 mgr.gibba009.xiladd (mgr.34457) 2752 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:53.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:53 gibba009 bash[26136]: cephadm 2021-03-10T21:01:52.210975+0000 mgr.gibba009.xiladd (mgr.34457) 2751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:01:53.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:53 gibba009 bash[26136]: cluster 2021-03-10T21:01:52.257694+0000 mgr.gibba009.xiladd (mgr.34457) 2752 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:55 gibba004 bash[30897]: cluster 2021-03-10T21:01:54.259090+0000 mgr.gibba009.xiladd (mgr.34457) 2753 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:55 gibba004 bash[31878]: cluster 2021-03-10T21:01:54.259090+0000 mgr.gibba009.xiladd (mgr.34457) 2753 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:55 gibba009 bash[26136]: cluster 2021-03-10T21:01:54.259090+0000 mgr.gibba009.xiladd (mgr.34457) 2753 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:57 gibba004 bash[30897]: cluster 2021-03-10T21:01:56.260995+0000 mgr.gibba009.xiladd (mgr.34457) 2754 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:57 gibba004 bash[31878]: cluster 2021-03-10T21:01:56.260995+0000 mgr.gibba009.xiladd (mgr.34457) 2754 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:57 gibba009 bash[26136]: cluster 2021-03-10T21:01:56.260995+0000 mgr.gibba009.xiladd (mgr.34457) 2754 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:01:59 gibba004 bash[30897]: cluster 2021-03-10T21:01:58.262341+0000 mgr.gibba009.xiladd (mgr.34457) 2755 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:01:59 gibba004 bash[31878]: cluster 2021-03-10T21:01:58.262341+0000 mgr.gibba009.xiladd (mgr.34457) 2755 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:01:59 gibba009 bash[26136]: cluster 2021-03-10T21:01:58.262341+0000 mgr.gibba009.xiladd (mgr.34457) 2755 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:01 gibba004 bash[30897]: cluster 2021-03-10T21:02:00.264093+0000 mgr.gibba009.xiladd (mgr.34457) 2756 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:01 gibba004 bash[31878]: cluster 2021-03-10T21:02:00.264093+0000 mgr.gibba009.xiladd (mgr.34457) 2756 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:01 gibba009 bash[26136]: cluster 2021-03-10T21:02:00.264093+0000 mgr.gibba009.xiladd (mgr.34457) 2756 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:03 gibba004 bash[30897]: cluster 2021-03-10T21:02:02.265725+0000 mgr.gibba009.xiladd (mgr.34457) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:04.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:03 gibba004 bash[31878]: cluster 2021-03-10T21:02:02.265725+0000 mgr.gibba009.xiladd (mgr.34457) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:03 gibba009 bash[26136]: cluster 2021-03-10T21:02:02.265725+0000 mgr.gibba009.xiladd (mgr.34457) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:05 gibba004 bash[30897]: cluster 2021-03-10T21:02:04.267090+0000 mgr.gibba009.xiladd (mgr.34457) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:06.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:05 gibba004 bash[31878]: cluster 2021-03-10T21:02:04.267090+0000 mgr.gibba009.xiladd (mgr.34457) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:05 gibba009 bash[26136]: cluster 2021-03-10T21:02:04.267090+0000 mgr.gibba009.xiladd (mgr.34457) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:07.445 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:02:07.670 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:02:07.670 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:02:07.671 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:02:07.671 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:02:07.671 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:02:07.672 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:02:07.672 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:02:07.672 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:02:07.673 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:02:07.673 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:02:07.673 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:02:07.674 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:02:07.674 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:02:07.675 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:02:07.675 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:02:07.675 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:02:07.675 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:02:07.675 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:02:07.676 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:02:07.676 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (55m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:02:07.676 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:07.676 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:07.920 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:02:07.920 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:02:07.920 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:07.921 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:07.921 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:02:07.921 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:07.921 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:07.922 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:02:07.922 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:02:07.922 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:07.922 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:02:07.923 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:02:07.923 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:02:07.923 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:02:07.923 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:02:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:07 gibba004 bash[30897]: cluster 2021-03-10T21:02:06.268903+0000 mgr.gibba009.xiladd (mgr.34457) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:07 gibba004 bash[30897]: audit 2021-03-10T21:02:07.917154+0000 mon.c (mon.1) 817 : audit [DBG] from='client.? 172.21.2.104:0/2456446903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:08.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:07 gibba004 bash[31878]: cluster 2021-03-10T21:02:06.268903+0000 mgr.gibba009.xiladd (mgr.34457) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:08.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:07 gibba004 bash[31878]: audit 2021-03-10T21:02:07.917154+0000 mon.c (mon.1) 817 : audit [DBG] from='client.? 172.21.2.104:0/2456446903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:07 gibba009 bash[26136]: cluster 2021-03-10T21:02:06.268903+0000 mgr.gibba009.xiladd (mgr.34457) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:07 gibba009 bash[26136]: audit 2021-03-10T21:02:07.917154+0000 mon.c (mon.1) 817 : audit [DBG] from='client.? 172.21.2.104:0/2456446903' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:09.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[30897]: cephadm 2021-03-10T21:02:07.225568+0000 mgr.gibba009.xiladd (mgr.34457) 2760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:09.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[30897]: audit 2021-03-10T21:02:07.432343+0000 mgr.gibba009.xiladd (mgr.34457) 2761 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:09.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[30897]: audit 2021-03-10T21:02:07.653889+0000 mgr.gibba009.xiladd (mgr.34457) 2762 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:09.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[31878]: cephadm 2021-03-10T21:02:07.225568+0000 mgr.gibba009.xiladd (mgr.34457) 2760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:09.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[31878]: audit 2021-03-10T21:02:07.432343+0000 mgr.gibba009.xiladd (mgr.34457) 2761 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:09.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:08 gibba004 bash[31878]: audit 2021-03-10T21:02:07.653889+0000 mgr.gibba009.xiladd (mgr.34457) 2762 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:09.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:08 gibba009 bash[26136]: cephadm 2021-03-10T21:02:07.225568+0000 mgr.gibba009.xiladd (mgr.34457) 2760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:09.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:08 gibba009 bash[26136]: audit 2021-03-10T21:02:07.432343+0000 mgr.gibba009.xiladd (mgr.34457) 2761 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:09.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:08 gibba009 bash[26136]: audit 2021-03-10T21:02:07.653889+0000 mgr.gibba009.xiladd (mgr.34457) 2762 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:09 gibba004 bash[30897]: cluster 2021-03-10T21:02:08.270464+0000 mgr.gibba009.xiladd (mgr.34457) 2763 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:10.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:09 gibba004 bash[31878]: cluster 2021-03-10T21:02:08.270464+0000 mgr.gibba009.xiladd (mgr.34457) 2763 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:09 gibba009 bash[26136]: cluster 2021-03-10T21:02:08.270464+0000 mgr.gibba009.xiladd (mgr.34457) 2763 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:11 gibba004 bash[30897]: cluster 2021-03-10T21:02:10.271624+0000 mgr.gibba009.xiladd (mgr.34457) 2764 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:11.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:11 gibba004 bash[31878]: cluster 2021-03-10T21:02:10.271624+0000 mgr.gibba009.xiladd (mgr.34457) 2764 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:11.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:11 gibba009 bash[26136]: cluster 2021-03-10T21:02:10.271624+0000 mgr.gibba009.xiladd (mgr.34457) 2764 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:13.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:13 gibba004 bash[30897]: cluster 2021-03-10T21:02:12.273184+0000 mgr.gibba009.xiladd (mgr.34457) 2765 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:13.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:13 gibba004 bash[31878]: cluster 2021-03-10T21:02:12.273184+0000 mgr.gibba009.xiladd (mgr.34457) 2765 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:13.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:13 gibba009 bash[26136]: cluster 2021-03-10T21:02:12.273184+0000 mgr.gibba009.xiladd (mgr.34457) 2765 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:16.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:15 gibba004 bash[30897]: cluster 2021-03-10T21:02:14.274406+0000 mgr.gibba009.xiladd (mgr.34457) 2766 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:15 gibba004 bash[31878]: cluster 2021-03-10T21:02:14.274406+0000 mgr.gibba009.xiladd (mgr.34457) 2766 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:15 gibba009 bash[26136]: cluster 2021-03-10T21:02:14.274406+0000 mgr.gibba009.xiladd (mgr.34457) 2766 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:17 gibba004 bash[30897]: cluster 2021-03-10T21:02:16.276241+0000 mgr.gibba009.xiladd (mgr.34457) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:17 gibba004 bash[31878]: cluster 2021-03-10T21:02:16.276241+0000 mgr.gibba009.xiladd (mgr.34457) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:17 gibba009 bash[26136]: cluster 2021-03-10T21:02:16.276241+0000 mgr.gibba009.xiladd (mgr.34457) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:19 gibba004 bash[30897]: cluster 2021-03-10T21:02:18.277744+0000 mgr.gibba009.xiladd (mgr.34457) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:20.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:19 gibba004 bash[31878]: cluster 2021-03-10T21:02:18.277744+0000 mgr.gibba009.xiladd (mgr.34457) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:19 gibba009 bash[26136]: cluster 2021-03-10T21:02:18.277744+0000 mgr.gibba009.xiladd (mgr.34457) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:22.249 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:21 gibba009 bash[26136]: cluster 2021-03-10T21:02:20.279297+0000 mgr.gibba009.xiladd (mgr.34457) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:21 gibba004 bash[30897]: cluster 2021-03-10T21:02:20.279297+0000 mgr.gibba009.xiladd (mgr.34457) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:21 gibba004 bash[31878]: cluster 2021-03-10T21:02:20.279297+0000 mgr.gibba009.xiladd (mgr.34457) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:24.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:23 gibba004 bash[30897]: cephadm 2021-03-10T21:02:22.241621+0000 mgr.gibba009.xiladd (mgr.34457) 2770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:23 gibba004 bash[30897]: cluster 2021-03-10T21:02:22.280879+0000 mgr.gibba009.xiladd (mgr.34457) 2771 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:24.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:23 gibba004 bash[31878]: cephadm 2021-03-10T21:02:22.241621+0000 mgr.gibba009.xiladd (mgr.34457) 2770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:24.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:23 gibba004 bash[31878]: cluster 2021-03-10T21:02:22.280879+0000 mgr.gibba009.xiladd (mgr.34457) 2771 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:23 gibba009 bash[26136]: cephadm 2021-03-10T21:02:22.241621+0000 mgr.gibba009.xiladd (mgr.34457) 2770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:24.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:23 gibba009 bash[26136]: cluster 2021-03-10T21:02:22.280879+0000 mgr.gibba009.xiladd (mgr.34457) 2771 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:26.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:25 gibba004 bash[30897]: cluster 2021-03-10T21:02:24.282182+0000 mgr.gibba009.xiladd (mgr.34457) 2772 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:25 gibba004 bash[31878]: cluster 2021-03-10T21:02:24.282182+0000 mgr.gibba009.xiladd (mgr.34457) 2772 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:25 gibba009 bash[26136]: cluster 2021-03-10T21:02:24.282182+0000 mgr.gibba009.xiladd (mgr.34457) 2772 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:27 gibba004 bash[30897]: cluster 2021-03-10T21:02:26.284085+0000 mgr.gibba009.xiladd (mgr.34457) 2773 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:27 gibba004 bash[31878]: cluster 2021-03-10T21:02:26.284085+0000 mgr.gibba009.xiladd (mgr.34457) 2773 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:27 gibba009 bash[26136]: cluster 2021-03-10T21:02:26.284085+0000 mgr.gibba009.xiladd (mgr.34457) 2773 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:29 gibba004 bash[30897]: cluster 2021-03-10T21:02:28.285663+0000 mgr.gibba009.xiladd (mgr.34457) 2774 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:30.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:30 gibba004 bash[31878]: cluster 2021-03-10T21:02:28.285663+0000 mgr.gibba009.xiladd (mgr.34457) 2774 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:29 gibba009 bash[26136]: cluster 2021-03-10T21:02:28.285663+0000 mgr.gibba009.xiladd (mgr.34457) 2774 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:32 gibba004 bash[30897]: cluster 2021-03-10T21:02:30.287427+0000 mgr.gibba009.xiladd (mgr.34457) 2775 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:32 gibba004 bash[31878]: cluster 2021-03-10T21:02:30.287427+0000 mgr.gibba009.xiladd (mgr.34457) 2775 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:32 gibba009 bash[26136]: cluster 2021-03-10T21:02:30.287427+0000 mgr.gibba009.xiladd (mgr.34457) 2775 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:33.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:33 gibba004 bash[30897]: cluster 2021-03-10T21:02:32.288957+0000 mgr.gibba009.xiladd (mgr.34457) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:33.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:33 gibba004 bash[31878]: cluster 2021-03-10T21:02:32.288957+0000 mgr.gibba009.xiladd (mgr.34457) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:33.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:33 gibba009 bash[26136]: cluster 2021-03-10T21:02:32.288957+0000 mgr.gibba009.xiladd (mgr.34457) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:35 gibba004 bash[30897]: cluster 2021-03-10T21:02:34.290244+0000 mgr.gibba009.xiladd (mgr.34457) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:35 gibba004 bash[31878]: cluster 2021-03-10T21:02:34.290244+0000 mgr.gibba009.xiladd (mgr.34457) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:35 gibba009 bash[26136]: cluster 2021-03-10T21:02:34.290244+0000 mgr.gibba009.xiladd (mgr.34457) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.165 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:02:38.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: cluster 2021-03-10T21:02:36.291949+0000 mgr.gibba009.xiladd (mgr.34457) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.258998+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.464423+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.475654+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.660462+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.664377+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.665819+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.666986+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.668220+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.670397+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[30897]: audit 2021-03-10T21:02:37.671744+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: cluster 2021-03-10T21:02:36.291949+0000 mgr.gibba009.xiladd (mgr.34457) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.258998+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.464423+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.475654+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.660462+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.664377+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.665819+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.666986+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.668220+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.670397+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:37 gibba004 bash[31878]: audit 2021-03-10T21:02:37.671744+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: cluster 2021-03-10T21:02:36.291949+0000 mgr.gibba009.xiladd (mgr.34457) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.258998+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.464423+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.475654+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.660462+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:02:38.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.664377+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.665819+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.666986+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.668220+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.352 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.670397+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.352 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:37 gibba009 bash[26136]: audit 2021-03-10T21:02:37.671744+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.395 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:02:38.395 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (51m) 7m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:02:38.396 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (56m) 6m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:02:38.396 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (51m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:02:38.396 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:02:38.397 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:02:38.397 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:02:38.398 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:02:38.398 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:02:38.399 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:02:38.399 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:02:38.399 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:02:38.400 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:02:38.400 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:02:38.400 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (48m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:02:38.401 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:02:38.401 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:02:38.401 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:02:38.402 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (46m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:02:38.402 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (56m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:02:38.403 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:38.403 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:38.643 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:02:38.643 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:02:38.643 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:38.644 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:38.644 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:02:38.644 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:38.644 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:38.644 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:02:38.645 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:02:38.645 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:02:38.645 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:02:38.645 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:02:38.646 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:02:38.646 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:02:38.646 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:02:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.465009+0000 mgr.gibba009.xiladd (mgr.34457) 2779 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:02:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.476026+0000 mgr.gibba009.xiladd (mgr.34457) 2780 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:02:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.662912+0000 mgr.gibba009.xiladd (mgr.34457) 2781 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.664714+0000 mgr.gibba009.xiladd (mgr.34457) 2782 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.665819+0000 mgr.gibba009.xiladd (mgr.34457) 2783 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.665857+0000 mgr.gibba009.xiladd (mgr.34457) 2784 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.667175+0000 mgr.gibba009.xiladd (mgr.34457) 2785 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.667223+0000 mgr.gibba009.xiladd (mgr.34457) 2786 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.668286+0000 mgr.gibba009.xiladd (mgr.34457) 2787 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.669402+0000 mgr.gibba009.xiladd (mgr.34457) 2788 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.669441+0000 mgr.gibba009.xiladd (mgr.34457) 2789 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.670428+0000 mgr.gibba009.xiladd (mgr.34457) 2790 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.670749+0000 mgr.gibba009.xiladd (mgr.34457) 2791 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.671747+0000 mgr.gibba009.xiladd (mgr.34457) 2792 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.671788+0000 mgr.gibba009.xiladd (mgr.34457) 2793 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: cephadm 2021-03-10T21:02:37.671916+0000 mgr.gibba009.xiladd (mgr.34457) 2794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:39.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[30897]: audit 2021-03-10T21:02:38.640066+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.2.104:0/3619170805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.465009+0000 mgr.gibba009.xiladd (mgr.34457) 2779 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:02:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.476026+0000 mgr.gibba009.xiladd (mgr.34457) 2780 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:02:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.662912+0000 mgr.gibba009.xiladd (mgr.34457) 2781 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.664714+0000 mgr.gibba009.xiladd (mgr.34457) 2782 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.665819+0000 mgr.gibba009.xiladd (mgr.34457) 2783 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.665857+0000 mgr.gibba009.xiladd (mgr.34457) 2784 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.667175+0000 mgr.gibba009.xiladd (mgr.34457) 2785 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.667223+0000 mgr.gibba009.xiladd (mgr.34457) 2786 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.668286+0000 mgr.gibba009.xiladd (mgr.34457) 2787 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.669402+0000 mgr.gibba009.xiladd (mgr.34457) 2788 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.669441+0000 mgr.gibba009.xiladd (mgr.34457) 2789 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.670428+0000 mgr.gibba009.xiladd (mgr.34457) 2790 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.670749+0000 mgr.gibba009.xiladd (mgr.34457) 2791 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.671747+0000 mgr.gibba009.xiladd (mgr.34457) 2792 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.671788+0000 mgr.gibba009.xiladd (mgr.34457) 2793 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: cephadm 2021-03-10T21:02:37.671916+0000 mgr.gibba009.xiladd (mgr.34457) 2794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:38 gibba004 bash[31878]: audit 2021-03-10T21:02:38.640066+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.2.104:0/3619170805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.465009+0000 mgr.gibba009.xiladd (mgr.34457) 2779 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:02:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.476026+0000 mgr.gibba009.xiladd (mgr.34457) 2780 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:02:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.662912+0000 mgr.gibba009.xiladd (mgr.34457) 2781 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.664714+0000 mgr.gibba009.xiladd (mgr.34457) 2782 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.665819+0000 mgr.gibba009.xiladd (mgr.34457) 2783 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.665857+0000 mgr.gibba009.xiladd (mgr.34457) 2784 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.667175+0000 mgr.gibba009.xiladd (mgr.34457) 2785 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.667223+0000 mgr.gibba009.xiladd (mgr.34457) 2786 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.668286+0000 mgr.gibba009.xiladd (mgr.34457) 2787 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.669402+0000 mgr.gibba009.xiladd (mgr.34457) 2788 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.669441+0000 mgr.gibba009.xiladd (mgr.34457) 2789 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.670428+0000 mgr.gibba009.xiladd (mgr.34457) 2790 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.670749+0000 mgr.gibba009.xiladd (mgr.34457) 2791 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.671747+0000 mgr.gibba009.xiladd (mgr.34457) 2792 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.671788+0000 mgr.gibba009.xiladd (mgr.34457) 2793 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: cephadm 2021-03-10T21:02:37.671916+0000 mgr.gibba009.xiladd (mgr.34457) 2794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:38 gibba009 bash[26136]: audit 2021-03-10T21:02:38.640066+0000 mon.a (mon.0) 981 : audit [DBG] from='client.? 172.21.2.104:0/3619170805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:38.152941+0000 mgr.gibba009.xiladd (mgr.34457) 2795 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: cluster 2021-03-10T21:02:38.293630+0000 mgr.gibba009.xiladd (mgr.34457) 2796 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:38.378871+0000 mgr.gibba009.xiladd (mgr.34457) 2797 : audit [DBG] from='client.55915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.896835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.897469+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.897940+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.899005+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.909687+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.910454+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.910894+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.911476+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.912243+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.912863+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.913163+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[30897]: audit 2021-03-10T21:02:39.914151+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:38.152941+0000 mgr.gibba009.xiladd (mgr.34457) 2795 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: cluster 2021-03-10T21:02:38.293630+0000 mgr.gibba009.xiladd (mgr.34457) 2796 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:38.378871+0000 mgr.gibba009.xiladd (mgr.34457) 2797 : audit [DBG] from='client.55915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.896835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.897469+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.897940+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.899005+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.909687+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.910454+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.910894+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.911476+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.912243+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.912863+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.913163+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:39 gibba004 bash[31878]: audit 2021-03-10T21:02:39.914151+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:38.152941+0000 mgr.gibba009.xiladd (mgr.34457) 2795 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: cluster 2021-03-10T21:02:38.293630+0000 mgr.gibba009.xiladd (mgr.34457) 2796 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:38.378871+0000 mgr.gibba009.xiladd (mgr.34457) 2797 : audit [DBG] from='client.55915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.896835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.897469+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.897940+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.899005+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.909687+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.910454+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.910894+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:02:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.911476+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.912243+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.912863+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.913163+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T21:02:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:39 gibba009 bash[26136]: audit 2021-03-10T21:02:39.914151+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:02:42.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:41 gibba004 bash[30897]: cluster 2021-03-10T21:02:40.295244+0000 mgr.gibba009.xiladd (mgr.34457) 2798 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:42.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:41 gibba004 bash[31878]: cluster 2021-03-10T21:02:40.295244+0000 mgr.gibba009.xiladd (mgr.34457) 2798 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:42.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:41 gibba009 bash[26136]: cluster 2021-03-10T21:02:40.295244+0000 mgr.gibba009.xiladd (mgr.34457) 2798 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:44.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:43 gibba004 bash[30897]: cluster 2021-03-10T21:02:42.296877+0000 mgr.gibba009.xiladd (mgr.34457) 2799 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:44.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:43 gibba004 bash[31878]: cluster 2021-03-10T21:02:42.296877+0000 mgr.gibba009.xiladd (mgr.34457) 2799 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:43 gibba009 bash[26136]: cluster 2021-03-10T21:02:42.296877+0000 mgr.gibba009.xiladd (mgr.34457) 2799 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:45 gibba004 bash[30897]: cluster 2021-03-10T21:02:44.298071+0000 mgr.gibba009.xiladd (mgr.34457) 2800 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:46.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:46 gibba004 bash[31878]: cluster 2021-03-10T21:02:44.298071+0000 mgr.gibba009.xiladd (mgr.34457) 2800 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:46 gibba009 bash[26136]: cluster 2021-03-10T21:02:44.298071+0000 mgr.gibba009.xiladd (mgr.34457) 2800 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:48.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:48 gibba004 bash[30897]: cluster 2021-03-10T21:02:46.298912+0000 mgr.gibba009.xiladd (mgr.34457) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:48.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:48 gibba004 bash[31878]: cluster 2021-03-10T21:02:46.298912+0000 mgr.gibba009.xiladd (mgr.34457) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:48 gibba009 bash[26136]: cluster 2021-03-10T21:02:46.298912+0000 mgr.gibba009.xiladd (mgr.34457) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:50.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:50 gibba004 bash[30897]: cluster 2021-03-10T21:02:48.300465+0000 mgr.gibba009.xiladd (mgr.34457) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:50 gibba004 bash[31878]: cluster 2021-03-10T21:02:48.300465+0000 mgr.gibba009.xiladd (mgr.34457) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:50 gibba009 bash[26136]: cluster 2021-03-10T21:02:48.300465+0000 mgr.gibba009.xiladd (mgr.34457) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:51.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:51 gibba004 bash[30897]: cluster 2021-03-10T21:02:50.302039+0000 mgr.gibba009.xiladd (mgr.34457) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:51.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:51 gibba004 bash[31878]: cluster 2021-03-10T21:02:50.302039+0000 mgr.gibba009.xiladd (mgr.34457) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:51.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:51 gibba009 bash[26136]: cluster 2021-03-10T21:02:50.302039+0000 mgr.gibba009.xiladd (mgr.34457) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:53 gibba004 bash[30897]: cluster 2021-03-10T21:02:52.303661+0000 mgr.gibba009.xiladd (mgr.34457) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:53 gibba004 bash[30897]: cephadm 2021-03-10T21:02:52.687872+0000 mgr.gibba009.xiladd (mgr.34457) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:53.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:53 gibba004 bash[31878]: cluster 2021-03-10T21:02:52.303661+0000 mgr.gibba009.xiladd (mgr.34457) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:53 gibba004 bash[31878]: cephadm 2021-03-10T21:02:52.687872+0000 mgr.gibba009.xiladd (mgr.34457) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:53.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:53 gibba009 bash[26136]: cluster 2021-03-10T21:02:52.303661+0000 mgr.gibba009.xiladd (mgr.34457) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:53 gibba009 bash[26136]: cephadm 2021-03-10T21:02:52.687872+0000 mgr.gibba009.xiladd (mgr.34457) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:02:56.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:55 gibba004 bash[30897]: cluster 2021-03-10T21:02:54.304925+0000 mgr.gibba009.xiladd (mgr.34457) 2806 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:55 gibba004 bash[31878]: cluster 2021-03-10T21:02:54.304925+0000 mgr.gibba009.xiladd (mgr.34457) 2806 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:56.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:55 gibba009 bash[26136]: cluster 2021-03-10T21:02:54.304925+0000 mgr.gibba009.xiladd (mgr.34457) 2806 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:58.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:57 gibba004 bash[30897]: cluster 2021-03-10T21:02:56.306570+0000 mgr.gibba009.xiladd (mgr.34457) 2807 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:57 gibba004 bash[31878]: cluster 2021-03-10T21:02:56.306570+0000 mgr.gibba009.xiladd (mgr.34457) 2807 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:57 gibba009 bash[26136]: cluster 2021-03-10T21:02:56.306570+0000 mgr.gibba009.xiladd (mgr.34457) 2807 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:02:59 gibba004 bash[30897]: cluster 2021-03-10T21:02:58.308236+0000 mgr.gibba009.xiladd (mgr.34457) 2808 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:00.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:02:59 gibba004 bash[31878]: cluster 2021-03-10T21:02:58.308236+0000 mgr.gibba009.xiladd (mgr.34457) 2808 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:02:59 gibba009 bash[26136]: cluster 2021-03-10T21:02:58.308236+0000 mgr.gibba009.xiladd (mgr.34457) 2808 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:01 gibba004 bash[30897]: cluster 2021-03-10T21:03:00.309598+0000 mgr.gibba009.xiladd (mgr.34457) 2809 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:01 gibba004 bash[31878]: cluster 2021-03-10T21:03:00.309598+0000 mgr.gibba009.xiladd (mgr.34457) 2809 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:01 gibba009 bash[26136]: cluster 2021-03-10T21:03:00.309598+0000 mgr.gibba009.xiladd (mgr.34457) 2809 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:03 gibba004 bash[30897]: cluster 2021-03-10T21:03:02.311256+0000 mgr.gibba009.xiladd (mgr.34457) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:04.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:03 gibba004 bash[31878]: cluster 2021-03-10T21:03:02.311256+0000 mgr.gibba009.xiladd (mgr.34457) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:03 gibba009 bash[26136]: cluster 2021-03-10T21:03:02.311256+0000 mgr.gibba009.xiladd (mgr.34457) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:06.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:06 gibba004 bash[30897]: cluster 2021-03-10T21:03:04.312552+0000 mgr.gibba009.xiladd (mgr.34457) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:06.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:06 gibba004 bash[31878]: cluster 2021-03-10T21:03:04.312552+0000 mgr.gibba009.xiladd (mgr.34457) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:06 gibba009 bash[26136]: cluster 2021-03-10T21:03:04.312552+0000 mgr.gibba009.xiladd (mgr.34457) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:08 gibba004 bash[30897]: cluster 2021-03-10T21:03:06.314287+0000 mgr.gibba009.xiladd (mgr.34457) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:08.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:08 gibba004 bash[31878]: cluster 2021-03-10T21:03:06.314287+0000 mgr.gibba009.xiladd (mgr.34457) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:08 gibba009 bash[26136]: cluster 2021-03-10T21:03:06.314287+0000 mgr.gibba009.xiladd (mgr.34457) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:08.887 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:03:09.119 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:03:09.119 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (52m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:03:09.120 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:03:09.120 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:03:09.120 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:03:09.121 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:03:09.121 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:03:09.122 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:03:09.122 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:03:09.123 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:03:09.123 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:03:09.123 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:03:09.124 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:03:09.124 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:03:09.125 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:03:09.125 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:03:09.126 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:03:09.126 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:03:09.126 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:03:09.127 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (56m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:03:09.127 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:09.128 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:09.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:09 gibba004 bash[30897]: cephadm 2021-03-10T21:03:07.703686+0000 mgr.gibba009.xiladd (mgr.34457) 2813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:09.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:09 gibba004 bash[31878]: cephadm 2021-03-10T21:03:07.703686+0000 mgr.gibba009.xiladd (mgr.34457) 2813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:09.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:09 gibba009 bash[26136]: cephadm 2021-03-10T21:03:07.703686+0000 mgr.gibba009.xiladd (mgr.34457) 2813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:09.370 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:03:09.371 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:03:09.371 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:09.371 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:09.371 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:03:09.372 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:09.372 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:09.372 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:03:09.372 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:03:09.373 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:09.373 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:03:09.373 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:03:09.373 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:03:09.373 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:03:09.374 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:03:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[30897]: cluster 2021-03-10T21:03:08.315996+0000 mgr.gibba009.xiladd (mgr.34457) 2814 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:10.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[30897]: audit 2021-03-10T21:03:08.874304+0000 mgr.gibba009.xiladd (mgr.34457) 2815 : audit [DBG] from='client.55927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[30897]: audit 2021-03-10T21:03:09.102385+0000 mgr.gibba009.xiladd (mgr.34457) 2816 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[30897]: audit 2021-03-10T21:03:09.366493+0000 mon.a (mon.0) 988 : audit [DBG] from='client.? 172.21.2.104:0/2579882328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:10.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[31878]: cluster 2021-03-10T21:03:08.315996+0000 mgr.gibba009.xiladd (mgr.34457) 2814 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:10.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[31878]: audit 2021-03-10T21:03:08.874304+0000 mgr.gibba009.xiladd (mgr.34457) 2815 : audit [DBG] from='client.55927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[31878]: audit 2021-03-10T21:03:09.102385+0000 mgr.gibba009.xiladd (mgr.34457) 2816 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:10 gibba004 bash[31878]: audit 2021-03-10T21:03:09.366493+0000 mon.a (mon.0) 988 : audit [DBG] from='client.? 172.21.2.104:0/2579882328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:10 gibba009 bash[26136]: cluster 2021-03-10T21:03:08.315996+0000 mgr.gibba009.xiladd (mgr.34457) 2814 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:10.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:10 gibba009 bash[26136]: audit 2021-03-10T21:03:08.874304+0000 mgr.gibba009.xiladd (mgr.34457) 2815 : audit [DBG] from='client.55927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:10 gibba009 bash[26136]: audit 2021-03-10T21:03:09.102385+0000 mgr.gibba009.xiladd (mgr.34457) 2816 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:10.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:10 gibba009 bash[26136]: audit 2021-03-10T21:03:09.366493+0000 mon.a (mon.0) 988 : audit [DBG] from='client.? 172.21.2.104:0/2579882328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:11 gibba004 bash[30897]: cluster 2021-03-10T21:03:10.317532+0000 mgr.gibba009.xiladd (mgr.34457) 2817 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:11.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:11 gibba004 bash[31878]: cluster 2021-03-10T21:03:10.317532+0000 mgr.gibba009.xiladd (mgr.34457) 2817 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:11.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:11 gibba009 bash[26136]: cluster 2021-03-10T21:03:10.317532+0000 mgr.gibba009.xiladd (mgr.34457) 2817 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:13.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:13 gibba004 bash[30897]: cluster 2021-03-10T21:03:12.319210+0000 mgr.gibba009.xiladd (mgr.34457) 2818 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:13.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:13 gibba004 bash[31878]: cluster 2021-03-10T21:03:12.319210+0000 mgr.gibba009.xiladd (mgr.34457) 2818 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:13.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:13 gibba009 bash[26136]: cluster 2021-03-10T21:03:12.319210+0000 mgr.gibba009.xiladd (mgr.34457) 2818 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:16.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:15 gibba004 bash[30897]: cluster 2021-03-10T21:03:14.320446+0000 mgr.gibba009.xiladd (mgr.34457) 2819 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:15 gibba004 bash[31878]: cluster 2021-03-10T21:03:14.320446+0000 mgr.gibba009.xiladd (mgr.34457) 2819 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:15 gibba009 bash[26136]: cluster 2021-03-10T21:03:14.320446+0000 mgr.gibba009.xiladd (mgr.34457) 2819 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:18.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:17 gibba004 bash[30897]: cluster 2021-03-10T21:03:16.322289+0000 mgr.gibba009.xiladd (mgr.34457) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:18.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:17 gibba004 bash[31878]: cluster 2021-03-10T21:03:16.322289+0000 mgr.gibba009.xiladd (mgr.34457) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:17 gibba009 bash[26136]: cluster 2021-03-10T21:03:16.322289+0000 mgr.gibba009.xiladd (mgr.34457) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:20.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:19 gibba004 bash[30897]: cluster 2021-03-10T21:03:18.323814+0000 mgr.gibba009.xiladd (mgr.34457) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:20.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:19 gibba004 bash[31878]: cluster 2021-03-10T21:03:18.323814+0000 mgr.gibba009.xiladd (mgr.34457) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:19 gibba009 bash[26136]: cluster 2021-03-10T21:03:18.323814+0000 mgr.gibba009.xiladd (mgr.34457) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:22 gibba004 bash[30897]: cluster 2021-03-10T21:03:20.325374+0000 mgr.gibba009.xiladd (mgr.34457) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:22 gibba004 bash[31878]: cluster 2021-03-10T21:03:20.325374+0000 mgr.gibba009.xiladd (mgr.34457) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:22 gibba009 bash[26136]: cluster 2021-03-10T21:03:20.325374+0000 mgr.gibba009.xiladd (mgr.34457) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:24 gibba004 bash[30897]: cluster 2021-03-10T21:03:22.326915+0000 mgr.gibba009.xiladd (mgr.34457) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:24 gibba004 bash[30897]: cephadm 2021-03-10T21:03:22.719708+0000 mgr.gibba009.xiladd (mgr.34457) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:24.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:24 gibba004 bash[31878]: cluster 2021-03-10T21:03:22.326915+0000 mgr.gibba009.xiladd (mgr.34457) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:24 gibba004 bash[31878]: cephadm 2021-03-10T21:03:22.719708+0000 mgr.gibba009.xiladd (mgr.34457) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:24 gibba009 bash[26136]: cluster 2021-03-10T21:03:22.326915+0000 mgr.gibba009.xiladd (mgr.34457) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:24 gibba009 bash[26136]: cephadm 2021-03-10T21:03:22.719708+0000 mgr.gibba009.xiladd (mgr.34457) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:26.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:26 gibba004 bash[30897]: cluster 2021-03-10T21:03:24.328133+0000 mgr.gibba009.xiladd (mgr.34457) 2825 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:26 gibba004 bash[31878]: cluster 2021-03-10T21:03:24.328133+0000 mgr.gibba009.xiladd (mgr.34457) 2825 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:26 gibba009 bash[26136]: cluster 2021-03-10T21:03:24.328133+0000 mgr.gibba009.xiladd (mgr.34457) 2825 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:28 gibba004 bash[30897]: cluster 2021-03-10T21:03:26.329957+0000 mgr.gibba009.xiladd (mgr.34457) 2826 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:28 gibba004 bash[31878]: cluster 2021-03-10T21:03:26.329957+0000 mgr.gibba009.xiladd (mgr.34457) 2826 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:28 gibba009 bash[26136]: cluster 2021-03-10T21:03:26.329957+0000 mgr.gibba009.xiladd (mgr.34457) 2826 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:29.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:29 gibba004 bash[30897]: cluster 2021-03-10T21:03:28.331616+0000 mgr.gibba009.xiladd (mgr.34457) 2827 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:29.690 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:29 gibba004 bash[31878]: cluster 2021-03-10T21:03:28.331616+0000 mgr.gibba009.xiladd (mgr.34457) 2827 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:29.691 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:29 gibba009 bash[26136]: cluster 2021-03-10T21:03:28.331616+0000 mgr.gibba009.xiladd (mgr.34457) 2827 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:31 gibba004 bash[30897]: cluster 2021-03-10T21:03:30.333236+0000 mgr.gibba009.xiladd (mgr.34457) 2828 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:31 gibba004 bash[31878]: cluster 2021-03-10T21:03:30.333236+0000 mgr.gibba009.xiladd (mgr.34457) 2828 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:31 gibba009 bash[26136]: cluster 2021-03-10T21:03:30.333236+0000 mgr.gibba009.xiladd (mgr.34457) 2828 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:34.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:33 gibba004 bash[30897]: cluster 2021-03-10T21:03:32.334850+0000 mgr.gibba009.xiladd (mgr.34457) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:34.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:33 gibba004 bash[31878]: cluster 2021-03-10T21:03:32.334850+0000 mgr.gibba009.xiladd (mgr.34457) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:33 gibba009 bash[26136]: cluster 2021-03-10T21:03:32.334850+0000 mgr.gibba009.xiladd (mgr.34457) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:36 gibba004 bash[30897]: cluster 2021-03-10T21:03:34.336081+0000 mgr.gibba009.xiladd (mgr.34457) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:36 gibba004 bash[31878]: cluster 2021-03-10T21:03:34.336081+0000 mgr.gibba009.xiladd (mgr.34457) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:36 gibba009 bash[26136]: cluster 2021-03-10T21:03:34.336081+0000 mgr.gibba009.xiladd (mgr.34457) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: cluster 2021-03-10T21:03:36.337982+0000 mgr.gibba009.xiladd (mgr.34457) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.737386+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.954250+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:03:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.958206+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.959612+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.960761+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.961849+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.964692+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[30897]: audit 2021-03-10T21:03:37.966005+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: cluster 2021-03-10T21:03:36.337982+0000 mgr.gibba009.xiladd (mgr.34457) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.737386+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.954250+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:03:38.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.958206+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.959612+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.960761+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.961849+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.964692+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:38 gibba004 bash[31878]: audit 2021-03-10T21:03:37.966005+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: cluster 2021-03-10T21:03:36.337982+0000 mgr.gibba009.xiladd (mgr.34457) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.737386+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.954250+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:03:38.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.958206+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.959612+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.960761+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.961849+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.964692+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:38.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:38 gibba009 bash[26136]: audit 2021-03-10T21:03:37.966005+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.742383+0000 mgr.gibba009.xiladd (mgr.34457) 2832 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:03:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.744179+0000 mgr.gibba009.xiladd (mgr.34457) 2833 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:03:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.956929+0000 mgr.gibba009.xiladd (mgr.34457) 2834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.958736+0000 mgr.gibba009.xiladd (mgr.34457) 2835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.959767+0000 mgr.gibba009.xiladd (mgr.34457) 2836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.959805+0000 mgr.gibba009.xiladd (mgr.34457) 2837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.960835+0000 mgr.gibba009.xiladd (mgr.34457) 2838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:39.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.960874+0000 mgr.gibba009.xiladd (mgr.34457) 2839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.962023+0000 mgr.gibba009.xiladd (mgr.34457) 2840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.963616+0000 mgr.gibba009.xiladd (mgr.34457) 2841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:39.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.963655+0000 mgr.gibba009.xiladd (mgr.34457) 2842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.964790+0000 mgr.gibba009.xiladd (mgr.34457) 2843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.965114+0000 mgr.gibba009.xiladd (mgr.34457) 2844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.966107+0000 mgr.gibba009.xiladd (mgr.34457) 2845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:39.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.966143+0000 mgr.gibba009.xiladd (mgr.34457) 2846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:39.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[30897]: cephadm 2021-03-10T21:03:37.966264+0000 mgr.gibba009.xiladd (mgr.34457) 2847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.742383+0000 mgr.gibba009.xiladd (mgr.34457) 2832 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:03:39.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.744179+0000 mgr.gibba009.xiladd (mgr.34457) 2833 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:03:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.956929+0000 mgr.gibba009.xiladd (mgr.34457) 2834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.958736+0000 mgr.gibba009.xiladd (mgr.34457) 2835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.959767+0000 mgr.gibba009.xiladd (mgr.34457) 2836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.959805+0000 mgr.gibba009.xiladd (mgr.34457) 2837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:39.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.960835+0000 mgr.gibba009.xiladd (mgr.34457) 2838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.960874+0000 mgr.gibba009.xiladd (mgr.34457) 2839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:39.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.962023+0000 mgr.gibba009.xiladd (mgr.34457) 2840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.963616+0000 mgr.gibba009.xiladd (mgr.34457) 2841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.963655+0000 mgr.gibba009.xiladd (mgr.34457) 2842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.964790+0000 mgr.gibba009.xiladd (mgr.34457) 2843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:39.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.965114+0000 mgr.gibba009.xiladd (mgr.34457) 2844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.966107+0000 mgr.gibba009.xiladd (mgr.34457) 2845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.966143+0000 mgr.gibba009.xiladd (mgr.34457) 2846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:39.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:39 gibba004 bash[31878]: cephadm 2021-03-10T21:03:37.966264+0000 mgr.gibba009.xiladd (mgr.34457) 2847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:39.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.742383+0000 mgr.gibba009.xiladd (mgr.34457) 2832 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:03:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.744179+0000 mgr.gibba009.xiladd (mgr.34457) 2833 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:03:39.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.956929+0000 mgr.gibba009.xiladd (mgr.34457) 2834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.958736+0000 mgr.gibba009.xiladd (mgr.34457) 2835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.959767+0000 mgr.gibba009.xiladd (mgr.34457) 2836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.959805+0000 mgr.gibba009.xiladd (mgr.34457) 2837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:39.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.960835+0000 mgr.gibba009.xiladd (mgr.34457) 2838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.960874+0000 mgr.gibba009.xiladd (mgr.34457) 2839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.962023+0000 mgr.gibba009.xiladd (mgr.34457) 2840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.963616+0000 mgr.gibba009.xiladd (mgr.34457) 2841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:39.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.963655+0000 mgr.gibba009.xiladd (mgr.34457) 2842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.964790+0000 mgr.gibba009.xiladd (mgr.34457) 2843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.965114+0000 mgr.gibba009.xiladd (mgr.34457) 2844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.966107+0000 mgr.gibba009.xiladd (mgr.34457) 2845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:39.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.966143+0000 mgr.gibba009.xiladd (mgr.34457) 2846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:39.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:39 gibba009 bash[26136]: cephadm 2021-03-10T21:03:37.966264+0000 mgr.gibba009.xiladd (mgr.34457) 2847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:39.612 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:03:39.840 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:03:39.841 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (52m) 8m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:03:39.841 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (57m) 7m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:03:39.841 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:03:39.841 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:03:39.842 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:03:39.842 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:03:39.842 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:03:39.842 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:03:39.843 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:03:39.843 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:03:39.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:03:39.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:03:39.843 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:03:39.844 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (49m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:03:39.844 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:03:39.844 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:03:39.844 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (48m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:03:39.844 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (47m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:03:39.845 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (57m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:03:39.845 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:39.845 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:40.095 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:03:40.096 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:03:40.096 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:40.097 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:40.097 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:03:40.098 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:40.098 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:40.099 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:03:40.099 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:03:40.100 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:03:40.100 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:03:40.101 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:03:40.101 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:03:40.102 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:03:40.102 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:03:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: cluster 2021-03-10T21:03:38.339319+0000 mgr.gibba009.xiladd (mgr.34457) 2848 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.599449+0000 mgr.gibba009.xiladd (mgr.34457) 2849 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.824093+0000 mgr.gibba009.xiladd (mgr.34457) 2850 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.900682+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.900966+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.901314+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.901705+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.920762+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.920979+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.921156+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.921210+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.921373+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:40.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.921548+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.921797+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[30897]: audit 2021-03-10T21:03:39.922018+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: cluster 2021-03-10T21:03:38.339319+0000 mgr.gibba009.xiladd (mgr.34457) 2848 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:40.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.599449+0000 mgr.gibba009.xiladd (mgr.34457) 2849 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.824093+0000 mgr.gibba009.xiladd (mgr.34457) 2850 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.900682+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.900966+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.901314+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.901705+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.920762+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.329 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.920979+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.921156+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.921210+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.331 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.921373+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:40.331 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.921548+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.331 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.921797+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.332 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:40 gibba004 bash[31878]: audit 2021-03-10T21:03:39.922018+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: cluster 2021-03-10T21:03:38.339319+0000 mgr.gibba009.xiladd (mgr.34457) 2848 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.599449+0000 mgr.gibba009.xiladd (mgr.34457) 2849 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.824093+0000 mgr.gibba009.xiladd (mgr.34457) 2850 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.900682+0000 mon.c (mon.1) 838 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.900966+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.901314+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.901705+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.920762+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.920979+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.921156+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.921210+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:03:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.921373+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.921548+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.921797+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:03:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:40 gibba009 bash[26136]: audit 2021-03-10T21:03:39.922018+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:03:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:41 gibba004 bash[30897]: audit 2021-03-10T21:03:40.091518+0000 mon.c (mon.1) 844 : audit [DBG] from='client.? 172.21.2.104:0/495741265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:41 gibba004 bash[30897]: cluster 2021-03-10T21:03:40.340705+0000 mgr.gibba009.xiladd (mgr.34457) 2851 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:41.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:41 gibba004 bash[31878]: audit 2021-03-10T21:03:40.091518+0000 mon.c (mon.1) 844 : audit [DBG] from='client.? 172.21.2.104:0/495741265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:41.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:41 gibba004 bash[31878]: cluster 2021-03-10T21:03:40.340705+0000 mgr.gibba009.xiladd (mgr.34457) 2851 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:41.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:41 gibba009 bash[26136]: audit 2021-03-10T21:03:40.091518+0000 mon.c (mon.1) 844 : audit [DBG] from='client.? 172.21.2.104:0/495741265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:41.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:41 gibba009 bash[26136]: cluster 2021-03-10T21:03:40.340705+0000 mgr.gibba009.xiladd (mgr.34457) 2851 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:43 gibba004 bash[30897]: cluster 2021-03-10T21:03:42.342323+0000 mgr.gibba009.xiladd (mgr.34457) 2852 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:43 gibba004 bash[31878]: cluster 2021-03-10T21:03:42.342323+0000 mgr.gibba009.xiladd (mgr.34457) 2852 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:43 gibba009 bash[26136]: cluster 2021-03-10T21:03:42.342323+0000 mgr.gibba009.xiladd (mgr.34457) 2852 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:45 gibba004 bash[30897]: cluster 2021-03-10T21:03:44.343710+0000 mgr.gibba009.xiladd (mgr.34457) 2853 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:45 gibba004 bash[31878]: cluster 2021-03-10T21:03:44.343710+0000 mgr.gibba009.xiladd (mgr.34457) 2853 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:45 gibba009 bash[26136]: cluster 2021-03-10T21:03:44.343710+0000 mgr.gibba009.xiladd (mgr.34457) 2853 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:48 gibba004 bash[30897]: cluster 2021-03-10T21:03:46.345544+0000 mgr.gibba009.xiladd (mgr.34457) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:48 gibba004 bash[31878]: cluster 2021-03-10T21:03:46.345544+0000 mgr.gibba009.xiladd (mgr.34457) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:48 gibba009 bash[26136]: cluster 2021-03-10T21:03:46.345544+0000 mgr.gibba009.xiladd (mgr.34457) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:50 gibba004 bash[30897]: cluster 2021-03-10T21:03:48.347143+0000 mgr.gibba009.xiladd (mgr.34457) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:50 gibba004 bash[31878]: cluster 2021-03-10T21:03:48.347143+0000 mgr.gibba009.xiladd (mgr.34457) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:50 gibba009 bash[26136]: cluster 2021-03-10T21:03:48.347143+0000 mgr.gibba009.xiladd (mgr.34457) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:52.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:52 gibba004 bash[30897]: cluster 2021-03-10T21:03:50.348803+0000 mgr.gibba009.xiladd (mgr.34457) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:52 gibba004 bash[31878]: cluster 2021-03-10T21:03:50.348803+0000 mgr.gibba009.xiladd (mgr.34457) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:52 gibba009 bash[26136]: cluster 2021-03-10T21:03:50.348803+0000 mgr.gibba009.xiladd (mgr.34457) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:54.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:54 gibba004 bash[30897]: cluster 2021-03-10T21:03:52.350274+0000 mgr.gibba009.xiladd (mgr.34457) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:54.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:54 gibba004 bash[30897]: cephadm 2021-03-10T21:03:52.982337+0000 mgr.gibba009.xiladd (mgr.34457) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:54.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:54 gibba004 bash[31878]: cluster 2021-03-10T21:03:52.350274+0000 mgr.gibba009.xiladd (mgr.34457) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:54.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:54 gibba004 bash[31878]: cephadm 2021-03-10T21:03:52.982337+0000 mgr.gibba009.xiladd (mgr.34457) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:54 gibba009 bash[26136]: cluster 2021-03-10T21:03:52.350274+0000 mgr.gibba009.xiladd (mgr.34457) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:54 gibba009 bash[26136]: cephadm 2021-03-10T21:03:52.982337+0000 mgr.gibba009.xiladd (mgr.34457) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:03:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:56 gibba004 bash[30897]: cluster 2021-03-10T21:03:54.351542+0000 mgr.gibba009.xiladd (mgr.34457) 2859 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:56 gibba004 bash[31878]: cluster 2021-03-10T21:03:54.351542+0000 mgr.gibba009.xiladd (mgr.34457) 2859 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:56 gibba009 bash[26136]: cluster 2021-03-10T21:03:54.351542+0000 mgr.gibba009.xiladd (mgr.34457) 2859 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:57.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:57 gibba004 bash[30897]: cluster 2021-03-10T21:03:56.353440+0000 mgr.gibba009.xiladd (mgr.34457) 2860 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:57.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:57 gibba004 bash[31878]: cluster 2021-03-10T21:03:56.353440+0000 mgr.gibba009.xiladd (mgr.34457) 2860 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:57 gibba009 bash[26136]: cluster 2021-03-10T21:03:56.353440+0000 mgr.gibba009.xiladd (mgr.34457) 2860 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:59.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:03:59 gibba004 bash[30897]: cluster 2021-03-10T21:03:58.354855+0000 mgr.gibba009.xiladd (mgr.34457) 2861 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:03:59 gibba004 bash[31878]: cluster 2021-03-10T21:03:58.354855+0000 mgr.gibba009.xiladd (mgr.34457) 2861 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:59.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:03:59 gibba009 bash[26136]: cluster 2021-03-10T21:03:58.354855+0000 mgr.gibba009.xiladd (mgr.34457) 2861 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:02 gibba004 bash[30897]: cluster 2021-03-10T21:04:00.356516+0000 mgr.gibba009.xiladd (mgr.34457) 2862 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:02 gibba004 bash[31878]: cluster 2021-03-10T21:04:00.356516+0000 mgr.gibba009.xiladd (mgr.34457) 2862 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:02 gibba009 bash[26136]: cluster 2021-03-10T21:04:00.356516+0000 mgr.gibba009.xiladd (mgr.34457) 2862 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:04.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:04 gibba004 bash[30897]: cluster 2021-03-10T21:04:02.358008+0000 mgr.gibba009.xiladd (mgr.34457) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:04.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:04 gibba004 bash[31878]: cluster 2021-03-10T21:04:02.358008+0000 mgr.gibba009.xiladd (mgr.34457) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:04 gibba009 bash[26136]: cluster 2021-03-10T21:04:02.358008+0000 mgr.gibba009.xiladd (mgr.34457) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:06 gibba004 bash[30897]: cluster 2021-03-10T21:04:04.359249+0000 mgr.gibba009.xiladd (mgr.34457) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:06.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:06 gibba004 bash[31878]: cluster 2021-03-10T21:04:04.359249+0000 mgr.gibba009.xiladd (mgr.34457) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:06 gibba009 bash[26136]: cluster 2021-03-10T21:04:04.359249+0000 mgr.gibba009.xiladd (mgr.34457) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:08.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:08 gibba004 bash[30897]: cluster 2021-03-10T21:04:06.361151+0000 mgr.gibba009.xiladd (mgr.34457) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:08.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:08 gibba004 bash[31878]: cluster 2021-03-10T21:04:06.361151+0000 mgr.gibba009.xiladd (mgr.34457) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:08 gibba009 bash[26136]: cluster 2021-03-10T21:04:06.361151+0000 mgr.gibba009.xiladd (mgr.34457) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:09.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:09 gibba004 bash[30897]: cephadm 2021-03-10T21:04:07.986119+0000 mgr.gibba009.xiladd (mgr.34457) 2866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:09.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:09 gibba004 bash[31878]: cephadm 2021-03-10T21:04:07.986119+0000 mgr.gibba009.xiladd (mgr.34457) 2866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:09.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:09 gibba009 bash[26136]: cephadm 2021-03-10T21:04:07.986119+0000 mgr.gibba009.xiladd (mgr.34457) 2866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:10.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:10 gibba004 bash[30897]: cluster 2021-03-10T21:04:08.362696+0000 mgr.gibba009.xiladd (mgr.34457) 2867 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:10 gibba004 bash[31878]: cluster 2021-03-10T21:04:08.362696+0000 mgr.gibba009.xiladd (mgr.34457) 2867 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:10 gibba009 bash[26136]: cluster 2021-03-10T21:04:08.362696+0000 mgr.gibba009.xiladd (mgr.34457) 2867 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.342 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:04:10.584 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:04:10.584 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (53m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:04:10.585 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:04:10.585 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:04:10.585 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:04:10.585 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:04:10.585 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:04:10.586 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:04:10.586 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:04:10.586 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:04:10.586 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:04:10.587 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:04:10.587 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:04:10.587 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:04:10.587 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:04:10.588 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:04:10.588 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:04:10.588 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:04:10.588 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:04:10.589 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (58m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:04:10.589 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:10.589 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 7m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:10.832 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:04:10.832 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:04:10.833 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:10.833 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:10.833 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:04:10.833 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:10.834 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:10.834 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:04:10.834 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:04:10.834 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:10.834 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:04:10.835 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:04:10.835 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:04:10.835 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:04:10.835 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:04:11.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[30897]: audit 2021-03-10T21:04:10.330227+0000 mgr.gibba009.xiladd (mgr.34457) 2868 : audit [DBG] from='client.45984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[30897]: cluster 2021-03-10T21:04:10.364183+0000 mgr.gibba009.xiladd (mgr.34457) 2869 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[30897]: audit 2021-03-10T21:04:10.556299+0000 mgr.gibba009.xiladd (mgr.34457) 2870 : audit [DBG] from='client.45990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[30897]: audit 2021-03-10T21:04:10.829068+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.104:0/2794563307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:11.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[31878]: audit 2021-03-10T21:04:10.330227+0000 mgr.gibba009.xiladd (mgr.34457) 2868 : audit [DBG] from='client.45984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[31878]: cluster 2021-03-10T21:04:10.364183+0000 mgr.gibba009.xiladd (mgr.34457) 2869 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:11.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[31878]: audit 2021-03-10T21:04:10.556299+0000 mgr.gibba009.xiladd (mgr.34457) 2870 : audit [DBG] from='client.45990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:11 gibba004 bash[31878]: audit 2021-03-10T21:04:10.829068+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.104:0/2794563307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:11.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:11 gibba009 bash[26136]: audit 2021-03-10T21:04:10.330227+0000 mgr.gibba009.xiladd (mgr.34457) 2868 : audit [DBG] from='client.45984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:11 gibba009 bash[26136]: cluster 2021-03-10T21:04:10.364183+0000 mgr.gibba009.xiladd (mgr.34457) 2869 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:11.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:11 gibba009 bash[26136]: audit 2021-03-10T21:04:10.556299+0000 mgr.gibba009.xiladd (mgr.34457) 2870 : audit [DBG] from='client.45990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:11.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:11 gibba009 bash[26136]: audit 2021-03-10T21:04:10.829068+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.104:0/2794563307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:13.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:13 gibba004 bash[30897]: cluster 2021-03-10T21:04:12.365793+0000 mgr.gibba009.xiladd (mgr.34457) 2871 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:13.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:13 gibba004 bash[31878]: cluster 2021-03-10T21:04:12.365793+0000 mgr.gibba009.xiladd (mgr.34457) 2871 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:13.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:13 gibba009 bash[26136]: cluster 2021-03-10T21:04:12.365793+0000 mgr.gibba009.xiladd (mgr.34457) 2871 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:16.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:16 gibba004 bash[30897]: cluster 2021-03-10T21:04:14.367056+0000 mgr.gibba009.xiladd (mgr.34457) 2872 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:16 gibba004 bash[31878]: cluster 2021-03-10T21:04:14.367056+0000 mgr.gibba009.xiladd (mgr.34457) 2872 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:16 gibba009 bash[26136]: cluster 2021-03-10T21:04:14.367056+0000 mgr.gibba009.xiladd (mgr.34457) 2872 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:18.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:18 gibba004 bash[30897]: cluster 2021-03-10T21:04:16.368830+0000 mgr.gibba009.xiladd (mgr.34457) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:18 gibba004 bash[31878]: cluster 2021-03-10T21:04:16.368830+0000 mgr.gibba009.xiladd (mgr.34457) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:18 gibba009 bash[26136]: cluster 2021-03-10T21:04:16.368830+0000 mgr.gibba009.xiladd (mgr.34457) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:20 gibba004 bash[30897]: cluster 2021-03-10T21:04:18.370309+0000 mgr.gibba009.xiladd (mgr.34457) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:20.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:20 gibba004 bash[31878]: cluster 2021-03-10T21:04:18.370309+0000 mgr.gibba009.xiladd (mgr.34457) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:20 gibba009 bash[26136]: cluster 2021-03-10T21:04:18.370309+0000 mgr.gibba009.xiladd (mgr.34457) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:22 gibba004 bash[30897]: cluster 2021-03-10T21:04:20.371780+0000 mgr.gibba009.xiladd (mgr.34457) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:22 gibba004 bash[31878]: cluster 2021-03-10T21:04:20.371780+0000 mgr.gibba009.xiladd (mgr.34457) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:22.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:22 gibba009 bash[26136]: cluster 2021-03-10T21:04:20.371780+0000 mgr.gibba009.xiladd (mgr.34457) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:24 gibba004 bash[30897]: cluster 2021-03-10T21:04:22.373388+0000 mgr.gibba009.xiladd (mgr.34457) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:24.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:24 gibba004 bash[30897]: cephadm 2021-03-10T21:04:23.001240+0000 mgr.gibba009.xiladd (mgr.34457) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:24.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:24 gibba004 bash[31878]: cluster 2021-03-10T21:04:22.373388+0000 mgr.gibba009.xiladd (mgr.34457) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:24.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:24 gibba004 bash[31878]: cephadm 2021-03-10T21:04:23.001240+0000 mgr.gibba009.xiladd (mgr.34457) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:24.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:24 gibba009 bash[26136]: cluster 2021-03-10T21:04:22.373388+0000 mgr.gibba009.xiladd (mgr.34457) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:24.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:24 gibba009 bash[26136]: cephadm 2021-03-10T21:04:23.001240+0000 mgr.gibba009.xiladd (mgr.34457) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:26.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:26 gibba004 bash[30897]: cluster 2021-03-10T21:04:24.374625+0000 mgr.gibba009.xiladd (mgr.34457) 2878 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:26.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:26 gibba004 bash[31878]: cluster 2021-03-10T21:04:24.374625+0000 mgr.gibba009.xiladd (mgr.34457) 2878 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:26.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:26 gibba009 bash[26136]: cluster 2021-03-10T21:04:24.374625+0000 mgr.gibba009.xiladd (mgr.34457) 2878 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:28.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:28 gibba004 bash[30897]: cluster 2021-03-10T21:04:26.376446+0000 mgr.gibba009.xiladd (mgr.34457) 2879 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:28 gibba004 bash[31878]: cluster 2021-03-10T21:04:26.376446+0000 mgr.gibba009.xiladd (mgr.34457) 2879 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:28 gibba009 bash[26136]: cluster 2021-03-10T21:04:26.376446+0000 mgr.gibba009.xiladd (mgr.34457) 2879 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:30.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:30 gibba004 bash[30897]: cluster 2021-03-10T21:04:28.377954+0000 mgr.gibba009.xiladd (mgr.34457) 2880 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:30.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:30 gibba004 bash[31878]: cluster 2021-03-10T21:04:28.377954+0000 mgr.gibba009.xiladd (mgr.34457) 2880 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:30 gibba009 bash[26136]: cluster 2021-03-10T21:04:28.377954+0000 mgr.gibba009.xiladd (mgr.34457) 2880 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:32.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:32 gibba004 bash[30897]: cluster 2021-03-10T21:04:30.379431+0000 mgr.gibba009.xiladd (mgr.34457) 2881 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:32.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:32 gibba004 bash[31878]: cluster 2021-03-10T21:04:30.379431+0000 mgr.gibba009.xiladd (mgr.34457) 2881 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:32 gibba009 bash[26136]: cluster 2021-03-10T21:04:30.379431+0000 mgr.gibba009.xiladd (mgr.34457) 2881 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:34.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:34 gibba004 bash[30897]: cluster 2021-03-10T21:04:32.380980+0000 mgr.gibba009.xiladd (mgr.34457) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:34.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:34 gibba004 bash[31878]: cluster 2021-03-10T21:04:32.380980+0000 mgr.gibba009.xiladd (mgr.34457) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:34 gibba009 bash[26136]: cluster 2021-03-10T21:04:32.380980+0000 mgr.gibba009.xiladd (mgr.34457) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:36.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:36 gibba004 bash[30897]: cluster 2021-03-10T21:04:34.382207+0000 mgr.gibba009.xiladd (mgr.34457) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:36 gibba004 bash[31878]: cluster 2021-03-10T21:04:34.382207+0000 mgr.gibba009.xiladd (mgr.34457) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:36 gibba009 bash[26136]: cluster 2021-03-10T21:04:34.382207+0000 mgr.gibba009.xiladd (mgr.34457) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.307 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:38 gibba004 bash[30897]: cluster 2021-03-10T21:04:36.383729+0000 mgr.gibba009.xiladd (mgr.34457) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.308 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:38 gibba004 bash[30897]: audit 2021-03-10T21:04:38.014883+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:38.308 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:38 gibba004 bash[31878]: cluster 2021-03-10T21:04:36.383729+0000 mgr.gibba009.xiladd (mgr.34457) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.308 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:38 gibba004 bash[31878]: audit 2021-03-10T21:04:38.014883+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:38 gibba009 bash[26136]: cluster 2021-03-10T21:04:36.383729+0000 mgr.gibba009.xiladd (mgr.34457) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:38 gibba009 bash[26136]: audit 2021-03-10T21:04:38.014883+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:39 gibba004 bash[30897]: cephadm 2021-03-10T21:04:38.020415+0000 mgr.gibba009.xiladd (mgr.34457) 2885 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:04:39.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:39 gibba004 bash[30897]: audit 2021-03-10T21:04:38.021155+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:04:39.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:39 gibba004 bash[31878]: cephadm 2021-03-10T21:04:38.020415+0000 mgr.gibba009.xiladd (mgr.34457) 2885 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:04:39.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:39 gibba004 bash[31878]: audit 2021-03-10T21:04:38.021155+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:04:39.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:39 gibba009 bash[26136]: cephadm 2021-03-10T21:04:38.020415+0000 mgr.gibba009.xiladd (mgr.34457) 2885 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:04:39.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:39 gibba009 bash[26136]: audit 2021-03-10T21:04:38.021155+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:04:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: cluster 2021-03-10T21:04:38.385302+0000 mgr.gibba009.xiladd (mgr.34457) 2886 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.908431+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.909094+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.909540+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.910722+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.924453+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.925175+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.925582+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.925941+0000 mon.c (mon.1) 852 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.926830+0000 mon.c (mon.1) 853 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.926920+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.928119+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[30897]: audit 2021-03-10T21:04:39.928908+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: cluster 2021-03-10T21:04:38.385302+0000 mgr.gibba009.xiladd (mgr.34457) 2886 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.908431+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.909094+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.909540+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.910722+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.924453+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.925175+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.925582+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.925941+0000 mon.c (mon.1) 852 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.926830+0000 mon.c (mon.1) 853 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.926920+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.928119+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:40 gibba004 bash[31878]: audit 2021-03-10T21:04:39.928908+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: cluster 2021-03-10T21:04:38.385302+0000 mgr.gibba009.xiladd (mgr.34457) 2886 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.908431+0000 mon.c (mon.1) 848 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.909094+0000 mon.c (mon.1) 849 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.909540+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.910722+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.924453+0000 mon.c (mon.1) 850 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.925175+0000 mon.c (mon.1) 851 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.925582+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:04:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.925941+0000 mon.c (mon.1) 852 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.926830+0000 mon.c (mon.1) 853 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.926920+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:04:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.928119+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T21:04:40.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:40 gibba009 bash[26136]: audit 2021-03-10T21:04:39.928908+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T21:04:41.082 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:04:41.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:41 gibba004 bash[30897]: cluster 2021-03-10T21:04:40.386674+0000 mgr.gibba009.xiladd (mgr.34457) 2887 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:41.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:41 gibba004 bash[31878]: cluster 2021-03-10T21:04:40.386674+0000 mgr.gibba009.xiladd (mgr.34457) 2887 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:41.316 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:04:41.316 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (53m) 9m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:04:41.317 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (58m) 8m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:04:41.317 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:04:41.317 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:04:41.317 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:04:41.318 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:04:41.318 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:04:41.318 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:04:41.318 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:04:41.319 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:04:41.319 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:04:41.319 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:04:41.319 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:04:41.319 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:04:41.320 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:04:41.320 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:04:41.320 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (49m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:04:41.321 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (48m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:04:41.321 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (58m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:04:41.321 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:41.321 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:41.569 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:04:41.569 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:04:41.569 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:41.570 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:41.570 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:04:41.570 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:41.570 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:41.571 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:04:41.571 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:04:41.571 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:04:41.571 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:04:41.571 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:04:41.572 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:04:41.572 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:04:41.572 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:04:41.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:41 gibba009 bash[26136]: cluster 2021-03-10T21:04:40.386674+0000 mgr.gibba009.xiladd (mgr.34457) 2887 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:42.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[30897]: audit 2021-03-10T21:04:41.070912+0000 mgr.gibba009.xiladd (mgr.34457) 2888 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[30897]: audit 2021-03-10T21:04:41.300101+0000 mgr.gibba009.xiladd (mgr.34457) 2889 : audit [DBG] from='client.46008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[30897]: audit 2021-03-10T21:04:41.566003+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.104:0/2154574016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:42.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[31878]: audit 2021-03-10T21:04:41.070912+0000 mgr.gibba009.xiladd (mgr.34457) 2888 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[31878]: audit 2021-03-10T21:04:41.300101+0000 mgr.gibba009.xiladd (mgr.34457) 2889 : audit [DBG] from='client.46008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:42 gibba004 bash[31878]: audit 2021-03-10T21:04:41.566003+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.104:0/2154574016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:42.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:42 gibba009 bash[26136]: audit 2021-03-10T21:04:41.070912+0000 mgr.gibba009.xiladd (mgr.34457) 2888 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:42 gibba009 bash[26136]: audit 2021-03-10T21:04:41.300101+0000 mgr.gibba009.xiladd (mgr.34457) 2889 : audit [DBG] from='client.46008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:42.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:42 gibba009 bash[26136]: audit 2021-03-10T21:04:41.566003+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.2.104:0/2154574016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:43.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[30897]: cluster 2021-03-10T21:04:42.388148+0000 mgr.gibba009.xiladd (mgr.34457) 2890 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[30897]: audit 2021-03-10T21:04:42.749384+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[30897]: audit 2021-03-10T21:04:42.926026+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[30897]: cephadm 2021-03-10T21:04:42.928042+0000 mgr.gibba009.xiladd (mgr.34457) 2891 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:04:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[31878]: cluster 2021-03-10T21:04:42.388148+0000 mgr.gibba009.xiladd (mgr.34457) 2890 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[31878]: audit 2021-03-10T21:04:42.749384+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[31878]: audit 2021-03-10T21:04:42.926026+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:43 gibba004 bash[31878]: cephadm 2021-03-10T21:04:42.928042+0000 mgr.gibba009.xiladd (mgr.34457) 2891 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:04:43.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:43 gibba009 bash[26136]: cluster 2021-03-10T21:04:42.388148+0000 mgr.gibba009.xiladd (mgr.34457) 2890 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:43 gibba009 bash[26136]: audit 2021-03-10T21:04:42.749384+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:43.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:43 gibba009 bash[26136]: audit 2021-03-10T21:04:42.926026+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:43.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:43 gibba009 bash[26136]: cephadm 2021-03-10T21:04:42.928042+0000 mgr.gibba009.xiladd (mgr.34457) 2891 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:04:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.128606+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.136509+0000 mgr.gibba009.xiladd (mgr.34457) 2892 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.137685+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.137747+0000 mgr.gibba009.xiladd (mgr.34457) 2893 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:44.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.138547+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.138615+0000 mgr.gibba009.xiladd (mgr.34457) 2894 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.138687+0000 mgr.gibba009.xiladd (mgr.34457) 2895 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.139520+0000 mgr.gibba009.xiladd (mgr.34457) 2896 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:44.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.139563+0000 mgr.gibba009.xiladd (mgr.34457) 2897 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:44.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.139601+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.140219+0000 mgr.gibba009.xiladd (mgr.34457) 2898 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:44.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.140278+0000 mon.c (mon.1) 858 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.141274+0000 mgr.gibba009.xiladd (mgr.34457) 2899 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:44.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.141319+0000 mgr.gibba009.xiladd (mgr.34457) 2900 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:44.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.142256+0000 mon.c (mon.1) 859 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.142343+0000 mgr.gibba009.xiladd (mgr.34457) 2901 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:44.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.142744+0000 mgr.gibba009.xiladd (mgr.34457) 2902 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:44.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: audit 2021-03-10T21:04:43.143487+0000 mon.c (mon.1) 860 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.143559+0000 mgr.gibba009.xiladd (mgr.34457) 2903 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:44.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.143601+0000 mgr.gibba009.xiladd (mgr.34457) 2904 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:44.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[30897]: cephadm 2021-03-10T21:04:43.143734+0000 mgr.gibba009.xiladd (mgr.34457) 2905 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:44.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.128606+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:44.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.136509+0000 mgr.gibba009.xiladd (mgr.34457) 2892 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:44.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.137685+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:44.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.137747+0000 mgr.gibba009.xiladd (mgr.34457) 2893 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:44.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.138547+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.138615+0000 mgr.gibba009.xiladd (mgr.34457) 2894 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:44.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.138687+0000 mgr.gibba009.xiladd (mgr.34457) 2895 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:44.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.139520+0000 mgr.gibba009.xiladd (mgr.34457) 2896 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:44.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.139563+0000 mgr.gibba009.xiladd (mgr.34457) 2897 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:44.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.139601+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.140219+0000 mgr.gibba009.xiladd (mgr.34457) 2898 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:44.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.140278+0000 mon.c (mon.1) 858 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.141274+0000 mgr.gibba009.xiladd (mgr.34457) 2899 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:44.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.141319+0000 mgr.gibba009.xiladd (mgr.34457) 2900 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:44.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.142256+0000 mon.c (mon.1) 859 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.142343+0000 mgr.gibba009.xiladd (mgr.34457) 2901 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:44.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.142744+0000 mgr.gibba009.xiladd (mgr.34457) 2902 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:44.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: audit 2021-03-10T21:04:43.143487+0000 mon.c (mon.1) 860 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.143559+0000 mgr.gibba009.xiladd (mgr.34457) 2903 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:44.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.143601+0000 mgr.gibba009.xiladd (mgr.34457) 2904 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:44.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:44 gibba004 bash[31878]: cephadm 2021-03-10T21:04:43.143734+0000 mgr.gibba009.xiladd (mgr.34457) 2905 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:44.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.128606+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:04:44.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.136509+0000 mgr.gibba009.xiladd (mgr.34457) 2892 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:44.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.137685+0000 mon.c (mon.1) 855 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:44.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.137747+0000 mgr.gibba009.xiladd (mgr.34457) 2893 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:44.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.138547+0000 mon.c (mon.1) 856 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.138615+0000 mgr.gibba009.xiladd (mgr.34457) 2894 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:44.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.138687+0000 mgr.gibba009.xiladd (mgr.34457) 2895 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:44.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.139520+0000 mgr.gibba009.xiladd (mgr.34457) 2896 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:44.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.139563+0000 mgr.gibba009.xiladd (mgr.34457) 2897 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:44.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.139601+0000 mon.c (mon.1) 857 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.140219+0000 mgr.gibba009.xiladd (mgr.34457) 2898 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:44.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.140278+0000 mon.c (mon.1) 858 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.141274+0000 mgr.gibba009.xiladd (mgr.34457) 2899 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.141319+0000 mgr.gibba009.xiladd (mgr.34457) 2900 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.142256+0000 mon.c (mon.1) 859 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.142343+0000 mgr.gibba009.xiladd (mgr.34457) 2901 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.142744+0000 mgr.gibba009.xiladd (mgr.34457) 2902 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: audit 2021-03-10T21:04:43.143487+0000 mon.c (mon.1) 860 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.143559+0000 mgr.gibba009.xiladd (mgr.34457) 2903 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.143601+0000 mgr.gibba009.xiladd (mgr.34457) 2904 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:44.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:44 gibba009 bash[26136]: cephadm 2021-03-10T21:04:43.143734+0000 mgr.gibba009.xiladd (mgr.34457) 2905 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:04:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:46 gibba004 bash[30897]: cluster 2021-03-10T21:04:44.389507+0000 mgr.gibba009.xiladd (mgr.34457) 2906 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:46 gibba004 bash[31878]: cluster 2021-03-10T21:04:44.389507+0000 mgr.gibba009.xiladd (mgr.34457) 2906 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:46.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:46 gibba009 bash[26136]: cluster 2021-03-10T21:04:44.389507+0000 mgr.gibba009.xiladd (mgr.34457) 2906 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:48 gibba004 bash[30897]: cluster 2021-03-10T21:04:46.391035+0000 mgr.gibba009.xiladd (mgr.34457) 2907 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:48.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:48 gibba004 bash[31878]: cluster 2021-03-10T21:04:46.391035+0000 mgr.gibba009.xiladd (mgr.34457) 2907 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:48 gibba009 bash[26136]: cluster 2021-03-10T21:04:46.391035+0000 mgr.gibba009.xiladd (mgr.34457) 2907 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:50.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:50 gibba004 bash[30897]: cluster 2021-03-10T21:04:48.392875+0000 mgr.gibba009.xiladd (mgr.34457) 2908 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:50 gibba004 bash[31878]: cluster 2021-03-10T21:04:48.392875+0000 mgr.gibba009.xiladd (mgr.34457) 2908 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:50 gibba009 bash[26136]: cluster 2021-03-10T21:04:48.392875+0000 mgr.gibba009.xiladd (mgr.34457) 2908 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:52 gibba004 bash[30897]: cluster 2021-03-10T21:04:50.394506+0000 mgr.gibba009.xiladd (mgr.34457) 2909 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:52 gibba004 bash[31878]: cluster 2021-03-10T21:04:50.394506+0000 mgr.gibba009.xiladd (mgr.34457) 2909 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:52 gibba009 bash[26136]: cluster 2021-03-10T21:04:50.394506+0000 mgr.gibba009.xiladd (mgr.34457) 2909 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:53.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:53 gibba004 bash[30897]: cluster 2021-03-10T21:04:52.396224+0000 mgr.gibba009.xiladd (mgr.34457) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:53.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:53 gibba004 bash[31878]: cluster 2021-03-10T21:04:52.396224+0000 mgr.gibba009.xiladd (mgr.34457) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:53.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:53 gibba009 bash[26136]: cluster 2021-03-10T21:04:52.396224+0000 mgr.gibba009.xiladd (mgr.34457) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:56 gibba004 bash[30897]: cluster 2021-03-10T21:04:54.397712+0000 mgr.gibba009.xiladd (mgr.34457) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:56.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:56 gibba004 bash[31878]: cluster 2021-03-10T21:04:54.397712+0000 mgr.gibba009.xiladd (mgr.34457) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:56 gibba009 bash[26136]: cluster 2021-03-10T21:04:54.397712+0000 mgr.gibba009.xiladd (mgr.34457) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:58.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:04:58 gibba004 bash[30897]: cluster 2021-03-10T21:04:56.399473+0000 mgr.gibba009.xiladd (mgr.34457) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:04:58 gibba004 bash[31878]: cluster 2021-03-10T21:04:56.399473+0000 mgr.gibba009.xiladd (mgr.34457) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:58.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:04:58 gibba009 bash[26136]: cluster 2021-03-10T21:04:56.399473+0000 mgr.gibba009.xiladd (mgr.34457) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:00 gibba004 bash[30897]: cephadm 2021-03-10T21:04:58.159789+0000 mgr.gibba009.xiladd (mgr.34457) 2913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:00 gibba004 bash[30897]: cluster 2021-03-10T21:04:58.401047+0000 mgr.gibba009.xiladd (mgr.34457) 2914 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:00.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:00 gibba004 bash[31878]: cephadm 2021-03-10T21:04:58.159789+0000 mgr.gibba009.xiladd (mgr.34457) 2913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:00.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:00 gibba004 bash[31878]: cluster 2021-03-10T21:04:58.401047+0000 mgr.gibba009.xiladd (mgr.34457) 2914 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:00 gibba009 bash[26136]: cephadm 2021-03-10T21:04:58.159789+0000 mgr.gibba009.xiladd (mgr.34457) 2913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:00.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:00 gibba009 bash[26136]: cluster 2021-03-10T21:04:58.401047+0000 mgr.gibba009.xiladd (mgr.34457) 2914 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:02 gibba004 bash[30897]: cluster 2021-03-10T21:05:00.402585+0000 mgr.gibba009.xiladd (mgr.34457) 2915 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:02 gibba004 bash[31878]: cluster 2021-03-10T21:05:00.402585+0000 mgr.gibba009.xiladd (mgr.34457) 2915 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:02 gibba009 bash[26136]: cluster 2021-03-10T21:05:00.402585+0000 mgr.gibba009.xiladd (mgr.34457) 2915 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:03 gibba004 bash[30897]: cluster 2021-03-10T21:05:02.404144+0000 mgr.gibba009.xiladd (mgr.34457) 2916 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:03 gibba004 bash[31878]: cluster 2021-03-10T21:05:02.404144+0000 mgr.gibba009.xiladd (mgr.34457) 2916 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:03 gibba009 bash[26136]: cluster 2021-03-10T21:05:02.404144+0000 mgr.gibba009.xiladd (mgr.34457) 2916 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:06.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:06 gibba004 bash[30897]: cluster 2021-03-10T21:05:04.405601+0000 mgr.gibba009.xiladd (mgr.34457) 2917 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:06.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:06 gibba004 bash[31878]: cluster 2021-03-10T21:05:04.405601+0000 mgr.gibba009.xiladd (mgr.34457) 2917 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:06 gibba009 bash[26136]: cluster 2021-03-10T21:05:04.405601+0000 mgr.gibba009.xiladd (mgr.34457) 2917 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:08.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:08 gibba004 bash[30897]: cluster 2021-03-10T21:05:06.407576+0000 mgr.gibba009.xiladd (mgr.34457) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:08.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:08 gibba004 bash[31878]: cluster 2021-03-10T21:05:06.407576+0000 mgr.gibba009.xiladd (mgr.34457) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:08 gibba009 bash[26136]: cluster 2021-03-10T21:05:06.407576+0000 mgr.gibba009.xiladd (mgr.34457) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:10.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:10 gibba004 bash[30897]: cluster 2021-03-10T21:05:08.408982+0000 mgr.gibba009.xiladd (mgr.34457) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:10.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:10 gibba004 bash[31878]: cluster 2021-03-10T21:05:08.408982+0000 mgr.gibba009.xiladd (mgr.34457) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:10.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:10 gibba009 bash[26136]: cluster 2021-03-10T21:05:08.408982+0000 mgr.gibba009.xiladd (mgr.34457) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:11.816 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:05:12.050 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:05:12.051 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (54m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:05:12.051 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (59m) 8m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:05:12.051 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:05:12.051 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:05:12.052 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:05:12.052 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:05:12.052 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (53m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:05:12.052 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:05:12.053 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:05:12.053 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:05:12.053 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:05:12.053 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:05:12.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:05:12.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:05:12.054 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:05:12.055 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:05:12.055 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:05:12.055 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:05:12.055 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (59m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:05:12.056 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:12.056 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:12.298 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:05:12.299 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:05:12.299 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:12.299 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:12.300 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:05:12.300 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:12.300 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:12.300 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:05:12.300 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:05:12.301 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:12.301 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:05:12.301 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:05:12.301 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:05:12.302 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:05:12.302 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:05:12.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:12 gibba004 bash[30897]: cluster 2021-03-10T21:05:10.410426+0000 mgr.gibba009.xiladd (mgr.34457) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:12.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:12 gibba004 bash[31878]: cluster 2021-03-10T21:05:10.410426+0000 mgr.gibba009.xiladd (mgr.34457) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:12 gibba009 bash[26136]: cluster 2021-03-10T21:05:10.410426+0000 mgr.gibba009.xiladd (mgr.34457) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:13.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[30897]: audit 2021-03-10T21:05:11.804603+0000 mgr.gibba009.xiladd (mgr.34457) 2921 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[30897]: audit 2021-03-10T21:05:12.033826+0000 mgr.gibba009.xiladd (mgr.34457) 2922 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[30897]: audit 2021-03-10T21:05:12.295515+0000 mon.c (mon.1) 861 : audit [DBG] from='client.? 172.21.2.104:0/90138044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:13.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[31878]: audit 2021-03-10T21:05:11.804603+0000 mgr.gibba009.xiladd (mgr.34457) 2921 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[31878]: audit 2021-03-10T21:05:12.033826+0000 mgr.gibba009.xiladd (mgr.34457) 2922 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:13 gibba004 bash[31878]: audit 2021-03-10T21:05:12.295515+0000 mon.c (mon.1) 861 : audit [DBG] from='client.? 172.21.2.104:0/90138044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:13.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:13 gibba009 bash[26136]: audit 2021-03-10T21:05:11.804603+0000 mgr.gibba009.xiladd (mgr.34457) 2921 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:13 gibba009 bash[26136]: audit 2021-03-10T21:05:12.033826+0000 mgr.gibba009.xiladd (mgr.34457) 2922 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:13.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:13 gibba009 bash[26136]: audit 2021-03-10T21:05:12.295515+0000 mon.c (mon.1) 861 : audit [DBG] from='client.? 172.21.2.104:0/90138044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:14.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:14 gibba004 bash[30897]: cluster 2021-03-10T21:05:12.411912+0000 mgr.gibba009.xiladd (mgr.34457) 2923 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:14 gibba004 bash[30897]: cephadm 2021-03-10T21:05:13.175823+0000 mgr.gibba009.xiladd (mgr.34457) 2924 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:14.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:14 gibba004 bash[31878]: cluster 2021-03-10T21:05:12.411912+0000 mgr.gibba009.xiladd (mgr.34457) 2923 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:14 gibba004 bash[31878]: cephadm 2021-03-10T21:05:13.175823+0000 mgr.gibba009.xiladd (mgr.34457) 2924 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:14 gibba009 bash[26136]: cluster 2021-03-10T21:05:12.411912+0000 mgr.gibba009.xiladd (mgr.34457) 2923 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:14 gibba009 bash[26136]: cephadm 2021-03-10T21:05:13.175823+0000 mgr.gibba009.xiladd (mgr.34457) 2924 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:16.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:16 gibba004 bash[30897]: cluster 2021-03-10T21:05:14.413370+0000 mgr.gibba009.xiladd (mgr.34457) 2925 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:16.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:16 gibba004 bash[31878]: cluster 2021-03-10T21:05:14.413370+0000 mgr.gibba009.xiladd (mgr.34457) 2925 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:16 gibba009 bash[26136]: cluster 2021-03-10T21:05:14.413370+0000 mgr.gibba009.xiladd (mgr.34457) 2925 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:18.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:18 gibba004 bash[30897]: cluster 2021-03-10T21:05:16.414925+0000 mgr.gibba009.xiladd (mgr.34457) 2926 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:18.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:18 gibba004 bash[31878]: cluster 2021-03-10T21:05:16.414925+0000 mgr.gibba009.xiladd (mgr.34457) 2926 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:18 gibba009 bash[26136]: cluster 2021-03-10T21:05:16.414925+0000 mgr.gibba009.xiladd (mgr.34457) 2926 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:20.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:20 gibba004 bash[30897]: cluster 2021-03-10T21:05:18.416242+0000 mgr.gibba009.xiladd (mgr.34457) 2927 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:20.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:20 gibba004 bash[31878]: cluster 2021-03-10T21:05:18.416242+0000 mgr.gibba009.xiladd (mgr.34457) 2927 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:20.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:20 gibba009 bash[26136]: cluster 2021-03-10T21:05:18.416242+0000 mgr.gibba009.xiladd (mgr.34457) 2927 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:22 gibba004 bash[30897]: cluster 2021-03-10T21:05:20.417834+0000 mgr.gibba009.xiladd (mgr.34457) 2928 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:22 gibba004 bash[31878]: cluster 2021-03-10T21:05:20.417834+0000 mgr.gibba009.xiladd (mgr.34457) 2928 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:22.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:22 gibba009 bash[26136]: cluster 2021-03-10T21:05:20.417834+0000 mgr.gibba009.xiladd (mgr.34457) 2928 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:23.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:23 gibba009 bash[26136]: cluster 2021-03-10T21:05:22.419184+0000 mgr.gibba009.xiladd (mgr.34457) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:23.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:23 gibba004 bash[30897]: cluster 2021-03-10T21:05:22.419184+0000 mgr.gibba009.xiladd (mgr.34457) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:23.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:23 gibba004 bash[31878]: cluster 2021-03-10T21:05:22.419184+0000 mgr.gibba009.xiladd (mgr.34457) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:26.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:26 gibba004 bash[30897]: cluster 2021-03-10T21:05:24.420377+0000 mgr.gibba009.xiladd (mgr.34457) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:26.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:26 gibba004 bash[31878]: cluster 2021-03-10T21:05:24.420377+0000 mgr.gibba009.xiladd (mgr.34457) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:26 gibba009 bash[26136]: cluster 2021-03-10T21:05:24.420377+0000 mgr.gibba009.xiladd (mgr.34457) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:28.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:28 gibba004 bash[30897]: cluster 2021-03-10T21:05:26.422141+0000 mgr.gibba009.xiladd (mgr.34457) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:28.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:28 gibba004 bash[31878]: cluster 2021-03-10T21:05:26.422141+0000 mgr.gibba009.xiladd (mgr.34457) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:28 gibba009 bash[26136]: cluster 2021-03-10T21:05:26.422141+0000 mgr.gibba009.xiladd (mgr.34457) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:30.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:30 gibba004 bash[30897]: cephadm 2021-03-10T21:05:28.179182+0000 mgr.gibba009.xiladd (mgr.34457) 2932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:30.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:30 gibba004 bash[30897]: cluster 2021-03-10T21:05:28.423670+0000 mgr.gibba009.xiladd (mgr.34457) 2933 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:30.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:30 gibba004 bash[31878]: cephadm 2021-03-10T21:05:28.179182+0000 mgr.gibba009.xiladd (mgr.34457) 2932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:30.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:30 gibba004 bash[31878]: cluster 2021-03-10T21:05:28.423670+0000 mgr.gibba009.xiladd (mgr.34457) 2933 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:30 gibba009 bash[26136]: cephadm 2021-03-10T21:05:28.179182+0000 mgr.gibba009.xiladd (mgr.34457) 2932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:30.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:30 gibba009 bash[26136]: cluster 2021-03-10T21:05:28.423670+0000 mgr.gibba009.xiladd (mgr.34457) 2933 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:31 gibba004 bash[30897]: cluster 2021-03-10T21:05:30.425360+0000 mgr.gibba009.xiladd (mgr.34457) 2934 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:31 gibba004 bash[31878]: cluster 2021-03-10T21:05:30.425360+0000 mgr.gibba009.xiladd (mgr.34457) 2934 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:31 gibba009 bash[26136]: cluster 2021-03-10T21:05:30.425360+0000 mgr.gibba009.xiladd (mgr.34457) 2934 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:33.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:33 gibba004 bash[30897]: cluster 2021-03-10T21:05:32.426912+0000 mgr.gibba009.xiladd (mgr.34457) 2935 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:34.224 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:33 gibba004 bash[31878]: cluster 2021-03-10T21:05:32.426912+0000 mgr.gibba009.xiladd (mgr.34457) 2935 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:34.225 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:33 gibba009 bash[26136]: cluster 2021-03-10T21:05:32.426912+0000 mgr.gibba009.xiladd (mgr.34457) 2935 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:36 gibba004 bash[30897]: cluster 2021-03-10T21:05:34.428131+0000 mgr.gibba009.xiladd (mgr.34457) 2936 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:36 gibba004 bash[31878]: cluster 2021-03-10T21:05:34.428131+0000 mgr.gibba009.xiladd (mgr.34457) 2936 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:36 gibba009 bash[26136]: cluster 2021-03-10T21:05:34.428131+0000 mgr.gibba009.xiladd (mgr.34457) 2936 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:38 gibba004 bash[30897]: cluster 2021-03-10T21:05:36.429812+0000 mgr.gibba009.xiladd (mgr.34457) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:38.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:38 gibba004 bash[31878]: cluster 2021-03-10T21:05:36.429812+0000 mgr.gibba009.xiladd (mgr.34457) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:38 gibba009 bash[26136]: cluster 2021-03-10T21:05:36.429812+0000 mgr.gibba009.xiladd (mgr.34457) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: cluster 2021-03-10T21:05:38.431451+0000 mgr.gibba009.xiladd (mgr.34457) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.915589+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.916289+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.916702+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.917954+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.932054+0000 mon.c (mon.1) 864 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.932741+0000 mon.c (mon.1) 865 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.933146+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.933395+0000 mon.c (mon.1) 866 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.934277+0000 mon.c (mon.1) 867 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.934652+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.935912+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[30897]: audit 2021-03-10T21:05:39.936743+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: cluster 2021-03-10T21:05:38.431451+0000 mgr.gibba009.xiladd (mgr.34457) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.915589+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.916289+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.916702+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.917954+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.932054+0000 mon.c (mon.1) 864 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.932741+0000 mon.c (mon.1) 865 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.933146+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.933395+0000 mon.c (mon.1) 866 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.934277+0000 mon.c (mon.1) 867 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.934652+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.935912+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:40 gibba004 bash[31878]: audit 2021-03-10T21:05:39.936743+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: cluster 2021-03-10T21:05:38.431451+0000 mgr.gibba009.xiladd (mgr.34457) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.915589+0000 mon.c (mon.1) 862 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.916289+0000 mon.c (mon.1) 863 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.916702+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.917954+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.932054+0000 mon.c (mon.1) 864 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.932741+0000 mon.c (mon.1) 865 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.933146+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T21:05:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.933395+0000 mon.c (mon.1) 866 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.934277+0000 mon.c (mon.1) 867 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.934652+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:05:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.935912+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:05:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:40 gibba009 bash[26136]: audit 2021-03-10T21:05:39.936743+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:05:42.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:42 gibba004 bash[30897]: cluster 2021-03-10T21:05:40.432293+0000 mgr.gibba009.xiladd (mgr.34457) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:42.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:42 gibba004 bash[31878]: cluster 2021-03-10T21:05:40.432293+0000 mgr.gibba009.xiladd (mgr.34457) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:42.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:42 gibba009 bash[26136]: cluster 2021-03-10T21:05:40.432293+0000 mgr.gibba009.xiladd (mgr.34457) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:42.542 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:05:42.771 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:05:42.771 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (54m) 10m ago 60m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:05:42.771 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (59m) 9m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:05:42.772 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:05:42.772 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:05:42.772 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:05:42.772 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:05:42.773 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:05:42.773 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (53m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:05:42.773 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (60m) 10m ago 60m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:05:42.773 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:05:42.773 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (52m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:05:42.774 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:05:42.774 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:05:42.774 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:05:42.774 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:05:42.775 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:05:42.775 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:05:42.775 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:05:42.776 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (59m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:05:42.776 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 10m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:42.776 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:43.021 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:05:43.021 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:05:43.021 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:43.022 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:43.022 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:05:43.022 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:43.022 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:43.023 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:05:43.023 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:05:43.023 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:05:43.023 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:05:43.023 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:05:43.024 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:05:43.024 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:05:43.024 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:05:43.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:43 gibba009 bash[26136]: cluster 2021-03-10T21:05:42.433842+0000 mgr.gibba009.xiladd (mgr.34457) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:43.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:43 gibba009 bash[26136]: audit 2021-03-10T21:05:42.529926+0000 mgr.gibba009.xiladd (mgr.34457) 2941 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:43 gibba009 bash[26136]: audit 2021-03-10T21:05:42.754813+0000 mgr.gibba009.xiladd (mgr.34457) 2942 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:43 gibba009 bash[26136]: audit 2021-03-10T21:05:43.017784+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.104:0/1313314968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[30897]: cluster 2021-03-10T21:05:42.433842+0000 mgr.gibba009.xiladd (mgr.34457) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[30897]: audit 2021-03-10T21:05:42.529926+0000 mgr.gibba009.xiladd (mgr.34457) 2941 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[30897]: audit 2021-03-10T21:05:42.754813+0000 mgr.gibba009.xiladd (mgr.34457) 2942 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[30897]: audit 2021-03-10T21:05:43.017784+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.104:0/1313314968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[31878]: cluster 2021-03-10T21:05:42.433842+0000 mgr.gibba009.xiladd (mgr.34457) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[31878]: audit 2021-03-10T21:05:42.529926+0000 mgr.gibba009.xiladd (mgr.34457) 2941 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[31878]: audit 2021-03-10T21:05:42.754813+0000 mgr.gibba009.xiladd (mgr.34457) 2942 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:43.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:43 gibba004 bash[31878]: audit 2021-03-10T21:05:43.017784+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.104:0/1313314968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:44 gibba009 bash[26136]: audit 2021-03-10T21:05:43.196727+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:44 gibba009 bash[26136]: cephadm 2021-03-10T21:05:43.203006+0000 mgr.gibba009.xiladd (mgr.34457) 2943 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:05:44.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:44 gibba009 bash[26136]: audit 2021-03-10T21:05:43.203847+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:05:44.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[30897]: audit 2021-03-10T21:05:43.196727+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[30897]: cephadm 2021-03-10T21:05:43.203006+0000 mgr.gibba009.xiladd (mgr.34457) 2943 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:05:44.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[30897]: audit 2021-03-10T21:05:43.203847+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:05:44.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[31878]: audit 2021-03-10T21:05:43.196727+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:44.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[31878]: cephadm 2021-03-10T21:05:43.203006+0000 mgr.gibba009.xiladd (mgr.34457) 2943 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:05:44.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:44 gibba004 bash[31878]: audit 2021-03-10T21:05:43.203847+0000 mon.c (mon.1) 869 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:05:46.315 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:46 gibba004 bash[31878]: cluster 2021-03-10T21:05:44.435060+0000 mgr.gibba009.xiladd (mgr.34457) 2944 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:46.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:46 gibba004 bash[30897]: cluster 2021-03-10T21:05:44.435060+0000 mgr.gibba009.xiladd (mgr.34457) 2944 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:46 gibba009 bash[26136]: cluster 2021-03-10T21:05:44.435060+0000 mgr.gibba009.xiladd (mgr.34457) 2944 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: cluster 2021-03-10T21:05:46.437018+0000 mgr.gibba009.xiladd (mgr.34457) 2945 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:46.848331+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: cephadm 2021-03-10T21:05:46.849054+0000 mgr.gibba009.xiladd (mgr.34457) 2946 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:05:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.051844+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.061388+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.064563+0000 mon.c (mon.1) 871 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.066987+0000 mon.c (mon.1) 872 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.069068+0000 mon.c (mon.1) 873 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.074665+0000 mon.c (mon.1) 874 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[30897]: audit 2021-03-10T21:05:47.077375+0000 mon.c (mon.1) 875 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: cluster 2021-03-10T21:05:46.437018+0000 mgr.gibba009.xiladd (mgr.34457) 2945 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:46.848331+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: cephadm 2021-03-10T21:05:46.849054+0000 mgr.gibba009.xiladd (mgr.34457) 2946 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:05:48.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.051844+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.061388+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.064563+0000 mon.c (mon.1) 871 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.066987+0000 mon.c (mon.1) 872 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.069068+0000 mon.c (mon.1) 873 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.074665+0000 mon.c (mon.1) 874 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:47 gibba004 bash[31878]: audit 2021-03-10T21:05:47.077375+0000 mon.c (mon.1) 875 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: cluster 2021-03-10T21:05:46.437018+0000 mgr.gibba009.xiladd (mgr.34457) 2945 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:46.848331+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: cephadm 2021-03-10T21:05:46.849054+0000 mgr.gibba009.xiladd (mgr.34457) 2946 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:05:48.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.051844+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:05:48.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.061388+0000 mon.c (mon.1) 870 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.064563+0000 mon.c (mon.1) 871 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.066987+0000 mon.c (mon.1) 872 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.069068+0000 mon.c (mon.1) 873 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.074665+0000 mon.c (mon.1) 874 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:47 gibba009 bash[26136]: audit 2021-03-10T21:05:47.077375+0000 mon.c (mon.1) 875 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:49.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.059560+0000 mgr.gibba009.xiladd (mgr.34457) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:49.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.063362+0000 mgr.gibba009.xiladd (mgr.34457) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:49.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.065866+0000 mgr.gibba009.xiladd (mgr.34457) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:49.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.065906+0000 mgr.gibba009.xiladd (mgr.34457) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:49.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.068025+0000 mgr.gibba009.xiladd (mgr.34457) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:49.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.068066+0000 mgr.gibba009.xiladd (mgr.34457) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:49.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.070165+0000 mgr.gibba009.xiladd (mgr.34457) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:49.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.073427+0000 mgr.gibba009.xiladd (mgr.34457) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:49.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.073472+0000 mgr.gibba009.xiladd (mgr.34457) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:49.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.075783+0000 mgr.gibba009.xiladd (mgr.34457) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:49.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.076263+0000 mgr.gibba009.xiladd (mgr.34457) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:49.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.079377+0000 mgr.gibba009.xiladd (mgr.34457) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:49.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.079431+0000 mgr.gibba009.xiladd (mgr.34457) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:49.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[30897]: cephadm 2021-03-10T21:05:47.079615+0000 mgr.gibba009.xiladd (mgr.34457) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:49.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.059560+0000 mgr.gibba009.xiladd (mgr.34457) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:49.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.063362+0000 mgr.gibba009.xiladd (mgr.34457) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:49.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.065866+0000 mgr.gibba009.xiladd (mgr.34457) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:49.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.065906+0000 mgr.gibba009.xiladd (mgr.34457) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:49.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.068025+0000 mgr.gibba009.xiladd (mgr.34457) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:49.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.068066+0000 mgr.gibba009.xiladd (mgr.34457) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:49.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.070165+0000 mgr.gibba009.xiladd (mgr.34457) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:49.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.073427+0000 mgr.gibba009.xiladd (mgr.34457) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:49.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.073472+0000 mgr.gibba009.xiladd (mgr.34457) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:49.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.075783+0000 mgr.gibba009.xiladd (mgr.34457) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:49.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.076263+0000 mgr.gibba009.xiladd (mgr.34457) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:49.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.079377+0000 mgr.gibba009.xiladd (mgr.34457) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:49.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.079431+0000 mgr.gibba009.xiladd (mgr.34457) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:49.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:48 gibba004 bash[31878]: cephadm 2021-03-10T21:05:47.079615+0000 mgr.gibba009.xiladd (mgr.34457) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:49.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.059560+0000 mgr.gibba009.xiladd (mgr.34457) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:49.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.063362+0000 mgr.gibba009.xiladd (mgr.34457) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:49.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.065866+0000 mgr.gibba009.xiladd (mgr.34457) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:49.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.065906+0000 mgr.gibba009.xiladd (mgr.34457) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:49.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.068025+0000 mgr.gibba009.xiladd (mgr.34457) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:49.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.068066+0000 mgr.gibba009.xiladd (mgr.34457) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:49.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.070165+0000 mgr.gibba009.xiladd (mgr.34457) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:49.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.073427+0000 mgr.gibba009.xiladd (mgr.34457) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:49.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.073472+0000 mgr.gibba009.xiladd (mgr.34457) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:49.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.075783+0000 mgr.gibba009.xiladd (mgr.34457) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:49.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.076263+0000 mgr.gibba009.xiladd (mgr.34457) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:49.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.079377+0000 mgr.gibba009.xiladd (mgr.34457) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:49.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.079431+0000 mgr.gibba009.xiladd (mgr.34457) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:49.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:48 gibba009 bash[26136]: cephadm 2021-03-10T21:05:47.079615+0000 mgr.gibba009.xiladd (mgr.34457) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:05:50.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:49 gibba004 bash[30897]: cluster 2021-03-10T21:05:48.438544+0000 mgr.gibba009.xiladd (mgr.34457) 2961 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:50.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:49 gibba004 bash[31878]: cluster 2021-03-10T21:05:48.438544+0000 mgr.gibba009.xiladd (mgr.34457) 2961 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:49 gibba009 bash[26136]: cluster 2021-03-10T21:05:48.438544+0000 mgr.gibba009.xiladd (mgr.34457) 2961 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:52 gibba004 bash[30897]: cluster 2021-03-10T21:05:50.440144+0000 mgr.gibba009.xiladd (mgr.34457) 2962 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:52.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:52 gibba004 bash[31878]: cluster 2021-03-10T21:05:50.440144+0000 mgr.gibba009.xiladd (mgr.34457) 2962 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:52.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:52 gibba009 bash[26136]: cluster 2021-03-10T21:05:50.440144+0000 mgr.gibba009.xiladd (mgr.34457) 2962 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:54.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:54 gibba004 bash[30897]: cluster 2021-03-10T21:05:52.441771+0000 mgr.gibba009.xiladd (mgr.34457) 2963 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:54.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:54 gibba004 bash[31878]: cluster 2021-03-10T21:05:52.441771+0000 mgr.gibba009.xiladd (mgr.34457) 2963 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:54 gibba009 bash[26136]: cluster 2021-03-10T21:05:52.441771+0000 mgr.gibba009.xiladd (mgr.34457) 2963 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:56.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:56 gibba009 bash[26136]: cluster 2021-03-10T21:05:54.443032+0000 mgr.gibba009.xiladd (mgr.34457) 2964 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:56 gibba004 bash[30897]: cluster 2021-03-10T21:05:54.443032+0000 mgr.gibba009.xiladd (mgr.34457) 2964 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:56.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:56 gibba004 bash[31878]: cluster 2021-03-10T21:05:54.443032+0000 mgr.gibba009.xiladd (mgr.34457) 2964 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:57 gibba009 bash[26136]: cluster 2021-03-10T21:05:56.444810+0000 mgr.gibba009.xiladd (mgr.34457) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:57 gibba004 bash[30897]: cluster 2021-03-10T21:05:56.444810+0000 mgr.gibba009.xiladd (mgr.34457) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:57 gibba004 bash[31878]: cluster 2021-03-10T21:05:56.444810+0000 mgr.gibba009.xiladd (mgr.34457) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:59.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:05:59 gibba004 bash[30897]: cluster 2021-03-10T21:05:58.446425+0000 mgr.gibba009.xiladd (mgr.34457) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:59.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:05:59 gibba004 bash[31878]: cluster 2021-03-10T21:05:58.446425+0000 mgr.gibba009.xiladd (mgr.34457) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:59.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:05:59 gibba009 bash[26136]: cluster 2021-03-10T21:05:58.446425+0000 mgr.gibba009.xiladd (mgr.34457) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:02.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:02 gibba004 bash[30897]: cluster 2021-03-10T21:06:00.448012+0000 mgr.gibba009.xiladd (mgr.34457) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:02.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:02 gibba004 bash[31878]: cluster 2021-03-10T21:06:00.448012+0000 mgr.gibba009.xiladd (mgr.34457) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:02.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:02 gibba009 bash[26136]: cluster 2021-03-10T21:06:00.448012+0000 mgr.gibba009.xiladd (mgr.34457) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:04.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:04 gibba004 bash[30897]: cephadm 2021-03-10T21:06:02.087359+0000 mgr.gibba009.xiladd (mgr.34457) 2968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:04.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:04 gibba004 bash[30897]: cluster 2021-03-10T21:06:02.449306+0000 mgr.gibba009.xiladd (mgr.34457) 2969 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:04.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:04 gibba004 bash[31878]: cephadm 2021-03-10T21:06:02.087359+0000 mgr.gibba009.xiladd (mgr.34457) 2968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:04.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:04 gibba004 bash[31878]: cluster 2021-03-10T21:06:02.449306+0000 mgr.gibba009.xiladd (mgr.34457) 2969 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:04 gibba009 bash[26136]: cephadm 2021-03-10T21:06:02.087359+0000 mgr.gibba009.xiladd (mgr.34457) 2968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:04.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:04 gibba009 bash[26136]: cluster 2021-03-10T21:06:02.449306+0000 mgr.gibba009.xiladd (mgr.34457) 2969 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:06 gibba009 bash[26136]: cluster 2021-03-10T21:06:04.450582+0000 mgr.gibba009.xiladd (mgr.34457) 2970 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:06 gibba004 bash[30897]: cluster 2021-03-10T21:06:04.450582+0000 mgr.gibba009.xiladd (mgr.34457) 2970 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:06 gibba004 bash[31878]: cluster 2021-03-10T21:06:04.450582+0000 mgr.gibba009.xiladd (mgr.34457) 2970 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:07.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:07 gibba009 bash[26136]: cluster 2021-03-10T21:06:06.452324+0000 mgr.gibba009.xiladd (mgr.34457) 2971 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:07 gibba004 bash[30897]: cluster 2021-03-10T21:06:06.452324+0000 mgr.gibba009.xiladd (mgr.34457) 2971 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:07.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:07 gibba004 bash[31878]: cluster 2021-03-10T21:06:06.452324+0000 mgr.gibba009.xiladd (mgr.34457) 2971 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:09.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:09 gibba004 bash[30897]: cluster 2021-03-10T21:06:08.453976+0000 mgr.gibba009.xiladd (mgr.34457) 2972 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:09.817 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:09 gibba004 bash[31878]: cluster 2021-03-10T21:06:08.453976+0000 mgr.gibba009.xiladd (mgr.34457) 2972 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:09.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:09 gibba009 bash[26136]: cluster 2021-03-10T21:06:08.453976+0000 mgr.gibba009.xiladd (mgr.34457) 2972 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:12.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:12 gibba004 bash[30897]: cluster 2021-03-10T21:06:10.455653+0000 mgr.gibba009.xiladd (mgr.34457) 2973 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:12.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:12 gibba004 bash[31878]: cluster 2021-03-10T21:06:10.455653+0000 mgr.gibba009.xiladd (mgr.34457) 2973 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:12 gibba009 bash[26136]: cluster 2021-03-10T21:06:10.455653+0000 mgr.gibba009.xiladd (mgr.34457) 2973 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:13.271 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:06:13.498 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:06:13.499 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (55m) 26s ago 60m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:06:13.499 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:06:13.499 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:06:13.499 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:06:13.500 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (54m) 26s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:06:13.500 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (54m) 26s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:06:13.500 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (54m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:06:13.500 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (54m) 26s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:06:13.501 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (60m) 26s ago 60m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:06:13.501 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:06:13.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (53m) 26s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:06:13.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (53m) 26s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:06:13.501 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (52m) 26s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:06:13.502 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (52m) 26s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:06:13.502 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:06:13.502 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:06:13.502 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:06:13.503 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:06:13.503 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (60m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:06:13.503 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 26s ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:13.503 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:13.746 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:06:13.746 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:06:13.747 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:13.747 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:13.747 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:06:13.747 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:13.748 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:13.748 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:06:13.748 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:06:13.748 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:13.749 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:06:13.749 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:06:13.749 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:06:13.749 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:06:13.750 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:06:14.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:14 gibba004 bash[30897]: cluster 2021-03-10T21:06:12.457311+0000 mgr.gibba009.xiladd (mgr.34457) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:14.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:14 gibba004 bash[30897]: audit 2021-03-10T21:06:13.742488+0000 mon.a (mon.0) 1014 : audit [DBG] from='client.? 172.21.2.104:0/3436343769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:14.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:14 gibba004 bash[31878]: cluster 2021-03-10T21:06:12.457311+0000 mgr.gibba009.xiladd (mgr.34457) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:14.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:14 gibba004 bash[31878]: audit 2021-03-10T21:06:13.742488+0000 mon.a (mon.0) 1014 : audit [DBG] from='client.? 172.21.2.104:0/3436343769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:14 gibba009 bash[26136]: cluster 2021-03-10T21:06:12.457311+0000 mgr.gibba009.xiladd (mgr.34457) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:14 gibba009 bash[26136]: audit 2021-03-10T21:06:13.742488+0000 mon.a (mon.0) 1014 : audit [DBG] from='client.? 172.21.2.104:0/3436343769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:15.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:15 gibba004 bash[30897]: audit 2021-03-10T21:06:13.256183+0000 mgr.gibba009.xiladd (mgr.34457) 2975 : audit [DBG] from='client.56035 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:15.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:15 gibba004 bash[30897]: audit 2021-03-10T21:06:13.482227+0000 mgr.gibba009.xiladd (mgr.34457) 2976 : audit [DBG] from='client.46062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:15.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:15 gibba004 bash[31878]: audit 2021-03-10T21:06:13.256183+0000 mgr.gibba009.xiladd (mgr.34457) 2975 : audit [DBG] from='client.56035 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:15.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:15 gibba004 bash[31878]: audit 2021-03-10T21:06:13.482227+0000 mgr.gibba009.xiladd (mgr.34457) 2976 : audit [DBG] from='client.46062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:15.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:15 gibba009 bash[26136]: audit 2021-03-10T21:06:13.256183+0000 mgr.gibba009.xiladd (mgr.34457) 2975 : audit [DBG] from='client.56035 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:15.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:15 gibba009 bash[26136]: audit 2021-03-10T21:06:13.482227+0000 mgr.gibba009.xiladd (mgr.34457) 2976 : audit [DBG] from='client.46062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:16 gibba009 bash[26136]: cluster 2021-03-10T21:06:14.458576+0000 mgr.gibba009.xiladd (mgr.34457) 2977 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:16 gibba004 bash[30897]: cluster 2021-03-10T21:06:14.458576+0000 mgr.gibba009.xiladd (mgr.34457) 2977 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:16.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:16 gibba004 bash[31878]: cluster 2021-03-10T21:06:14.458576+0000 mgr.gibba009.xiladd (mgr.34457) 2977 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:17 gibba009 bash[26136]: cluster 2021-03-10T21:06:16.460172+0000 mgr.gibba009.xiladd (mgr.34457) 2978 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:17 gibba004 bash[30897]: cluster 2021-03-10T21:06:16.460172+0000 mgr.gibba009.xiladd (mgr.34457) 2978 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:17 gibba004 bash[31878]: cluster 2021-03-10T21:06:16.460172+0000 mgr.gibba009.xiladd (mgr.34457) 2978 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:18 gibba004 bash[30897]: cephadm 2021-03-10T21:06:17.101149+0000 mgr.gibba009.xiladd (mgr.34457) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:18.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:18 gibba004 bash[31878]: cephadm 2021-03-10T21:06:17.101149+0000 mgr.gibba009.xiladd (mgr.34457) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:18.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:18 gibba009 bash[26136]: cephadm 2021-03-10T21:06:17.101149+0000 mgr.gibba009.xiladd (mgr.34457) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:19.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:19 gibba004 bash[30897]: cluster 2021-03-10T21:06:18.461958+0000 mgr.gibba009.xiladd (mgr.34457) 2980 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:19.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:19 gibba004 bash[31878]: cluster 2021-03-10T21:06:18.461958+0000 mgr.gibba009.xiladd (mgr.34457) 2980 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:19.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:19 gibba009 bash[26136]: cluster 2021-03-10T21:06:18.461958+0000 mgr.gibba009.xiladd (mgr.34457) 2980 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:22.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:22 gibba004 bash[30897]: cluster 2021-03-10T21:06:20.463802+0000 mgr.gibba009.xiladd (mgr.34457) 2981 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:22.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:22 gibba004 bash[31878]: cluster 2021-03-10T21:06:20.463802+0000 mgr.gibba009.xiladd (mgr.34457) 2981 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:22.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:22 gibba009 bash[26136]: cluster 2021-03-10T21:06:20.463802+0000 mgr.gibba009.xiladd (mgr.34457) 2981 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:24.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:24 gibba009 bash[26136]: cluster 2021-03-10T21:06:22.465383+0000 mgr.gibba009.xiladd (mgr.34457) 2982 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:24.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:24 gibba004 bash[30897]: cluster 2021-03-10T21:06:22.465383+0000 mgr.gibba009.xiladd (mgr.34457) 2982 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:24.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:24 gibba004 bash[31878]: cluster 2021-03-10T21:06:22.465383+0000 mgr.gibba009.xiladd (mgr.34457) 2982 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:26 gibba009 bash[26136]: cluster 2021-03-10T21:06:24.466649+0000 mgr.gibba009.xiladd (mgr.34457) 2983 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:26 gibba004 bash[30897]: cluster 2021-03-10T21:06:24.466649+0000 mgr.gibba009.xiladd (mgr.34457) 2983 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:26.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:26 gibba004 bash[31878]: cluster 2021-03-10T21:06:24.466649+0000 mgr.gibba009.xiladd (mgr.34457) 2983 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:27 gibba009 bash[26136]: cluster 2021-03-10T21:06:26.468623+0000 mgr.gibba009.xiladd (mgr.34457) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:27 gibba004 bash[30897]: cluster 2021-03-10T21:06:26.468623+0000 mgr.gibba009.xiladd (mgr.34457) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:27 gibba004 bash[31878]: cluster 2021-03-10T21:06:26.468623+0000 mgr.gibba009.xiladd (mgr.34457) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:29.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:29 gibba004 bash[30897]: cluster 2021-03-10T21:06:28.470392+0000 mgr.gibba009.xiladd (mgr.34457) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:29.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:29 gibba004 bash[31878]: cluster 2021-03-10T21:06:28.470392+0000 mgr.gibba009.xiladd (mgr.34457) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:29.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:29 gibba009 bash[26136]: cluster 2021-03-10T21:06:28.470392+0000 mgr.gibba009.xiladd (mgr.34457) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:32.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:32 gibba004 bash[30897]: cluster 2021-03-10T21:06:30.471989+0000 mgr.gibba009.xiladd (mgr.34457) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:32.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:32 gibba004 bash[31878]: cluster 2021-03-10T21:06:30.471989+0000 mgr.gibba009.xiladd (mgr.34457) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:32.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:32 gibba009 bash[26136]: cluster 2021-03-10T21:06:30.471989+0000 mgr.gibba009.xiladd (mgr.34457) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:34.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:34 gibba009 bash[26136]: cephadm 2021-03-10T21:06:32.116615+0000 mgr.gibba009.xiladd (mgr.34457) 2987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:34.524 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:34 gibba009 bash[26136]: cluster 2021-03-10T21:06:32.473674+0000 mgr.gibba009.xiladd (mgr.34457) 2988 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:34.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:34 gibba004 bash[30897]: cephadm 2021-03-10T21:06:32.116615+0000 mgr.gibba009.xiladd (mgr.34457) 2987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:34.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:34 gibba004 bash[30897]: cluster 2021-03-10T21:06:32.473674+0000 mgr.gibba009.xiladd (mgr.34457) 2988 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:34.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:34 gibba004 bash[31878]: cephadm 2021-03-10T21:06:32.116615+0000 mgr.gibba009.xiladd (mgr.34457) 2987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:34.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:34 gibba004 bash[31878]: cluster 2021-03-10T21:06:32.473674+0000 mgr.gibba009.xiladd (mgr.34457) 2988 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:36.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:36 gibba004 bash[30897]: cluster 2021-03-10T21:06:34.474951+0000 mgr.gibba009.xiladd (mgr.34457) 2989 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:36.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:36 gibba004 bash[31878]: cluster 2021-03-10T21:06:34.474951+0000 mgr.gibba009.xiladd (mgr.34457) 2989 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:36 gibba009 bash[26136]: cluster 2021-03-10T21:06:34.474951+0000 mgr.gibba009.xiladd (mgr.34457) 2989 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:38.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:38 gibba009 bash[26136]: cluster 2021-03-10T21:06:36.476530+0000 mgr.gibba009.xiladd (mgr.34457) 2990 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:38.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:38 gibba004 bash[30897]: cluster 2021-03-10T21:06:36.476530+0000 mgr.gibba009.xiladd (mgr.34457) 2990 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:38.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:38 gibba004 bash[31878]: cluster 2021-03-10T21:06:36.476530+0000 mgr.gibba009.xiladd (mgr.34457) 2990 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: cluster 2021-03-10T21:06:38.477981+0000 mgr.gibba009.xiladd (mgr.34457) 2991 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.921687+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.922386+0000 mon.c (mon.1) 877 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.922813+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.923927+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.938384+0000 mon.c (mon.1) 878 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.939157+0000 mon.c (mon.1) 879 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.939602+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.939830+0000 mon.c (mon.1) 880 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.940629+0000 mon.c (mon.1) 881 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.940857+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.942082+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:40 gibba009 bash[26136]: audit 2021-03-10T21:06:39.942919+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: cluster 2021-03-10T21:06:38.477981+0000 mgr.gibba009.xiladd (mgr.34457) 2991 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.921687+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.922386+0000 mon.c (mon.1) 877 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.922813+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.923927+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.938384+0000 mon.c (mon.1) 878 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.939157+0000 mon.c (mon.1) 879 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.939602+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.939830+0000 mon.c (mon.1) 880 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.940629+0000 mon.c (mon.1) 881 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.940857+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.942082+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[30897]: audit 2021-03-10T21:06:39.942919+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: cluster 2021-03-10T21:06:38.477981+0000 mgr.gibba009.xiladd (mgr.34457) 2991 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.921687+0000 mon.c (mon.1) 876 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.922386+0000 mon.c (mon.1) 877 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.922813+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.923927+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.938384+0000 mon.c (mon.1) 878 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.939157+0000 mon.c (mon.1) 879 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.939602+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:06:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.939830+0000 mon.c (mon.1) 880 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.940629+0000 mon.c (mon.1) 881 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.940857+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:06:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.942082+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:06:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:40 gibba004 bash[31878]: audit 2021-03-10T21:06:39.942919+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:06:41.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:41 gibba004 bash[30897]: cluster 2021-03-10T21:06:40.479588+0000 mgr.gibba009.xiladd (mgr.34457) 2992 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:41.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:41 gibba004 bash[31878]: cluster 2021-03-10T21:06:40.479588+0000 mgr.gibba009.xiladd (mgr.34457) 2992 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:41.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:41 gibba009 bash[26136]: cluster 2021-03-10T21:06:40.479588+0000 mgr.gibba009.xiladd (mgr.34457) 2992 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:43 gibba004 bash[30897]: cluster 2021-03-10T21:06:42.481120+0000 mgr.gibba009.xiladd (mgr.34457) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:43 gibba004 bash[31878]: cluster 2021-03-10T21:06:42.481120+0000 mgr.gibba009.xiladd (mgr.34457) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:43 gibba009 bash[26136]: cluster 2021-03-10T21:06:42.481120+0000 mgr.gibba009.xiladd (mgr.34457) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.989 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:06:44.246 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:06:44.246 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (55m) 57s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:06:44.246 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (60m) 10m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:06:44.247 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:06:44.247 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:06:44.247 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (55m) 57s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:06:44.247 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (55m) 57s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:06:44.247 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (54m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:06:44.248 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (54m) 57s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:06:44.248 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (61m) 57s ago 61m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:06:44.248 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (61m) 10m ago 61m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:06:44.248 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (54m) 57s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:06:44.249 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (53m) 57s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:06:44.249 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (53m) 57s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:06:44.249 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (52m) 57s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:06:44.249 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:06:44.249 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:06:44.250 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:06:44.250 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (51m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:06:44.250 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (60m) 10m ago 61m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:06:44.250 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 57s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:44.251 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 10m ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:44.502 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:06:44.502 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:06:44.502 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:44.503 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:44.503 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:06:44.503 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:44.503 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:44.503 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:06:44.504 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:06:44.504 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:06:44.504 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:06:44.504 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:06:44.504 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:06:44.505 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:06:44.505 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:06:44.815 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:44 gibba004 bash[30897]: audit 2021-03-10T21:06:43.976447+0000 mgr.gibba009.xiladd (mgr.34457) 2994 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:44.816 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:44 gibba004 bash[30897]: audit 2021-03-10T21:06:44.498577+0000 mon.a (mon.0) 1021 : audit [DBG] from='client.? 172.21.2.104:0/3458790082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:44.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:44 gibba004 bash[31878]: audit 2021-03-10T21:06:43.976447+0000 mgr.gibba009.xiladd (mgr.34457) 2994 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:44.816 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:44 gibba004 bash[31878]: audit 2021-03-10T21:06:44.498577+0000 mon.a (mon.0) 1021 : audit [DBG] from='client.? 172.21.2.104:0/3458790082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:44.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:44 gibba009 bash[26136]: audit 2021-03-10T21:06:43.976447+0000 mgr.gibba009.xiladd (mgr.34457) 2994 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:44.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:44 gibba009 bash[26136]: audit 2021-03-10T21:06:44.498577+0000 mon.a (mon.0) 1021 : audit [DBG] from='client.? 172.21.2.104:0/3458790082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:46 gibba004 bash[30897]: audit 2021-03-10T21:06:44.202102+0000 mgr.gibba009.xiladd (mgr.34457) 2995 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:46 gibba004 bash[30897]: cluster 2021-03-10T21:06:44.482432+0000 mgr.gibba009.xiladd (mgr.34457) 2996 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:46 gibba004 bash[31878]: audit 2021-03-10T21:06:44.202102+0000 mgr.gibba009.xiladd (mgr.34457) 2995 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:46 gibba004 bash[31878]: cluster 2021-03-10T21:06:44.482432+0000 mgr.gibba009.xiladd (mgr.34457) 2996 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:46.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:46 gibba009 bash[26136]: audit 2021-03-10T21:06:44.202102+0000 mgr.gibba009.xiladd (mgr.34457) 2995 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:46.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:46 gibba009 bash[26136]: cluster 2021-03-10T21:06:44.482432+0000 mgr.gibba009.xiladd (mgr.34457) 2996 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:48.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:48 gibba009 bash[26136]: cluster 2021-03-10T21:06:46.484316+0000 mgr.gibba009.xiladd (mgr.34457) 2997 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:48 gibba009 bash[26136]: audit 2021-03-10T21:06:47.133335+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:48 gibba009 bash[26136]: audit 2021-03-10T21:06:47.137695+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:48.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[30897]: cluster 2021-03-10T21:06:46.484316+0000 mgr.gibba009.xiladd (mgr.34457) 2997 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:48.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[30897]: audit 2021-03-10T21:06:47.133335+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:48.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[30897]: audit 2021-03-10T21:06:47.137695+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:48.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[31878]: cluster 2021-03-10T21:06:46.484316+0000 mgr.gibba009.xiladd (mgr.34457) 2997 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:48.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[31878]: audit 2021-03-10T21:06:47.133335+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:48.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:48 gibba004 bash[31878]: audit 2021-03-10T21:06:47.137695+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:49.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:49 gibba009 bash[26136]: cephadm 2021-03-10T21:06:47.136214+0000 mgr.gibba009.xiladd (mgr.34457) 2998 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:06:49.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:49 gibba004 bash[30897]: cephadm 2021-03-10T21:06:47.136214+0000 mgr.gibba009.xiladd (mgr.34457) 2998 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:06:49.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:49 gibba004 bash[31878]: cephadm 2021-03-10T21:06:47.136214+0000 mgr.gibba009.xiladd (mgr.34457) 2998 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:06:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:50 gibba009 bash[26136]: cluster 2021-03-10T21:06:48.485900+0000 mgr.gibba009.xiladd (mgr.34457) 2999 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:50.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:50 gibba004 bash[30897]: cluster 2021-03-10T21:06:48.485900+0000 mgr.gibba009.xiladd (mgr.34457) 2999 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:50.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:50 gibba004 bash[31878]: cluster 2021-03-10T21:06:48.485900+0000 mgr.gibba009.xiladd (mgr.34457) 2999 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:52.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:51 gibba009 bash[26136]: cluster 2021-03-10T21:06:50.486430+0000 mgr.gibba009.xiladd (mgr.34457) 3000 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:52.116 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:51 gibba009 bash[26136]: audit 2021-03-10T21:06:50.837780+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:52.117 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:51 gibba009 bash[26136]: audit 2021-03-10T21:06:50.839378+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:06:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[30897]: cluster 2021-03-10T21:06:50.486430+0000 mgr.gibba009.xiladd (mgr.34457) 3000 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[30897]: audit 2021-03-10T21:06:50.837780+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:52.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[30897]: audit 2021-03-10T21:06:50.839378+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:06:52.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[31878]: cluster 2021-03-10T21:06:50.486430+0000 mgr.gibba009.xiladd (mgr.34457) 3000 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:52.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[31878]: audit 2021-03-10T21:06:50.837780+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:52.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:51 gibba004 bash[31878]: audit 2021-03-10T21:06:50.839378+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:06:54.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:53 gibba004 bash[30897]: cluster 2021-03-10T21:06:52.487801+0000 mgr.gibba009.xiladd (mgr.34457) 3001 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:54.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:53 gibba004 bash[31878]: cluster 2021-03-10T21:06:52.487801+0000 mgr.gibba009.xiladd (mgr.34457) 3001 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:54.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:53 gibba009 bash[26136]: cluster 2021-03-10T21:06:52.487801+0000 mgr.gibba009.xiladd (mgr.34457) 3001 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: cluster 2021-03-10T21:06:54.489254+0000 mgr.gibba009.xiladd (mgr.34457) 3002 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.103947+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.280797+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.472602+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.476470+0000 mon.c (mon.1) 886 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.477845+0000 mon.c (mon.1) 887 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.479399+0000 mon.c (mon.1) 888 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.480693+0000 mon.c (mon.1) 889 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.484528+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:56 gibba009 bash[26136]: audit 2021-03-10T21:06:55.486479+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: cluster 2021-03-10T21:06:54.489254+0000 mgr.gibba009.xiladd (mgr.34457) 3002 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.103947+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.280797+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.472602+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.476470+0000 mon.c (mon.1) 886 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.477845+0000 mon.c (mon.1) 887 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.479399+0000 mon.c (mon.1) 888 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.480693+0000 mon.c (mon.1) 889 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.484528+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[30897]: audit 2021-03-10T21:06:55.486479+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: cluster 2021-03-10T21:06:54.489254+0000 mgr.gibba009.xiladd (mgr.34457) 3002 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.103947+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:06:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.280797+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.472602+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:06:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.476470+0000 mon.c (mon.1) 886 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.477845+0000 mon.c (mon.1) 887 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.479399+0000 mon.c (mon.1) 888 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.480693+0000 mon.c (mon.1) 889 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.484528+0000 mon.c (mon.1) 890 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:56 gibba004 bash[31878]: audit 2021-03-10T21:06:55.486479+0000 mon.c (mon.1) 891 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.281381+0000 mgr.gibba009.xiladd (mgr.34457) 3003 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:06:57.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.475186+0000 mgr.gibba009.xiladd (mgr.34457) 3004 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:57.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.477061+0000 mgr.gibba009.xiladd (mgr.34457) 3005 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:57.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.478415+0000 mgr.gibba009.xiladd (mgr.34457) 3006 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:57.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.478454+0000 mgr.gibba009.xiladd (mgr.34457) 3007 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:57.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.479852+0000 mgr.gibba009.xiladd (mgr.34457) 3008 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:57.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.479888+0000 mgr.gibba009.xiladd (mgr.34457) 3009 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:57.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.481261+0000 mgr.gibba009.xiladd (mgr.34457) 3010 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:57.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.483295+0000 mgr.gibba009.xiladd (mgr.34457) 3011 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:57.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.483333+0000 mgr.gibba009.xiladd (mgr.34457) 3012 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:57.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.485297+0000 mgr.gibba009.xiladd (mgr.34457) 3013 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:57.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.485610+0000 mgr.gibba009.xiladd (mgr.34457) 3014 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:57.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.487366+0000 mgr.gibba009.xiladd (mgr.34457) 3015 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:57.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.487406+0000 mgr.gibba009.xiladd (mgr.34457) 3016 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:57.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:57 gibba009 bash[26136]: cephadm 2021-03-10T21:06:55.487531+0000 mgr.gibba009.xiladd (mgr.34457) 3017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.281381+0000 mgr.gibba009.xiladd (mgr.34457) 3003 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:06:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.475186+0000 mgr.gibba009.xiladd (mgr.34457) 3004 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.477061+0000 mgr.gibba009.xiladd (mgr.34457) 3005 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.478415+0000 mgr.gibba009.xiladd (mgr.34457) 3006 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.478454+0000 mgr.gibba009.xiladd (mgr.34457) 3007 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.479852+0000 mgr.gibba009.xiladd (mgr.34457) 3008 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.479888+0000 mgr.gibba009.xiladd (mgr.34457) 3009 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.481261+0000 mgr.gibba009.xiladd (mgr.34457) 3010 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.483295+0000 mgr.gibba009.xiladd (mgr.34457) 3011 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.483333+0000 mgr.gibba009.xiladd (mgr.34457) 3012 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.485297+0000 mgr.gibba009.xiladd (mgr.34457) 3013 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.485610+0000 mgr.gibba009.xiladd (mgr.34457) 3014 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.487366+0000 mgr.gibba009.xiladd (mgr.34457) 3015 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.487406+0000 mgr.gibba009.xiladd (mgr.34457) 3016 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[30897]: cephadm 2021-03-10T21:06:55.487531+0000 mgr.gibba009.xiladd (mgr.34457) 3017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:57.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.281381+0000 mgr.gibba009.xiladd (mgr.34457) 3003 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:06:57.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.475186+0000 mgr.gibba009.xiladd (mgr.34457) 3004 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.477061+0000 mgr.gibba009.xiladd (mgr.34457) 3005 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.478415+0000 mgr.gibba009.xiladd (mgr.34457) 3006 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.478454+0000 mgr.gibba009.xiladd (mgr.34457) 3007 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.479852+0000 mgr.gibba009.xiladd (mgr.34457) 3008 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.479888+0000 mgr.gibba009.xiladd (mgr.34457) 3009 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.481261+0000 mgr.gibba009.xiladd (mgr.34457) 3010 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.483295+0000 mgr.gibba009.xiladd (mgr.34457) 3011 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.483333+0000 mgr.gibba009.xiladd (mgr.34457) 3012 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.485297+0000 mgr.gibba009.xiladd (mgr.34457) 3013 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.485610+0000 mgr.gibba009.xiladd (mgr.34457) 3014 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.487366+0000 mgr.gibba009.xiladd (mgr.34457) 3015 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.487406+0000 mgr.gibba009.xiladd (mgr.34457) 3016 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:57 gibba004 bash[31878]: cephadm 2021-03-10T21:06:55.487531+0000 mgr.gibba009.xiladd (mgr.34457) 3017 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:06:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:58 gibba004 bash[30897]: cluster 2021-03-10T21:06:56.490951+0000 mgr.gibba009.xiladd (mgr.34457) 3018 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:58.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:58 gibba004 bash[31878]: cluster 2021-03-10T21:06:56.490951+0000 mgr.gibba009.xiladd (mgr.34457) 3018 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:58 gibba009 bash[26136]: cluster 2021-03-10T21:06:56.490951+0000 mgr.gibba009.xiladd (mgr.34457) 3018 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:06:59 gibba004 bash[30897]: cluster 2021-03-10T21:06:58.492606+0000 mgr.gibba009.xiladd (mgr.34457) 3019 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:06:59 gibba004 bash[31878]: cluster 2021-03-10T21:06:58.492606+0000 mgr.gibba009.xiladd (mgr.34457) 3019 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:06:59 gibba009 bash[26136]: cluster 2021-03-10T21:06:58.492606+0000 mgr.gibba009.xiladd (mgr.34457) 3019 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:02.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:02 gibba009 bash[26136]: cluster 2021-03-10T21:07:00.494061+0000 mgr.gibba009.xiladd (mgr.34457) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:02.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:02 gibba004 bash[30897]: cluster 2021-03-10T21:07:00.494061+0000 mgr.gibba009.xiladd (mgr.34457) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:02.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:02 gibba004 bash[31878]: cluster 2021-03-10T21:07:00.494061+0000 mgr.gibba009.xiladd (mgr.34457) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:04 gibba009 bash[26136]: cluster 2021-03-10T21:07:02.495663+0000 mgr.gibba009.xiladd (mgr.34457) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:04 gibba004 bash[30897]: cluster 2021-03-10T21:07:02.495663+0000 mgr.gibba009.xiladd (mgr.34457) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:04 gibba004 bash[31878]: cluster 2021-03-10T21:07:02.495663+0000 mgr.gibba009.xiladd (mgr.34457) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:06.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:06 gibba009 bash[26136]: cluster 2021-03-10T21:07:04.496896+0000 mgr.gibba009.xiladd (mgr.34457) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:06.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:06 gibba004 bash[30897]: cluster 2021-03-10T21:07:04.496896+0000 mgr.gibba009.xiladd (mgr.34457) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:06.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:06 gibba004 bash[31878]: cluster 2021-03-10T21:07:04.496896+0000 mgr.gibba009.xiladd (mgr.34457) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:08.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:08 gibba009 bash[26136]: cluster 2021-03-10T21:07:06.498726+0000 mgr.gibba009.xiladd (mgr.34457) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:08.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:08 gibba004 bash[30897]: cluster 2021-03-10T21:07:06.498726+0000 mgr.gibba009.xiladd (mgr.34457) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:08.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:08 gibba004 bash[31878]: cluster 2021-03-10T21:07:06.498726+0000 mgr.gibba009.xiladd (mgr.34457) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:09.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:09 gibba004 bash[30897]: cluster 2021-03-10T21:07:08.500370+0000 mgr.gibba009.xiladd (mgr.34457) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:09.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:09 gibba004 bash[31878]: cluster 2021-03-10T21:07:08.500370+0000 mgr.gibba009.xiladd (mgr.34457) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:09.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:09 gibba009 bash[26136]: cluster 2021-03-10T21:07:08.500370+0000 mgr.gibba009.xiladd (mgr.34457) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:12.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:12 gibba009 bash[26136]: cluster 2021-03-10T21:07:10.501757+0000 mgr.gibba009.xiladd (mgr.34457) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:12.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:12 gibba009 bash[26136]: cephadm 2021-03-10T21:07:10.503495+0000 mgr.gibba009.xiladd (mgr.34457) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:12.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:12 gibba004 bash[30897]: cluster 2021-03-10T21:07:10.501757+0000 mgr.gibba009.xiladd (mgr.34457) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:12.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:12 gibba004 bash[30897]: cephadm 2021-03-10T21:07:10.503495+0000 mgr.gibba009.xiladd (mgr.34457) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:12.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:12 gibba004 bash[31878]: cluster 2021-03-10T21:07:10.501757+0000 mgr.gibba009.xiladd (mgr.34457) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:12.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:12 gibba004 bash[31878]: cephadm 2021-03-10T21:07:10.503495+0000 mgr.gibba009.xiladd (mgr.34457) 3026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:14.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:14 gibba009 bash[26136]: cluster 2021-03-10T21:07:12.503225+0000 mgr.gibba009.xiladd (mgr.34457) 3027 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.565 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:14 gibba004 bash[31878]: cluster 2021-03-10T21:07:12.503225+0000 mgr.gibba009.xiladd (mgr.34457) 3027 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:14 gibba004 bash[30897]: cluster 2021-03-10T21:07:12.503225+0000 mgr.gibba009.xiladd (mgr.34457) 3027 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.744 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:07:14.975 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:07:14.975 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (56m) 88s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:07:14.975 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (61m) 24s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:07:14.976 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (56m) 24s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:07:14.976 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (56m) 24s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:07:14.976 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (55m) 88s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:07:14.977 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (55m) 88s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:07:14.977 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (55m) 24s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:07:14.977 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (55m) 88s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:07:14.977 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (61m) 88s ago 61m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:07:14.978 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (61m) 24s ago 61m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:07:14.978 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (54m) 88s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:07:14.978 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (54m) 88s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:07:14.978 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (53m) 88s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:07:14.979 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (53m) 88s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:07:14.979 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (52m) 24s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:07:14.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (52m) 24s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:07:14.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (51m) 24s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:07:14.980 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (51m) 24s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:07:14.980 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (61m) 24s ago 61m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:07:14.981 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 88s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:14.981 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 24s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:15.229 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:07:15.230 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:07:15.230 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:15.230 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:15.231 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:07:15.231 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:15.231 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:15.231 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:07:15.232 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:07:15.232 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:15.232 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:07:15.232 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:07:15.233 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:07:15.233 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:07:15.233 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:07:16.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:16 gibba009 bash[26136]: cluster 2021-03-10T21:07:14.504680+0000 mgr.gibba009.xiladd (mgr.34457) 3028 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:16.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:16 gibba009 bash[26136]: audit 2021-03-10T21:07:14.730800+0000 mgr.gibba009.xiladd (mgr.34457) 3029 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:16 gibba009 bash[26136]: audit 2021-03-10T21:07:14.958447+0000 mgr.gibba009.xiladd (mgr.34457) 3030 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:16 gibba009 bash[26136]: audit 2021-03-10T21:07:15.226313+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.104:0/3043861573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[30897]: cluster 2021-03-10T21:07:14.504680+0000 mgr.gibba009.xiladd (mgr.34457) 3028 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[30897]: audit 2021-03-10T21:07:14.730800+0000 mgr.gibba009.xiladd (mgr.34457) 3029 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[30897]: audit 2021-03-10T21:07:14.958447+0000 mgr.gibba009.xiladd (mgr.34457) 3030 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[30897]: audit 2021-03-10T21:07:15.226313+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.104:0/3043861573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:16.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[31878]: cluster 2021-03-10T21:07:14.504680+0000 mgr.gibba009.xiladd (mgr.34457) 3028 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:16.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[31878]: audit 2021-03-10T21:07:14.730800+0000 mgr.gibba009.xiladd (mgr.34457) 3029 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[31878]: audit 2021-03-10T21:07:14.958447+0000 mgr.gibba009.xiladd (mgr.34457) 3030 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:16.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:16 gibba004 bash[31878]: audit 2021-03-10T21:07:15.226313+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.104:0/3043861573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:18.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:18 gibba009 bash[26136]: cluster 2021-03-10T21:07:16.506369+0000 mgr.gibba009.xiladd (mgr.34457) 3031 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:18 gibba004 bash[30897]: cluster 2021-03-10T21:07:16.506369+0000 mgr.gibba009.xiladd (mgr.34457) 3031 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:18.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:18 gibba004 bash[31878]: cluster 2021-03-10T21:07:16.506369+0000 mgr.gibba009.xiladd (mgr.34457) 3031 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:20.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:20 gibba004 bash[30897]: cluster 2021-03-10T21:07:18.507840+0000 mgr.gibba009.xiladd (mgr.34457) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:20.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:20 gibba004 bash[31878]: cluster 2021-03-10T21:07:18.507840+0000 mgr.gibba009.xiladd (mgr.34457) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:20.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:20 gibba009 bash[26136]: cluster 2021-03-10T21:07:18.507840+0000 mgr.gibba009.xiladd (mgr.34457) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:21 gibba004 bash[30897]: cluster 2021-03-10T21:07:20.509467+0000 mgr.gibba009.xiladd (mgr.34457) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:21 gibba004 bash[31878]: cluster 2021-03-10T21:07:20.509467+0000 mgr.gibba009.xiladd (mgr.34457) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:21 gibba009 bash[26136]: cluster 2021-03-10T21:07:20.509467+0000 mgr.gibba009.xiladd (mgr.34457) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:23.840 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:23 gibba009 bash[26136]: cluster 2021-03-10T21:07:22.510829+0000 mgr.gibba009.xiladd (mgr.34457) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:24.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:23 gibba004 bash[30897]: cluster 2021-03-10T21:07:22.510829+0000 mgr.gibba009.xiladd (mgr.34457) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:24.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:23 gibba004 bash[31878]: cluster 2021-03-10T21:07:22.510829+0000 mgr.gibba009.xiladd (mgr.34457) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:26.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:26 gibba009 bash[26136]: cluster 2021-03-10T21:07:24.512337+0000 mgr.gibba009.xiladd (mgr.34457) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:26.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:26 gibba004 bash[30897]: cluster 2021-03-10T21:07:24.512337+0000 mgr.gibba009.xiladd (mgr.34457) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:26.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:26 gibba004 bash[31878]: cluster 2021-03-10T21:07:24.512337+0000 mgr.gibba009.xiladd (mgr.34457) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:27.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:27 gibba009 bash[26136]: cephadm 2021-03-10T21:07:25.519284+0000 mgr.gibba009.xiladd (mgr.34457) 3036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:27.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:27 gibba004 bash[30897]: cephadm 2021-03-10T21:07:25.519284+0000 mgr.gibba009.xiladd (mgr.34457) 3036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:27.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:27 gibba004 bash[31878]: cephadm 2021-03-10T21:07:25.519284+0000 mgr.gibba009.xiladd (mgr.34457) 3036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:28.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:28 gibba009 bash[26136]: cluster 2021-03-10T21:07:26.514148+0000 mgr.gibba009.xiladd (mgr.34457) 3037 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:28.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:28 gibba004 bash[30897]: cluster 2021-03-10T21:07:26.514148+0000 mgr.gibba009.xiladd (mgr.34457) 3037 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:28.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:28 gibba004 bash[31878]: cluster 2021-03-10T21:07:26.514148+0000 mgr.gibba009.xiladd (mgr.34457) 3037 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:30.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:30 gibba004 bash[30897]: cluster 2021-03-10T21:07:28.515820+0000 mgr.gibba009.xiladd (mgr.34457) 3038 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:30.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:30 gibba004 bash[31878]: cluster 2021-03-10T21:07:28.515820+0000 mgr.gibba009.xiladd (mgr.34457) 3038 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:30.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:30 gibba009 bash[26136]: cluster 2021-03-10T21:07:28.515820+0000 mgr.gibba009.xiladd (mgr.34457) 3038 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:31 gibba004 bash[30897]: cluster 2021-03-10T21:07:30.517459+0000 mgr.gibba009.xiladd (mgr.34457) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:31 gibba004 bash[31878]: cluster 2021-03-10T21:07:30.517459+0000 mgr.gibba009.xiladd (mgr.34457) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:31 gibba009 bash[26136]: cluster 2021-03-10T21:07:30.517459+0000 mgr.gibba009.xiladd (mgr.34457) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:33.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:33 gibba009 bash[26136]: cluster 2021-03-10T21:07:32.518837+0000 mgr.gibba009.xiladd (mgr.34457) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:34.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:33 gibba004 bash[30897]: cluster 2021-03-10T21:07:32.518837+0000 mgr.gibba009.xiladd (mgr.34457) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:34.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:33 gibba004 bash[31878]: cluster 2021-03-10T21:07:32.518837+0000 mgr.gibba009.xiladd (mgr.34457) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:36.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:36 gibba009 bash[26136]: cluster 2021-03-10T21:07:34.520112+0000 mgr.gibba009.xiladd (mgr.34457) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:36.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:36 gibba004 bash[30897]: cluster 2021-03-10T21:07:34.520112+0000 mgr.gibba009.xiladd (mgr.34457) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:36.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:36 gibba004 bash[31878]: cluster 2021-03-10T21:07:34.520112+0000 mgr.gibba009.xiladd (mgr.34457) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:38.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:38 gibba004 bash[30897]: cluster 2021-03-10T21:07:36.521875+0000 mgr.gibba009.xiladd (mgr.34457) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:38.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:38 gibba004 bash[31878]: cluster 2021-03-10T21:07:36.521875+0000 mgr.gibba009.xiladd (mgr.34457) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:38.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:38 gibba009 bash[26136]: cluster 2021-03-10T21:07:36.521875+0000 mgr.gibba009.xiladd (mgr.34457) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:39 gibba004 bash[30897]: cluster 2021-03-10T21:07:38.523278+0000 mgr.gibba009.xiladd (mgr.34457) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:39 gibba004 bash[31878]: cluster 2021-03-10T21:07:38.523278+0000 mgr.gibba009.xiladd (mgr.34457) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:39 gibba009 bash[26136]: cluster 2021-03-10T21:07:38.523278+0000 mgr.gibba009.xiladd (mgr.34457) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:40.539 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.929055+0000 mon.c (mon.1) 893 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.540 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.930014+0000 mon.c (mon.1) 894 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.540 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.930327+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.540 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.931424+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.541 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.944287+0000 mon.c (mon.1) 895 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.541 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.945397+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.541 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.945576+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.541 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.946498+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.542 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.946646+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.542 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.947667+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.542 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.947983+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.542 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:40 gibba009 bash[26136]: audit 2021-03-10T21:07:39.949229+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.929055+0000 mon.c (mon.1) 893 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.930014+0000 mon.c (mon.1) 894 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.930327+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.931424+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.944287+0000 mon.c (mon.1) 895 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.945397+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.945576+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.946498+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.946646+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.947667+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.947983+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[30897]: audit 2021-03-10T21:07:39.949229+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.929055+0000 mon.c (mon.1) 893 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.930014+0000 mon.c (mon.1) 894 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.930327+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:40.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.931424+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.944287+0000 mon.c (mon.1) 895 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.945397+0000 mon.c (mon.1) 896 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.945576+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T21:07:40.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.946498+0000 mon.c (mon.1) 897 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.946646+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.947667+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:07:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.947983+0000 mon.c (mon.1) 898 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:40.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:40 gibba004 bash[31878]: audit 2021-03-10T21:07:39.949229+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:41.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:41 gibba004 bash[30897]: cluster 2021-03-10T21:07:40.524917+0000 mgr.gibba009.xiladd (mgr.34457) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:41.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:41 gibba004 bash[30897]: cephadm 2021-03-10T21:07:40.535069+0000 mgr.gibba009.xiladd (mgr.34457) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:41.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:41 gibba004 bash[31878]: cluster 2021-03-10T21:07:40.524917+0000 mgr.gibba009.xiladd (mgr.34457) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:41.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:41 gibba004 bash[31878]: cephadm 2021-03-10T21:07:40.535069+0000 mgr.gibba009.xiladd (mgr.34457) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:41.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:41 gibba009 bash[26136]: cluster 2021-03-10T21:07:40.524917+0000 mgr.gibba009.xiladd (mgr.34457) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:41.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:41 gibba009 bash[26136]: cephadm 2021-03-10T21:07:40.535069+0000 mgr.gibba009.xiladd (mgr.34457) 3045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:43 gibba004 bash[30897]: cluster 2021-03-10T21:07:42.526517+0000 mgr.gibba009.xiladd (mgr.34457) 3046 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:44.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:43 gibba004 bash[31878]: cluster 2021-03-10T21:07:42.526517+0000 mgr.gibba009.xiladd (mgr.34457) 3046 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:44.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:43 gibba009 bash[26136]: cluster 2021-03-10T21:07:42.526517+0000 mgr.gibba009.xiladd (mgr.34457) 3046 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:45.476 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:07:45.706 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:07:45.707 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (56m) 118s ago 62m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:07:45.707 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (61m) 54s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:07:45.707 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (57m) 54s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:07:45.708 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (57m) 54s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:07:45.708 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (56m) 118s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:07:45.708 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (56m) 118s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:07:45.708 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (55m) 54s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:07:45.708 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (55m) 118s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:07:45.709 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (62m) 118s ago 62m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:07:45.709 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (62m) 54s ago 62m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:07:45.709 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (55m) 118s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:07:45.709 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (54m) 118s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:07:45.710 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (54m) 118s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:07:45.710 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (53m) 118s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:07:45.710 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (53m) 54s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:07:45.710 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (52m) 54s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:07:45.711 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (52m) 54s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:07:45.711 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (52m) 54s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:07:45.711 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (61m) 54s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:07:45.711 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 118s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:45.712 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 54s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:45.967 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:07:45.968 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:07:45.968 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:45.969 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:45.969 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:07:45.970 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:45.970 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:45.970 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:07:45.971 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:07:45.971 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:07:45.972 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:07:45.972 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:07:45.973 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:07:45.973 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:07:45.973 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:07:46.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:46 gibba009 bash[26136]: cluster 2021-03-10T21:07:44.527889+0000 mgr.gibba009.xiladd (mgr.34457) 3047 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:46.651 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:46 gibba009 bash[26136]: audit 2021-03-10T21:07:45.957377+0000 mon.c (mon.1) 899 : audit [DBG] from='client.? 172.21.2.104:0/4162566885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:46.652 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:46 gibba004 bash[30897]: cluster 2021-03-10T21:07:44.527889+0000 mgr.gibba009.xiladd (mgr.34457) 3047 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:46.653 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:46 gibba004 bash[30897]: audit 2021-03-10T21:07:45.957377+0000 mon.c (mon.1) 899 : audit [DBG] from='client.? 172.21.2.104:0/4162566885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:46.653 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:46 gibba004 bash[31878]: cluster 2021-03-10T21:07:44.527889+0000 mgr.gibba009.xiladd (mgr.34457) 3047 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:46.653 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:46 gibba004 bash[31878]: audit 2021-03-10T21:07:45.957377+0000 mon.c (mon.1) 899 : audit [DBG] from='client.? 172.21.2.104:0/4162566885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:47.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:47 gibba004 bash[30897]: audit 2021-03-10T21:07:45.462899+0000 mgr.gibba009.xiladd (mgr.34457) 3048 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:47.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:47 gibba004 bash[30897]: audit 2021-03-10T21:07:45.690823+0000 mgr.gibba009.xiladd (mgr.34457) 3049 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:47.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:47 gibba004 bash[31878]: audit 2021-03-10T21:07:45.462899+0000 mgr.gibba009.xiladd (mgr.34457) 3048 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:47.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:47 gibba004 bash[31878]: audit 2021-03-10T21:07:45.690823+0000 mgr.gibba009.xiladd (mgr.34457) 3049 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:47.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:47 gibba009 bash[26136]: audit 2021-03-10T21:07:45.462899+0000 mgr.gibba009.xiladd (mgr.34457) 3048 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:47.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:47 gibba009 bash[26136]: audit 2021-03-10T21:07:45.690823+0000 mgr.gibba009.xiladd (mgr.34457) 3049 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:48.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:48 gibba004 bash[30897]: cluster 2021-03-10T21:07:46.529889+0000 mgr.gibba009.xiladd (mgr.34457) 3050 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:48.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:48 gibba004 bash[31878]: cluster 2021-03-10T21:07:46.529889+0000 mgr.gibba009.xiladd (mgr.34457) 3050 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:48.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:48 gibba009 bash[26136]: cluster 2021-03-10T21:07:46.529889+0000 mgr.gibba009.xiladd (mgr.34457) 3050 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:49 gibba004 bash[30897]: cluster 2021-03-10T21:07:48.531544+0000 mgr.gibba009.xiladd (mgr.34457) 3051 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:49 gibba004 bash[31878]: cluster 2021-03-10T21:07:48.531544+0000 mgr.gibba009.xiladd (mgr.34457) 3051 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:49 gibba009 bash[26136]: cluster 2021-03-10T21:07:48.531544+0000 mgr.gibba009.xiladd (mgr.34457) 3051 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:52.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:52 gibba004 bash[30897]: cluster 2021-03-10T21:07:50.533045+0000 mgr.gibba009.xiladd (mgr.34457) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:52.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:52 gibba004 bash[31878]: cluster 2021-03-10T21:07:50.533045+0000 mgr.gibba009.xiladd (mgr.34457) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:52.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:52 gibba009 bash[26136]: cluster 2021-03-10T21:07:50.533045+0000 mgr.gibba009.xiladd (mgr.34457) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:54.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:54 gibba004 bash[30897]: cluster 2021-03-10T21:07:52.534592+0000 mgr.gibba009.xiladd (mgr.34457) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:54.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:54 gibba004 bash[31878]: cluster 2021-03-10T21:07:52.534592+0000 mgr.gibba009.xiladd (mgr.34457) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:54.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:54 gibba009 bash[26136]: cluster 2021-03-10T21:07:52.534592+0000 mgr.gibba009.xiladd (mgr.34457) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: cluster 2021-03-10T21:07:54.535969+0000 mgr.gibba009.xiladd (mgr.34457) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.538802+0000 mon.c (mon.1) 900 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.742800+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:07:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.746899+0000 mon.c (mon.1) 901 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.748785+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.750727+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.752039+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.755440+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[30897]: audit 2021-03-10T21:07:55.757043+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: cluster 2021-03-10T21:07:54.535969+0000 mgr.gibba009.xiladd (mgr.34457) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.538802+0000 mon.c (mon.1) 900 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.742800+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:07:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.746899+0000 mon.c (mon.1) 901 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.748785+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.750727+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.752039+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.755440+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:56 gibba004 bash[31878]: audit 2021-03-10T21:07:55.757043+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: cluster 2021-03-10T21:07:54.535969+0000 mgr.gibba009.xiladd (mgr.34457) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.538802+0000 mon.c (mon.1) 900 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.742800+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:07:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.746899+0000 mon.c (mon.1) 901 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.748785+0000 mon.c (mon.1) 902 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.750727+0000 mon.c (mon.1) 903 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.752039+0000 mon.c (mon.1) 904 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.755440+0000 mon.c (mon.1) 905 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:56.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:56 gibba009 bash[26136]: audit 2021-03-10T21:07:55.757043+0000 mon.c (mon.1) 906 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.543664+0000 mgr.gibba009.xiladd (mgr.34457) 3055 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:07:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.545487+0000 mgr.gibba009.xiladd (mgr.34457) 3056 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:07:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.745530+0000 mgr.gibba009.xiladd (mgr.34457) 3057 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.747802+0000 mgr.gibba009.xiladd (mgr.34457) 3058 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.749594+0000 mgr.gibba009.xiladd (mgr.34457) 3059 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.749631+0000 mgr.gibba009.xiladd (mgr.34457) 3060 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.751216+0000 mgr.gibba009.xiladd (mgr.34457) 3061 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.751250+0000 mgr.gibba009.xiladd (mgr.34457) 3062 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.752778+0000 mgr.gibba009.xiladd (mgr.34457) 3063 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:57.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.754455+0000 mgr.gibba009.xiladd (mgr.34457) 3064 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:57.571 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.754492+0000 mgr.gibba009.xiladd (mgr.34457) 3065 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.755840+0000 mgr.gibba009.xiladd (mgr.34457) 3066 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.756164+0000 mgr.gibba009.xiladd (mgr.34457) 3067 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:57.572 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.757441+0000 mgr.gibba009.xiladd (mgr.34457) 3068 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:57.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.757478+0000 mgr.gibba009.xiladd (mgr.34457) 3069 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:57.573 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[30897]: cephadm 2021-03-10T21:07:55.757603+0000 mgr.gibba009.xiladd (mgr.34457) 3070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:57.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.543664+0000 mgr.gibba009.xiladd (mgr.34457) 3055 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:07:57.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.545487+0000 mgr.gibba009.xiladd (mgr.34457) 3056 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:07:57.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.745530+0000 mgr.gibba009.xiladd (mgr.34457) 3057 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:57.575 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.747802+0000 mgr.gibba009.xiladd (mgr.34457) 3058 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:57.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.749594+0000 mgr.gibba009.xiladd (mgr.34457) 3059 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:57.576 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.749631+0000 mgr.gibba009.xiladd (mgr.34457) 3060 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:57.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.751216+0000 mgr.gibba009.xiladd (mgr.34457) 3061 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:57.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.751250+0000 mgr.gibba009.xiladd (mgr.34457) 3062 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:57.577 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.752778+0000 mgr.gibba009.xiladd (mgr.34457) 3063 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:57.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.754455+0000 mgr.gibba009.xiladd (mgr.34457) 3064 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:57.578 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.754492+0000 mgr.gibba009.xiladd (mgr.34457) 3065 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:57.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.755840+0000 mgr.gibba009.xiladd (mgr.34457) 3066 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:57.579 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.756164+0000 mgr.gibba009.xiladd (mgr.34457) 3067 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:57.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.757441+0000 mgr.gibba009.xiladd (mgr.34457) 3068 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:57.580 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.757478+0000 mgr.gibba009.xiladd (mgr.34457) 3069 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:57.581 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:57 gibba004 bash[31878]: cephadm 2021-03-10T21:07:55.757603+0000 mgr.gibba009.xiladd (mgr.34457) 3070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.543664+0000 mgr.gibba009.xiladd (mgr.34457) 3055 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:07:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.545487+0000 mgr.gibba009.xiladd (mgr.34457) 3056 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:07:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.745530+0000 mgr.gibba009.xiladd (mgr.34457) 3057 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.747802+0000 mgr.gibba009.xiladd (mgr.34457) 3058 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.749594+0000 mgr.gibba009.xiladd (mgr.34457) 3059 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.749631+0000 mgr.gibba009.xiladd (mgr.34457) 3060 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.751216+0000 mgr.gibba009.xiladd (mgr.34457) 3061 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.751250+0000 mgr.gibba009.xiladd (mgr.34457) 3062 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:57.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.752778+0000 mgr.gibba009.xiladd (mgr.34457) 3063 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:57.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.754455+0000 mgr.gibba009.xiladd (mgr.34457) 3064 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:57.596 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.754492+0000 mgr.gibba009.xiladd (mgr.34457) 3065 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:57.596 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.755840+0000 mgr.gibba009.xiladd (mgr.34457) 3066 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:57.597 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.756164+0000 mgr.gibba009.xiladd (mgr.34457) 3067 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:57.597 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.757441+0000 mgr.gibba009.xiladd (mgr.34457) 3068 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:57.597 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.757478+0000 mgr.gibba009.xiladd (mgr.34457) 3069 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:57.598 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:57 gibba009 bash[26136]: cephadm 2021-03-10T21:07:55.757603+0000 mgr.gibba009.xiladd (mgr.34457) 3070 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:07:58.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:58 gibba004 bash[30897]: cluster 2021-03-10T21:07:56.537840+0000 mgr.gibba009.xiladd (mgr.34457) 3071 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:58.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:58 gibba004 bash[31878]: cluster 2021-03-10T21:07:56.537840+0000 mgr.gibba009.xiladd (mgr.34457) 3071 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:58 gibba009 bash[26136]: cluster 2021-03-10T21:07:56.537840+0000 mgr.gibba009.xiladd (mgr.34457) 3071 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:07:59 gibba004 bash[30897]: cluster 2021-03-10T21:07:58.539494+0000 mgr.gibba009.xiladd (mgr.34457) 3072 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:07:59 gibba004 bash[31878]: cluster 2021-03-10T21:07:58.539494+0000 mgr.gibba009.xiladd (mgr.34457) 3072 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:07:59 gibba009 bash[26136]: cluster 2021-03-10T21:07:58.539494+0000 mgr.gibba009.xiladd (mgr.34457) 3072 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:02.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:02 gibba004 bash[30897]: cluster 2021-03-10T21:08:00.541050+0000 mgr.gibba009.xiladd (mgr.34457) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:02.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:02 gibba004 bash[31878]: cluster 2021-03-10T21:08:00.541050+0000 mgr.gibba009.xiladd (mgr.34457) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:02.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:02 gibba009 bash[26136]: cluster 2021-03-10T21:08:00.541050+0000 mgr.gibba009.xiladd (mgr.34457) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:04.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:04 gibba004 bash[30897]: cluster 2021-03-10T21:08:02.542672+0000 mgr.gibba009.xiladd (mgr.34457) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:04.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:04 gibba004 bash[31878]: cluster 2021-03-10T21:08:02.542672+0000 mgr.gibba009.xiladd (mgr.34457) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:04.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:04 gibba009 bash[26136]: cluster 2021-03-10T21:08:02.542672+0000 mgr.gibba009.xiladd (mgr.34457) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:06.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:06 gibba004 bash[30897]: cluster 2021-03-10T21:08:04.544008+0000 mgr.gibba009.xiladd (mgr.34457) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:06.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:06 gibba004 bash[31878]: cluster 2021-03-10T21:08:04.544008+0000 mgr.gibba009.xiladd (mgr.34457) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:06.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:06 gibba009 bash[26136]: cluster 2021-03-10T21:08:04.544008+0000 mgr.gibba009.xiladd (mgr.34457) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:08.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:08 gibba004 bash[30897]: cluster 2021-03-10T21:08:06.545045+0000 mgr.gibba009.xiladd (mgr.34457) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:08.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:08 gibba004 bash[31878]: cluster 2021-03-10T21:08:06.545045+0000 mgr.gibba009.xiladd (mgr.34457) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:08.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:08 gibba009 bash[26136]: cluster 2021-03-10T21:08:06.545045+0000 mgr.gibba009.xiladd (mgr.34457) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:09 gibba004 bash[30897]: cluster 2021-03-10T21:08:08.546339+0000 mgr.gibba009.xiladd (mgr.34457) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:09 gibba004 bash[31878]: cluster 2021-03-10T21:08:08.546339+0000 mgr.gibba009.xiladd (mgr.34457) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:09 gibba009 bash[26136]: cluster 2021-03-10T21:08:08.546339+0000 mgr.gibba009.xiladd (mgr.34457) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:12.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:12 gibba004 bash[30897]: cluster 2021-03-10T21:08:10.547848+0000 mgr.gibba009.xiladd (mgr.34457) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:12.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:12 gibba004 bash[30897]: cephadm 2021-03-10T21:08:10.771045+0000 mgr.gibba009.xiladd (mgr.34457) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:12.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:12 gibba004 bash[31878]: cluster 2021-03-10T21:08:10.547848+0000 mgr.gibba009.xiladd (mgr.34457) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:12.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:12 gibba004 bash[31878]: cephadm 2021-03-10T21:08:10.771045+0000 mgr.gibba009.xiladd (mgr.34457) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:12.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:12 gibba009 bash[26136]: cluster 2021-03-10T21:08:10.547848+0000 mgr.gibba009.xiladd (mgr.34457) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:12.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:12 gibba009 bash[26136]: cephadm 2021-03-10T21:08:10.771045+0000 mgr.gibba009.xiladd (mgr.34457) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:14.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:14 gibba004 bash[30897]: cluster 2021-03-10T21:08:12.549453+0000 mgr.gibba009.xiladd (mgr.34457) 3080 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:14.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:14 gibba004 bash[31878]: cluster 2021-03-10T21:08:12.549453+0000 mgr.gibba009.xiladd (mgr.34457) 3080 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:14.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:14 gibba009 bash[26136]: cluster 2021-03-10T21:08:12.549453+0000 mgr.gibba009.xiladd (mgr.34457) 3080 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:16.204 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:08:16.433 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:08:16.434 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (57m) 2m ago 62m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:08:16.434 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (62m) 85s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:08:16.434 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (57m) 85s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:08:16.434 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (57m) 85s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:08:16.435 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:08:16.435 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:08:16.435 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (56m) 85s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:08:16.435 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:08:16.435 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (62m) 2m ago 62m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:08:16.436 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (62m) 85s ago 62m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:08:16.436 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:08:16.436 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:08:16.436 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:08:16.436 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:08:16.437 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (53m) 85s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:08:16.437 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (53m) 85s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:08:16.437 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (53m) 85s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:08:16.437 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (52m) 85s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:08:16.438 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (62m) 85s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:08:16.438 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 2m ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:16.438 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 85s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:16.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:16 gibba004 bash[30897]: cluster 2021-03-10T21:08:14.550743+0000 mgr.gibba009.xiladd (mgr.34457) 3081 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:16.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:16 gibba004 bash[31878]: cluster 2021-03-10T21:08:14.550743+0000 mgr.gibba009.xiladd (mgr.34457) 3081 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:16 gibba009 bash[26136]: cluster 2021-03-10T21:08:14.550743+0000 mgr.gibba009.xiladd (mgr.34457) 3081 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:16.682 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:08:16.683 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:08:16.683 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:16.683 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:16.683 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:08:16.684 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:16.684 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:16.684 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:08:16.684 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:08:16.684 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:16.685 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:08:16.685 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:08:16.685 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:08:16.685 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:08:16.686 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:08:17.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:17 gibba004 bash[30897]: audit 2021-03-10T21:08:16.679140+0000 mon.c (mon.1) 907 : audit [DBG] from='client.? 172.21.2.104:0/2591183018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:17.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:17 gibba004 bash[31878]: audit 2021-03-10T21:08:16.679140+0000 mon.c (mon.1) 907 : audit [DBG] from='client.? 172.21.2.104:0/2591183018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:17.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:17 gibba009 bash[26136]: audit 2021-03-10T21:08:16.679140+0000 mon.c (mon.1) 907 : audit [DBG] from='client.? 172.21.2.104:0/2591183018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[30897]: audit 2021-03-10T21:08:16.191749+0000 mgr.gibba009.xiladd (mgr.34457) 3082 : audit [DBG] from='client.56107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[30897]: audit 2021-03-10T21:08:16.417175+0000 mgr.gibba009.xiladd (mgr.34457) 3083 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[30897]: cluster 2021-03-10T21:08:16.552619+0000 mgr.gibba009.xiladd (mgr.34457) 3084 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:18.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[31878]: audit 2021-03-10T21:08:16.191749+0000 mgr.gibba009.xiladd (mgr.34457) 3082 : audit [DBG] from='client.56107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[31878]: audit 2021-03-10T21:08:16.417175+0000 mgr.gibba009.xiladd (mgr.34457) 3083 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:18 gibba004 bash[31878]: cluster 2021-03-10T21:08:16.552619+0000 mgr.gibba009.xiladd (mgr.34457) 3084 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:18.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:18 gibba009 bash[26136]: audit 2021-03-10T21:08:16.191749+0000 mgr.gibba009.xiladd (mgr.34457) 3082 : audit [DBG] from='client.56107 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:18 gibba009 bash[26136]: audit 2021-03-10T21:08:16.417175+0000 mgr.gibba009.xiladd (mgr.34457) 3083 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:18.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:18 gibba009 bash[26136]: cluster 2021-03-10T21:08:16.552619+0000 mgr.gibba009.xiladd (mgr.34457) 3084 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:19 gibba004 bash[30897]: cluster 2021-03-10T21:08:18.554026+0000 mgr.gibba009.xiladd (mgr.34457) 3085 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:19 gibba004 bash[31878]: cluster 2021-03-10T21:08:18.554026+0000 mgr.gibba009.xiladd (mgr.34457) 3085 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:19 gibba009 bash[26136]: cluster 2021-03-10T21:08:18.554026+0000 mgr.gibba009.xiladd (mgr.34457) 3085 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:22.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:22 gibba004 bash[30897]: cluster 2021-03-10T21:08:20.555497+0000 mgr.gibba009.xiladd (mgr.34457) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:22.752 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:22 gibba004 bash[31878]: cluster 2021-03-10T21:08:20.555497+0000 mgr.gibba009.xiladd (mgr.34457) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:22.753 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:22 gibba009 bash[26136]: cluster 2021-03-10T21:08:20.555497+0000 mgr.gibba009.xiladd (mgr.34457) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:23 gibba004 bash[30897]: cluster 2021-03-10T21:08:22.557048+0000 mgr.gibba009.xiladd (mgr.34457) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:23 gibba004 bash[31878]: cluster 2021-03-10T21:08:22.557048+0000 mgr.gibba009.xiladd (mgr.34457) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:23 gibba009 bash[26136]: cluster 2021-03-10T21:08:22.557048+0000 mgr.gibba009.xiladd (mgr.34457) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:26.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:26 gibba004 bash[30897]: cluster 2021-03-10T21:08:24.558282+0000 mgr.gibba009.xiladd (mgr.34457) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:26.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:26 gibba004 bash[31878]: cluster 2021-03-10T21:08:24.558282+0000 mgr.gibba009.xiladd (mgr.34457) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:26.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:26 gibba009 bash[26136]: cluster 2021-03-10T21:08:24.558282+0000 mgr.gibba009.xiladd (mgr.34457) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:27.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:27 gibba004 bash[31878]: cephadm 2021-03-10T21:08:25.787064+0000 mgr.gibba009.xiladd (mgr.34457) 3089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:27.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:27 gibba004 bash[30897]: cephadm 2021-03-10T21:08:25.787064+0000 mgr.gibba009.xiladd (mgr.34457) 3089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:27.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:27 gibba009 bash[26136]: cephadm 2021-03-10T21:08:25.787064+0000 mgr.gibba009.xiladd (mgr.34457) 3089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:28.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:28 gibba004 bash[30897]: cluster 2021-03-10T21:08:26.560161+0000 mgr.gibba009.xiladd (mgr.34457) 3090 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:28.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:28 gibba004 bash[31878]: cluster 2021-03-10T21:08:26.560161+0000 mgr.gibba009.xiladd (mgr.34457) 3090 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:28.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:28 gibba009 bash[26136]: cluster 2021-03-10T21:08:26.560161+0000 mgr.gibba009.xiladd (mgr.34457) 3090 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:29.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:29 gibba004 bash[30897]: cluster 2021-03-10T21:08:28.561876+0000 mgr.gibba009.xiladd (mgr.34457) 3091 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:29.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:29 gibba004 bash[31878]: cluster 2021-03-10T21:08:28.561876+0000 mgr.gibba009.xiladd (mgr.34457) 3091 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:29.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:29 gibba009 bash[26136]: cluster 2021-03-10T21:08:28.561876+0000 mgr.gibba009.xiladd (mgr.34457) 3091 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:32.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:32 gibba004 bash[30897]: cluster 2021-03-10T21:08:30.563428+0000 mgr.gibba009.xiladd (mgr.34457) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:32.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:32 gibba004 bash[31878]: cluster 2021-03-10T21:08:30.563428+0000 mgr.gibba009.xiladd (mgr.34457) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:32.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:32 gibba009 bash[26136]: cluster 2021-03-10T21:08:30.563428+0000 mgr.gibba009.xiladd (mgr.34457) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:33 gibba004 bash[30897]: cluster 2021-03-10T21:08:32.564808+0000 mgr.gibba009.xiladd (mgr.34457) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:33 gibba004 bash[31878]: cluster 2021-03-10T21:08:32.564808+0000 mgr.gibba009.xiladd (mgr.34457) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:33 gibba009 bash[26136]: cluster 2021-03-10T21:08:32.564808+0000 mgr.gibba009.xiladd (mgr.34457) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:36.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:36 gibba004 bash[30897]: cluster 2021-03-10T21:08:34.566132+0000 mgr.gibba009.xiladd (mgr.34457) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:36.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:36 gibba004 bash[31878]: cluster 2021-03-10T21:08:34.566132+0000 mgr.gibba009.xiladd (mgr.34457) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:36.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:36 gibba009 bash[26136]: cluster 2021-03-10T21:08:34.566132+0000 mgr.gibba009.xiladd (mgr.34457) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:37 gibba004 bash[30897]: cluster 2021-03-10T21:08:36.568052+0000 mgr.gibba009.xiladd (mgr.34457) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.857 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:37 gibba004 bash[31878]: cluster 2021-03-10T21:08:36.568052+0000 mgr.gibba009.xiladd (mgr.34457) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.858 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:37 gibba009 bash[26136]: cluster 2021-03-10T21:08:36.568052+0000 mgr.gibba009.xiladd (mgr.34457) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:39 gibba004 bash[30897]: cluster 2021-03-10T21:08:38.569783+0000 mgr.gibba009.xiladd (mgr.34457) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:40.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:39 gibba004 bash[31878]: cluster 2021-03-10T21:08:38.569783+0000 mgr.gibba009.xiladd (mgr.34457) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:39 gibba009 bash[26136]: cluster 2021-03-10T21:08:38.569783+0000 mgr.gibba009.xiladd (mgr.34457) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.934510+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.935106+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.935848+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.936752+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.952544+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.953288+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.953778+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.953968+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.954825+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.955279+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.956335+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[30897]: audit 2021-03-10T21:08:39.957185+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.934510+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.935106+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.935848+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.936752+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.952544+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.953288+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.953778+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.953968+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.954825+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.955279+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.956335+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:40 gibba004 bash[31878]: audit 2021-03-10T21:08:39.957185+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.934510+0000 mon.c (mon.1) 908 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.935106+0000 mon.c (mon.1) 909 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.935848+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.936752+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.952544+0000 mon.c (mon.1) 910 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.953288+0000 mon.c (mon.1) 911 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.953778+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.953968+0000 mon.c (mon.1) 912 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.954825+0000 mon.c (mon.1) 913 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.955279+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T21:08:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.956335+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:08:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:40 gibba009 bash[26136]: audit 2021-03-10T21:08:39.957185+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:08:42.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:42 gibba004 bash[30897]: cluster 2021-03-10T21:08:40.571483+0000 mgr.gibba009.xiladd (mgr.34457) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:42.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:42 gibba004 bash[30897]: cephadm 2021-03-10T21:08:40.803138+0000 mgr.gibba009.xiladd (mgr.34457) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:42.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:42 gibba004 bash[31878]: cluster 2021-03-10T21:08:40.571483+0000 mgr.gibba009.xiladd (mgr.34457) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:42.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:42 gibba004 bash[31878]: cephadm 2021-03-10T21:08:40.803138+0000 mgr.gibba009.xiladd (mgr.34457) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:42.598 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:42 gibba009 bash[26136]: cluster 2021-03-10T21:08:40.571483+0000 mgr.gibba009.xiladd (mgr.34457) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:42.599 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:42 gibba009 bash[26136]: cephadm 2021-03-10T21:08:40.803138+0000 mgr.gibba009.xiladd (mgr.34457) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:43.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:43 gibba004 bash[30897]: cluster 2021-03-10T21:08:42.573171+0000 mgr.gibba009.xiladd (mgr.34457) 3099 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:43.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:43 gibba004 bash[31878]: cluster 2021-03-10T21:08:42.573171+0000 mgr.gibba009.xiladd (mgr.34457) 3099 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:43.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:43 gibba009 bash[26136]: cluster 2021-03-10T21:08:42.573171+0000 mgr.gibba009.xiladd (mgr.34457) 3099 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:46.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:46 gibba004 bash[30897]: cluster 2021-03-10T21:08:44.574540+0000 mgr.gibba009.xiladd (mgr.34457) 3100 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:46.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:46 gibba004 bash[31878]: cluster 2021-03-10T21:08:44.574540+0000 mgr.gibba009.xiladd (mgr.34457) 3100 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:46.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:46 gibba009 bash[26136]: cluster 2021-03-10T21:08:44.574540+0000 mgr.gibba009.xiladd (mgr.34457) 3100 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:46.936 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:08:47.163 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:08:47.163 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (57m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:08:47.163 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (62m) 116s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:08:47.164 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (58m) 116s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:08:47.164 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (58m) 116s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:08:47.164 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:08:47.164 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:08:47.165 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (56m) 116s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:08:47.165 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:08:47.165 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:08:47.166 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (63m) 116s ago 63m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:08:47.166 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:08:47.166 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:08:47.167 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:08:47.167 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:08:47.167 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (54m) 116s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:08:47.168 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (53m) 116s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:08:47.168 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (53m) 116s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:08:47.168 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (53m) 116s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:08:47.169 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (62m) 116s ago 63m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:08:47.169 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:47.170 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 116s ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:47.408 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:08:47.409 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:08:47.409 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:47.409 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:47.410 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:08:47.410 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:47.410 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:47.411 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:08:47.411 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:08:47.412 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:08:47.412 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:08:47.412 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:08:47.413 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:08:47.413 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:08:47.414 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:08:48.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[30897]: cluster 2021-03-10T21:08:46.576112+0000 mgr.gibba009.xiladd (mgr.34457) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:48.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[30897]: audit 2021-03-10T21:08:46.922769+0000 mgr.gibba009.xiladd (mgr.34457) 3102 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:48.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[30897]: audit 2021-03-10T21:08:47.405147+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.2.104:0/1963584160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:48.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[31878]: cluster 2021-03-10T21:08:46.576112+0000 mgr.gibba009.xiladd (mgr.34457) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:48.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[31878]: audit 2021-03-10T21:08:46.922769+0000 mgr.gibba009.xiladd (mgr.34457) 3102 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:48.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:48 gibba004 bash[31878]: audit 2021-03-10T21:08:47.405147+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.2.104:0/1963584160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:48.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:48 gibba009 bash[26136]: cluster 2021-03-10T21:08:46.576112+0000 mgr.gibba009.xiladd (mgr.34457) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:48.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:48 gibba009 bash[26136]: audit 2021-03-10T21:08:46.922769+0000 mgr.gibba009.xiladd (mgr.34457) 3102 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:48.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:48 gibba009 bash[26136]: audit 2021-03-10T21:08:47.405147+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.2.104:0/1963584160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:49 gibba004 bash[30897]: audit 2021-03-10T21:08:47.148920+0000 mgr.gibba009.xiladd (mgr.34457) 3103 : audit [DBG] from='client.46152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:49.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:49 gibba004 bash[30897]: cluster 2021-03-10T21:08:48.577786+0000 mgr.gibba009.xiladd (mgr.34457) 3104 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:49 gibba004 bash[31878]: audit 2021-03-10T21:08:47.148920+0000 mgr.gibba009.xiladd (mgr.34457) 3103 : audit [DBG] from='client.46152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:49.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:49 gibba004 bash[31878]: cluster 2021-03-10T21:08:48.577786+0000 mgr.gibba009.xiladd (mgr.34457) 3104 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:49 gibba009 bash[26136]: audit 2021-03-10T21:08:47.148920+0000 mgr.gibba009.xiladd (mgr.34457) 3103 : audit [DBG] from='client.46152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:49.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:49 gibba009 bash[26136]: cluster 2021-03-10T21:08:48.577786+0000 mgr.gibba009.xiladd (mgr.34457) 3104 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:52.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:52 gibba004 bash[30897]: cluster 2021-03-10T21:08:50.579159+0000 mgr.gibba009.xiladd (mgr.34457) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:52.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:52 gibba004 bash[31878]: cluster 2021-03-10T21:08:50.579159+0000 mgr.gibba009.xiladd (mgr.34457) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:52 gibba009 bash[26136]: cluster 2021-03-10T21:08:50.579159+0000 mgr.gibba009.xiladd (mgr.34457) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:53 gibba004 bash[30897]: cluster 2021-03-10T21:08:52.579675+0000 mgr.gibba009.xiladd (mgr.34457) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:53 gibba004 bash[31878]: cluster 2021-03-10T21:08:52.579675+0000 mgr.gibba009.xiladd (mgr.34457) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:53 gibba009 bash[26136]: cluster 2021-03-10T21:08:52.579675+0000 mgr.gibba009.xiladd (mgr.34457) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: cluster 2021-03-10T21:08:54.580828+0000 mgr.gibba009.xiladd (mgr.34457) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:55.820430+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.052578+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:08:56.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.056569+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.058298+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.059636+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.060959+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.064132+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:56 gibba009 bash[26136]: audit 2021-03-10T21:08:56.065875+0000 mon.c (mon.1) 920 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: cluster 2021-03-10T21:08:54.580828+0000 mgr.gibba009.xiladd (mgr.34457) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:55.820430+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.052578+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:08:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.056569+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.058298+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.059636+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.060959+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.064132+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[30897]: audit 2021-03-10T21:08:56.065875+0000 mon.c (mon.1) 920 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: cluster 2021-03-10T21:08:54.580828+0000 mgr.gibba009.xiladd (mgr.34457) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:55.820430+0000 mon.c (mon.1) 914 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.052578+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:08:56.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.056569+0000 mon.c (mon.1) 915 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.058298+0000 mon.c (mon.1) 916 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.059636+0000 mon.c (mon.1) 917 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.060959+0000 mon.c (mon.1) 918 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.570 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.064132+0000 mon.c (mon.1) 919 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:56.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:56 gibba004 bash[31878]: audit 2021-03-10T21:08:56.065875+0000 mon.c (mon.1) 920 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:57.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:55.824994+0000 mgr.gibba009.xiladd (mgr.34457) 3108 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:08:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:55.826784+0000 mgr.gibba009.xiladd (mgr.34457) 3109 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:08:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.055381+0000 mgr.gibba009.xiladd (mgr.34457) 3110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.057279+0000 mgr.gibba009.xiladd (mgr.34457) 3111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:57.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.058667+0000 mgr.gibba009.xiladd (mgr.34457) 3112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.058707+0000 mgr.gibba009.xiladd (mgr.34457) 3113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.059992+0000 mgr.gibba009.xiladd (mgr.34457) 3114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.060030+0000 mgr.gibba009.xiladd (mgr.34457) 3115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:57.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.061508+0000 mgr.gibba009.xiladd (mgr.34457) 3116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.063101+0000 mgr.gibba009.xiladd (mgr.34457) 3117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.063143+0000 mgr.gibba009.xiladd (mgr.34457) 3118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.064668+0000 mgr.gibba009.xiladd (mgr.34457) 3119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:57.569 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.065021+0000 mgr.gibba009.xiladd (mgr.34457) 3120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.066466+0000 mgr.gibba009.xiladd (mgr.34457) 3121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.066509+0000 mgr.gibba009.xiladd (mgr.34457) 3122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:57.570 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[30897]: cephadm 2021-03-10T21:08:56.066703+0000 mgr.gibba009.xiladd (mgr.34457) 3123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:55.824994+0000 mgr.gibba009.xiladd (mgr.34457) 3108 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:08:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:55.826784+0000 mgr.gibba009.xiladd (mgr.34457) 3109 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:08:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.055381+0000 mgr.gibba009.xiladd (mgr.34457) 3110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:57.571 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.057279+0000 mgr.gibba009.xiladd (mgr.34457) 3111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.058667+0000 mgr.gibba009.xiladd (mgr.34457) 3112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.058707+0000 mgr.gibba009.xiladd (mgr.34457) 3113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.059992+0000 mgr.gibba009.xiladd (mgr.34457) 3114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.060030+0000 mgr.gibba009.xiladd (mgr.34457) 3115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:57.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.061508+0000 mgr.gibba009.xiladd (mgr.34457) 3116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.063101+0000 mgr.gibba009.xiladd (mgr.34457) 3117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.063143+0000 mgr.gibba009.xiladd (mgr.34457) 3118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.064668+0000 mgr.gibba009.xiladd (mgr.34457) 3119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.065021+0000 mgr.gibba009.xiladd (mgr.34457) 3120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:57.573 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.066466+0000 mgr.gibba009.xiladd (mgr.34457) 3121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:57.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.066509+0000 mgr.gibba009.xiladd (mgr.34457) 3122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:57.574 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:57 gibba004 bash[31878]: cephadm 2021-03-10T21:08:56.066703+0000 mgr.gibba009.xiladd (mgr.34457) 3123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:55.824994+0000 mgr.gibba009.xiladd (mgr.34457) 3108 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:08:57.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:55.826784+0000 mgr.gibba009.xiladd (mgr.34457) 3109 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:08:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.055381+0000 mgr.gibba009.xiladd (mgr.34457) 3110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.057279+0000 mgr.gibba009.xiladd (mgr.34457) 3111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:57.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.058667+0000 mgr.gibba009.xiladd (mgr.34457) 3112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.058707+0000 mgr.gibba009.xiladd (mgr.34457) 3113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.059992+0000 mgr.gibba009.xiladd (mgr.34457) 3114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.060030+0000 mgr.gibba009.xiladd (mgr.34457) 3115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:57.593 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.061508+0000 mgr.gibba009.xiladd (mgr.34457) 3116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.063101+0000 mgr.gibba009.xiladd (mgr.34457) 3117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.063143+0000 mgr.gibba009.xiladd (mgr.34457) 3118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.064668+0000 mgr.gibba009.xiladd (mgr.34457) 3119 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:57.594 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.065021+0000 mgr.gibba009.xiladd (mgr.34457) 3120 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:57.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.066466+0000 mgr.gibba009.xiladd (mgr.34457) 3121 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:57.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.066509+0000 mgr.gibba009.xiladd (mgr.34457) 3122 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:57.595 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:57 gibba009 bash[26136]: cephadm 2021-03-10T21:08:56.066703+0000 mgr.gibba009.xiladd (mgr.34457) 3123 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:08:58.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:58 gibba004 bash[30897]: cluster 2021-03-10T21:08:56.582362+0000 mgr.gibba009.xiladd (mgr.34457) 3124 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:58.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:58 gibba004 bash[31878]: cluster 2021-03-10T21:08:56.582362+0000 mgr.gibba009.xiladd (mgr.34457) 3124 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:58.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:58 gibba009 bash[26136]: cluster 2021-03-10T21:08:56.582362+0000 mgr.gibba009.xiladd (mgr.34457) 3124 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:08:59 gibba004 bash[30897]: cluster 2021-03-10T21:08:58.583126+0000 mgr.gibba009.xiladd (mgr.34457) 3125 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:08:59 gibba004 bash[31878]: cluster 2021-03-10T21:08:58.583126+0000 mgr.gibba009.xiladd (mgr.34457) 3125 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:08:59 gibba009 bash[26136]: cluster 2021-03-10T21:08:58.583126+0000 mgr.gibba009.xiladd (mgr.34457) 3125 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:02.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:02 gibba004 bash[30897]: cluster 2021-03-10T21:09:00.584503+0000 mgr.gibba009.xiladd (mgr.34457) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:02.572 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:02 gibba004 bash[31878]: cluster 2021-03-10T21:09:00.584503+0000 mgr.gibba009.xiladd (mgr.34457) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:02.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:02 gibba009 bash[26136]: cluster 2021-03-10T21:09:00.584503+0000 mgr.gibba009.xiladd (mgr.34457) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:03 gibba004 bash[30897]: cluster 2021-03-10T21:09:02.586118+0000 mgr.gibba009.xiladd (mgr.34457) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:03 gibba004 bash[31878]: cluster 2021-03-10T21:09:02.586118+0000 mgr.gibba009.xiladd (mgr.34457) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:03 gibba009 bash[26136]: cluster 2021-03-10T21:09:02.586118+0000 mgr.gibba009.xiladd (mgr.34457) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:06.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:06 gibba004 bash[30897]: cluster 2021-03-10T21:09:04.587590+0000 mgr.gibba009.xiladd (mgr.34457) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:06.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:06 gibba004 bash[31878]: cluster 2021-03-10T21:09:04.587590+0000 mgr.gibba009.xiladd (mgr.34457) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:06.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:06 gibba009 bash[26136]: cluster 2021-03-10T21:09:04.587590+0000 mgr.gibba009.xiladd (mgr.34457) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:07 gibba004 bash[30897]: cluster 2021-03-10T21:09:06.589155+0000 mgr.gibba009.xiladd (mgr.34457) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:07 gibba004 bash[31878]: cluster 2021-03-10T21:09:06.589155+0000 mgr.gibba009.xiladd (mgr.34457) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:07 gibba009 bash[26136]: cluster 2021-03-10T21:09:06.589155+0000 mgr.gibba009.xiladd (mgr.34457) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:10.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:09 gibba004 bash[30897]: cluster 2021-03-10T21:09:08.590679+0000 mgr.gibba009.xiladd (mgr.34457) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:10.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:09 gibba004 bash[31878]: cluster 2021-03-10T21:09:08.590679+0000 mgr.gibba009.xiladd (mgr.34457) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:10.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:09 gibba009 bash[26136]: cluster 2021-03-10T21:09:08.590679+0000 mgr.gibba009.xiladd (mgr.34457) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:12.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:12 gibba004 bash[30897]: cluster 2021-03-10T21:09:10.591319+0000 mgr.gibba009.xiladd (mgr.34457) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:12.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:12 gibba004 bash[30897]: cephadm 2021-03-10T21:09:11.082759+0000 mgr.gibba009.xiladd (mgr.34457) 3132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:12.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:12 gibba004 bash[31878]: cluster 2021-03-10T21:09:10.591319+0000 mgr.gibba009.xiladd (mgr.34457) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:12.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:12 gibba004 bash[31878]: cephadm 2021-03-10T21:09:11.082759+0000 mgr.gibba009.xiladd (mgr.34457) 3132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:12.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:12 gibba009 bash[26136]: cluster 2021-03-10T21:09:10.591319+0000 mgr.gibba009.xiladd (mgr.34457) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:12.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:12 gibba009 bash[26136]: cephadm 2021-03-10T21:09:11.082759+0000 mgr.gibba009.xiladd (mgr.34457) 3132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:13.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:13 gibba004 bash[30897]: cluster 2021-03-10T21:09:12.592754+0000 mgr.gibba009.xiladd (mgr.34457) 3133 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:13.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:13 gibba004 bash[31878]: cluster 2021-03-10T21:09:12.592754+0000 mgr.gibba009.xiladd (mgr.34457) 3133 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:13 gibba009 bash[26136]: cluster 2021-03-10T21:09:12.592754+0000 mgr.gibba009.xiladd (mgr.34457) 3133 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:16 gibba004 bash[30897]: cluster 2021-03-10T21:09:14.594058+0000 mgr.gibba009.xiladd (mgr.34457) 3134 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:16.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:16 gibba004 bash[31878]: cluster 2021-03-10T21:09:14.594058+0000 mgr.gibba009.xiladd (mgr.34457) 3134 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:16.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:16 gibba009 bash[26136]: cluster 2021-03-10T21:09:14.594058+0000 mgr.gibba009.xiladd (mgr.34457) 3134 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:17 gibba004 bash[30897]: cluster 2021-03-10T21:09:16.595707+0000 mgr.gibba009.xiladd (mgr.34457) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:17 gibba004 bash[31878]: cluster 2021-03-10T21:09:16.595707+0000 mgr.gibba009.xiladd (mgr.34457) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:17 gibba009 bash[26136]: cluster 2021-03-10T21:09:16.595707+0000 mgr.gibba009.xiladd (mgr.34457) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.695 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:09:17.925 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:09:17.926 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (58m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:09:17.926 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:09:17.926 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:09:17.927 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:09:17.927 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:09:17.927 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:09:17.927 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:09:17.928 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:09:17.928 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:09:17.928 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:09:17.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:09:17.928 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:09:17.929 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:09:17.929 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:09:17.929 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:09:17.929 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:09:17.930 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:09:17.930 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:09:17.930 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (63m) 2m ago 63m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:09:17.930 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 3m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:17.931 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:18.175 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:09:18.176 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:09:18.176 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:18.176 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:18.176 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:09:18.177 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:18.177 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:18.177 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:09:18.177 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:09:18.177 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:18.178 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:09:18.178 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:09:18.178 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:09:18.178 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:09:18.179 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:09:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:18 gibba004 bash[30897]: audit 2021-03-10T21:09:17.682983+0000 mgr.gibba009.xiladd (mgr.34457) 3136 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:18.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:18 gibba004 bash[30897]: audit 2021-03-10T21:09:17.908990+0000 mgr.gibba009.xiladd (mgr.34457) 3137 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:18.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:18 gibba004 bash[31878]: audit 2021-03-10T21:09:17.682983+0000 mgr.gibba009.xiladd (mgr.34457) 3136 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:18.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:18 gibba004 bash[31878]: audit 2021-03-10T21:09:17.908990+0000 mgr.gibba009.xiladd (mgr.34457) 3137 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:18.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:18 gibba009 bash[26136]: audit 2021-03-10T21:09:17.682983+0000 mgr.gibba009.xiladd (mgr.34457) 3136 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:18.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:18 gibba009 bash[26136]: audit 2021-03-10T21:09:17.908990+0000 mgr.gibba009.xiladd (mgr.34457) 3137 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:19.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:19 gibba004 bash[30897]: audit 2021-03-10T21:09:18.171178+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.104:0/3870814855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:19.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:19 gibba004 bash[30897]: cluster 2021-03-10T21:09:18.597126+0000 mgr.gibba009.xiladd (mgr.34457) 3138 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:19 gibba004 bash[31878]: audit 2021-03-10T21:09:18.171178+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.104:0/3870814855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:19.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:19 gibba004 bash[31878]: cluster 2021-03-10T21:09:18.597126+0000 mgr.gibba009.xiladd (mgr.34457) 3138 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:19 gibba009 bash[26136]: audit 2021-03-10T21:09:18.171178+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.104:0/3870814855' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:19.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:19 gibba009 bash[26136]: cluster 2021-03-10T21:09:18.597126+0000 mgr.gibba009.xiladd (mgr.34457) 3138 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:21.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:21 gibba004 bash[30897]: cluster 2021-03-10T21:09:20.598583+0000 mgr.gibba009.xiladd (mgr.34457) 3139 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:21.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:21 gibba004 bash[31878]: cluster 2021-03-10T21:09:20.598583+0000 mgr.gibba009.xiladd (mgr.34457) 3139 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:21.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:21 gibba009 bash[26136]: cluster 2021-03-10T21:09:20.598583+0000 mgr.gibba009.xiladd (mgr.34457) 3139 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:24.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:23 gibba004 bash[30897]: cluster 2021-03-10T21:09:22.599313+0000 mgr.gibba009.xiladd (mgr.34457) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:24.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:23 gibba004 bash[31878]: cluster 2021-03-10T21:09:22.599313+0000 mgr.gibba009.xiladd (mgr.34457) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:24.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:23 gibba009 bash[26136]: cluster 2021-03-10T21:09:22.599313+0000 mgr.gibba009.xiladd (mgr.34457) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:26.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:26 gibba004 bash[30897]: cluster 2021-03-10T21:09:24.600479+0000 mgr.gibba009.xiladd (mgr.34457) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:26.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:26 gibba004 bash[31878]: cluster 2021-03-10T21:09:24.600479+0000 mgr.gibba009.xiladd (mgr.34457) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:26.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:26 gibba009 bash[26136]: cluster 2021-03-10T21:09:24.600479+0000 mgr.gibba009.xiladd (mgr.34457) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:27 gibba004 bash[30897]: cephadm 2021-03-10T21:09:26.098783+0000 mgr.gibba009.xiladd (mgr.34457) 3142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:27.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:27 gibba004 bash[30897]: cluster 2021-03-10T21:09:26.602143+0000 mgr.gibba009.xiladd (mgr.34457) 3143 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:27 gibba004 bash[31878]: cephadm 2021-03-10T21:09:26.098783+0000 mgr.gibba009.xiladd (mgr.34457) 3142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:27.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:27 gibba004 bash[31878]: cluster 2021-03-10T21:09:26.602143+0000 mgr.gibba009.xiladd (mgr.34457) 3143 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:27 gibba009 bash[26136]: cephadm 2021-03-10T21:09:26.098783+0000 mgr.gibba009.xiladd (mgr.34457) 3142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:27.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:27 gibba009 bash[26136]: cluster 2021-03-10T21:09:26.602143+0000 mgr.gibba009.xiladd (mgr.34457) 3143 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:29 gibba004 bash[30897]: cluster 2021-03-10T21:09:28.602946+0000 mgr.gibba009.xiladd (mgr.34457) 3144 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:30.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:29 gibba004 bash[31878]: cluster 2021-03-10T21:09:28.602946+0000 mgr.gibba009.xiladd (mgr.34457) 3144 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:30.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:29 gibba009 bash[26136]: cluster 2021-03-10T21:09:28.602946+0000 mgr.gibba009.xiladd (mgr.34457) 3144 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:31 gibba004 bash[30897]: cluster 2021-03-10T21:09:30.604441+0000 mgr.gibba009.xiladd (mgr.34457) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:31 gibba004 bash[31878]: cluster 2021-03-10T21:09:30.604441+0000 mgr.gibba009.xiladd (mgr.34457) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:31 gibba009 bash[26136]: cluster 2021-03-10T21:09:30.604441+0000 mgr.gibba009.xiladd (mgr.34457) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:33 gibba004 bash[30897]: cluster 2021-03-10T21:09:32.605868+0000 mgr.gibba009.xiladd (mgr.34457) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:34.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:33 gibba004 bash[31878]: cluster 2021-03-10T21:09:32.605868+0000 mgr.gibba009.xiladd (mgr.34457) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:34.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:33 gibba009 bash[26136]: cluster 2021-03-10T21:09:32.605868+0000 mgr.gibba009.xiladd (mgr.34457) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:36.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:36 gibba004 bash[30897]: cluster 2021-03-10T21:09:34.606668+0000 mgr.gibba009.xiladd (mgr.34457) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:36.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:36 gibba004 bash[31878]: cluster 2021-03-10T21:09:34.606668+0000 mgr.gibba009.xiladd (mgr.34457) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:36.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:36 gibba009 bash[26136]: cluster 2021-03-10T21:09:34.606668+0000 mgr.gibba009.xiladd (mgr.34457) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:37 gibba004 bash[30897]: cluster 2021-03-10T21:09:36.608070+0000 mgr.gibba009.xiladd (mgr.34457) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:37 gibba004 bash[31878]: cluster 2021-03-10T21:09:36.608070+0000 mgr.gibba009.xiladd (mgr.34457) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:37 gibba009 bash[26136]: cluster 2021-03-10T21:09:36.608070+0000 mgr.gibba009.xiladd (mgr.34457) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:39 gibba004 bash[30897]: cluster 2021-03-10T21:09:38.609822+0000 mgr.gibba009.xiladd (mgr.34457) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:39 gibba004 bash[31878]: cluster 2021-03-10T21:09:38.609822+0000 mgr.gibba009.xiladd (mgr.34457) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:39 gibba009 bash[26136]: cluster 2021-03-10T21:09:38.609822+0000 mgr.gibba009.xiladd (mgr.34457) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.942161+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.942819+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.943349+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.944405+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.958635+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.959391+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.959869+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.960104+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.960826+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.961555+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.962633+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[30897]: audit 2021-03-10T21:09:39.963445+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.942161+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.942819+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.943349+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.944405+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.073 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.958635+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.959391+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.959869+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.074 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.960104+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.960826+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:41.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.961555+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.075 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.962633+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.076 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:40 gibba004 bash[31878]: audit 2021-03-10T21:09:39.963445+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.942161+0000 mon.c (mon.1) 921 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.942819+0000 mon.c (mon.1) 922 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.943349+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.944405+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.958635+0000 mon.c (mon.1) 923 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.959391+0000 mon.c (mon.1) 924 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.959869+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:09:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.960104+0000 mon.c (mon.1) 925 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.960826+0000 mon.c (mon.1) 926 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.961555+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.962633+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:09:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:40 gibba009 bash[26136]: audit 2021-03-10T21:09:39.963445+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T21:09:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:41 gibba004 bash[30897]: cluster 2021-03-10T21:09:40.610754+0000 mgr.gibba009.xiladd (mgr.34457) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:41 gibba004 bash[30897]: cephadm 2021-03-10T21:09:41.114403+0000 mgr.gibba009.xiladd (mgr.34457) 3151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:42.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:41 gibba004 bash[31878]: cluster 2021-03-10T21:09:40.610754+0000 mgr.gibba009.xiladd (mgr.34457) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:42.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:41 gibba004 bash[31878]: cephadm 2021-03-10T21:09:41.114403+0000 mgr.gibba009.xiladd (mgr.34457) 3151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:42.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:41 gibba009 bash[26136]: cluster 2021-03-10T21:09:40.610754+0000 mgr.gibba009.xiladd (mgr.34457) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:42.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:41 gibba009 bash[26136]: cephadm 2021-03-10T21:09:41.114403+0000 mgr.gibba009.xiladd (mgr.34457) 3151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:43 gibba004 bash[30897]: cluster 2021-03-10T21:09:42.612346+0000 mgr.gibba009.xiladd (mgr.34457) 3152 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:44.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:43 gibba004 bash[31878]: cluster 2021-03-10T21:09:42.612346+0000 mgr.gibba009.xiladd (mgr.34457) 3152 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:44.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:43 gibba009 bash[26136]: cluster 2021-03-10T21:09:42.612346+0000 mgr.gibba009.xiladd (mgr.34457) 3152 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:46.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:46 gibba004 bash[30897]: cluster 2021-03-10T21:09:44.613646+0000 mgr.gibba009.xiladd (mgr.34457) 3153 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:46.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:46 gibba004 bash[31878]: cluster 2021-03-10T21:09:44.613646+0000 mgr.gibba009.xiladd (mgr.34457) 3153 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:46.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:46 gibba009 bash[26136]: cluster 2021-03-10T21:09:44.613646+0000 mgr.gibba009.xiladd (mgr.34457) 3153 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:47 gibba004 bash[30897]: cluster 2021-03-10T21:09:46.614319+0000 mgr.gibba009.xiladd (mgr.34457) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:47 gibba004 bash[31878]: cluster 2021-03-10T21:09:46.614319+0000 mgr.gibba009.xiladd (mgr.34457) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:47 gibba009 bash[26136]: cluster 2021-03-10T21:09:46.614319+0000 mgr.gibba009.xiladd (mgr.34457) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:48.424 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:09:48.656 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:09:48.657 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (58m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:09:48.657 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:09:48.658 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:09:48.658 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:09:48.659 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:09:48.659 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:09:48.660 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:09:48.660 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (57m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:09:48.661 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:09:48.661 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (64m) 2m ago 64m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:09:48.661 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:09:48.662 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:09:48.665 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:09:48.665 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:09:48.666 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:09:48.666 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:09:48.667 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:09:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:09:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:09:48.669 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:48.670 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 2m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:48.901 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:09:48.902 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:09:48.902 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:48.902 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:48.903 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:09:48.903 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:48.903 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:48.903 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:09:48.903 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:09:48.904 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:09:48.904 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:09:48.904 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:09:48.904 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:09:48.905 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:09:48.905 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:09:50.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[30897]: audit 2021-03-10T21:09:48.410054+0000 mgr.gibba009.xiladd (mgr.34457) 3155 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[30897]: cluster 2021-03-10T21:09:48.615836+0000 mgr.gibba009.xiladd (mgr.34457) 3156 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:50.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[30897]: audit 2021-03-10T21:09:48.634112+0000 mgr.gibba009.xiladd (mgr.34457) 3157 : audit [DBG] from='client.56167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[30897]: audit 2021-03-10T21:09:48.897738+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.2.104:0/658823206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[31878]: audit 2021-03-10T21:09:48.410054+0000 mgr.gibba009.xiladd (mgr.34457) 3155 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[31878]: cluster 2021-03-10T21:09:48.615836+0000 mgr.gibba009.xiladd (mgr.34457) 3156 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:50.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[31878]: audit 2021-03-10T21:09:48.634112+0000 mgr.gibba009.xiladd (mgr.34457) 3157 : audit [DBG] from='client.56167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:49 gibba004 bash[31878]: audit 2021-03-10T21:09:48.897738+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.2.104:0/658823206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:49 gibba009 bash[26136]: audit 2021-03-10T21:09:48.410054+0000 mgr.gibba009.xiladd (mgr.34457) 3155 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:49 gibba009 bash[26136]: cluster 2021-03-10T21:09:48.615836+0000 mgr.gibba009.xiladd (mgr.34457) 3156 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:50.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:49 gibba009 bash[26136]: audit 2021-03-10T21:09:48.634112+0000 mgr.gibba009.xiladd (mgr.34457) 3157 : audit [DBG] from='client.56167 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:50.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:49 gibba009 bash[26136]: audit 2021-03-10T21:09:48.897738+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.2.104:0/658823206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:51.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:51 gibba004 bash[30897]: cluster 2021-03-10T21:09:50.617539+0000 mgr.gibba009.xiladd (mgr.34457) 3158 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:51.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:51 gibba004 bash[31878]: cluster 2021-03-10T21:09:50.617539+0000 mgr.gibba009.xiladd (mgr.34457) 3158 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:51.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:51 gibba009 bash[26136]: cluster 2021-03-10T21:09:50.617539+0000 mgr.gibba009.xiladd (mgr.34457) 3158 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:53 gibba004 bash[30897]: cluster 2021-03-10T21:09:52.618216+0000 mgr.gibba009.xiladd (mgr.34457) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:54.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:53 gibba004 bash[31878]: cluster 2021-03-10T21:09:52.618216+0000 mgr.gibba009.xiladd (mgr.34457) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:54.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:53 gibba009 bash[26136]: cluster 2021-03-10T21:09:52.618216+0000 mgr.gibba009.xiladd (mgr.34457) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:56.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:56 gibba004 bash[30897]: cluster 2021-03-10T21:09:54.619759+0000 mgr.gibba009.xiladd (mgr.34457) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:56.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:56 gibba004 bash[30897]: audit 2021-03-10T21:09:56.129684+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:56.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:56 gibba004 bash[31878]: cluster 2021-03-10T21:09:54.619759+0000 mgr.gibba009.xiladd (mgr.34457) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:56.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:56 gibba004 bash[31878]: audit 2021-03-10T21:09:56.129684+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:56.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:56 gibba009 bash[26136]: cluster 2021-03-10T21:09:54.619759+0000 mgr.gibba009.xiladd (mgr.34457) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:56.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:56 gibba009 bash[26136]: audit 2021-03-10T21:09:56.129684+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:57.817 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.134806+0000 mgr.gibba009.xiladd (mgr.34457) 3161 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:09:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.136947+0000 mgr.gibba009.xiladd (mgr.34457) 3162 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:09:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.352844+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:09:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.355491+0000 mgr.gibba009.xiladd (mgr.34457) 3163 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:57.818 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.356749+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.357535+0000 mgr.gibba009.xiladd (mgr.34457) 3164 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.358419+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.359431+0000 mgr.gibba009.xiladd (mgr.34457) 3165 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:57.819 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.359467+0000 mgr.gibba009.xiladd (mgr.34457) 3166 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:57.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.360440+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.361046+0000 mgr.gibba009.xiladd (mgr.34457) 3167 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:57.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.361158+0000 mgr.gibba009.xiladd (mgr.34457) 3168 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:57.820 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.361976+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.362413+0000 mgr.gibba009.xiladd (mgr.34457) 3169 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:57.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.364145+0000 mgr.gibba009.xiladd (mgr.34457) 3170 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:57.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.364182+0000 mgr.gibba009.xiladd (mgr.34457) 3171 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:57.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.365113+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.821 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.365857+0000 mgr.gibba009.xiladd (mgr.34457) 3172 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:57.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.366175+0000 mgr.gibba009.xiladd (mgr.34457) 3173 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:57.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: audit 2021-03-10T21:09:56.366962+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.822 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.367659+0000 mgr.gibba009.xiladd (mgr.34457) 3174 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.134806+0000 mgr.gibba009.xiladd (mgr.34457) 3161 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:09:57.823 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.136947+0000 mgr.gibba009.xiladd (mgr.34457) 3162 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:09:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.352844+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:09:57.824 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.355491+0000 mgr.gibba009.xiladd (mgr.34457) 3163 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:57.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.356749+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:57.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.357535+0000 mgr.gibba009.xiladd (mgr.34457) 3164 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:57.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.358419+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.825 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.359431+0000 mgr.gibba009.xiladd (mgr.34457) 3165 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.359467+0000 mgr.gibba009.xiladd (mgr.34457) 3166 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.360440+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.361046+0000 mgr.gibba009.xiladd (mgr.34457) 3167 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.361158+0000 mgr.gibba009.xiladd (mgr.34457) 3168 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:57.826 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.361976+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.362413+0000 mgr.gibba009.xiladd (mgr.34457) 3169 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.364145+0000 mgr.gibba009.xiladd (mgr.34457) 3170 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.364182+0000 mgr.gibba009.xiladd (mgr.34457) 3171 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.365113+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.827 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.365857+0000 mgr.gibba009.xiladd (mgr.34457) 3172 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:57.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.366175+0000 mgr.gibba009.xiladd (mgr.34457) 3173 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:57.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: audit 2021-03-10T21:09:56.366962+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.828 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.367659+0000 mgr.gibba009.xiladd (mgr.34457) 3174 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:57.829 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.367695+0000 mgr.gibba009.xiladd (mgr.34457) 3175 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:57.829 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cephadm 2021-03-10T21:09:56.367820+0000 mgr.gibba009.xiladd (mgr.34457) 3176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:57.829 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[30897]: cluster 2021-03-10T21:09:56.621160+0000 mgr.gibba009.xiladd (mgr.34457) 3177 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:57.829 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.367695+0000 mgr.gibba009.xiladd (mgr.34457) 3175 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:57.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cephadm 2021-03-10T21:09:56.367820+0000 mgr.gibba009.xiladd (mgr.34457) 3176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:57.830 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:57 gibba004 bash[31878]: cluster 2021-03-10T21:09:56.621160+0000 mgr.gibba009.xiladd (mgr.34457) 3177 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:57.841 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.134806+0000 mgr.gibba009.xiladd (mgr.34457) 3161 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:09:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.136947+0000 mgr.gibba009.xiladd (mgr.34457) 3162 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:09:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.352844+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:09:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.355491+0000 mgr.gibba009.xiladd (mgr.34457) 3163 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:57.842 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.356749+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.357535+0000 mgr.gibba009.xiladd (mgr.34457) 3164 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.358419+0000 mon.c (mon.1) 929 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.359431+0000 mgr.gibba009.xiladd (mgr.34457) 3165 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:57.843 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.359467+0000 mgr.gibba009.xiladd (mgr.34457) 3166 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.360440+0000 mon.c (mon.1) 930 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.361046+0000 mgr.gibba009.xiladd (mgr.34457) 3167 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.361158+0000 mgr.gibba009.xiladd (mgr.34457) 3168 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.361976+0000 mon.c (mon.1) 931 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.844 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.362413+0000 mgr.gibba009.xiladd (mgr.34457) 3169 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:57.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.364145+0000 mgr.gibba009.xiladd (mgr.34457) 3170 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:57.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.364182+0000 mgr.gibba009.xiladd (mgr.34457) 3171 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:57.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.365113+0000 mon.c (mon.1) 932 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.365857+0000 mgr.gibba009.xiladd (mgr.34457) 3172 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:57.845 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.366175+0000 mgr.gibba009.xiladd (mgr.34457) 3173 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:57.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: audit 2021-03-10T21:09:56.366962+0000 mon.c (mon.1) 933 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:57.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.367659+0000 mgr.gibba009.xiladd (mgr.34457) 3174 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:57.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.367695+0000 mgr.gibba009.xiladd (mgr.34457) 3175 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:57.846 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cephadm 2021-03-10T21:09:56.367820+0000 mgr.gibba009.xiladd (mgr.34457) 3176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:09:57.847 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:57 gibba009 bash[26136]: cluster 2021-03-10T21:09:56.621160+0000 mgr.gibba009.xiladd (mgr.34457) 3177 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:00.004 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:09:59 gibba004 bash[30897]: cluster 2021-03-10T21:09:58.622568+0000 mgr.gibba009.xiladd (mgr.34457) 3178 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:00.005 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:09:59 gibba004 bash[31878]: cluster 2021-03-10T21:09:58.622568+0000 mgr.gibba009.xiladd (mgr.34457) 3178 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:00.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:09:59 gibba009 bash[26136]: cluster 2021-03-10T21:09:58.622568+0000 mgr.gibba009.xiladd (mgr.34457) 3178 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:00.315 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:00 gibba004 bash[30897]: debug 2021-03-10T21:09:59.997+0000 7f2f76ee5700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:01.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:00 gibba004 bash[30897]: cluster 2021-03-10T21:10:00.000184+0000 mon.a (mon.0) 1049 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:01.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:00 gibba004 bash[31878]: cluster 2021-03-10T21:10:00.000184+0000 mon.a (mon.0) 1049 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:01.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:00 gibba009 bash[26136]: cluster 2021-03-10T21:10:00.000184+0000 mon.a (mon.0) 1049 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:02.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:01 gibba004 bash[30897]: cluster 2021-03-10T21:10:00.624255+0000 mgr.gibba009.xiladd (mgr.34457) 3179 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:02.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:01 gibba004 bash[31878]: cluster 2021-03-10T21:10:00.624255+0000 mgr.gibba009.xiladd (mgr.34457) 3179 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:02.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:01 gibba009 bash[26136]: cluster 2021-03-10T21:10:00.624255+0000 mgr.gibba009.xiladd (mgr.34457) 3179 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:04.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:03 gibba004 bash[30897]: cluster 2021-03-10T21:10:02.625912+0000 mgr.gibba009.xiladd (mgr.34457) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:04.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:03 gibba004 bash[31878]: cluster 2021-03-10T21:10:02.625912+0000 mgr.gibba009.xiladd (mgr.34457) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:04.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:03 gibba009 bash[26136]: cluster 2021-03-10T21:10:02.625912+0000 mgr.gibba009.xiladd (mgr.34457) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:06.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:06 gibba004 bash[30897]: cluster 2021-03-10T21:10:04.626653+0000 mgr.gibba009.xiladd (mgr.34457) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:06.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:06 gibba004 bash[31878]: cluster 2021-03-10T21:10:04.626653+0000 mgr.gibba009.xiladd (mgr.34457) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:06.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:06 gibba009 bash[26136]: cluster 2021-03-10T21:10:04.626653+0000 mgr.gibba009.xiladd (mgr.34457) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:07 gibba004 bash[30897]: cluster 2021-03-10T21:10:06.628021+0000 mgr.gibba009.xiladd (mgr.34457) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:07 gibba004 bash[31878]: cluster 2021-03-10T21:10:06.628021+0000 mgr.gibba009.xiladd (mgr.34457) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:07 gibba009 bash[26136]: cluster 2021-03-10T21:10:06.628021+0000 mgr.gibba009.xiladd (mgr.34457) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:10.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:09 gibba004 bash[30897]: cluster 2021-03-10T21:10:08.629707+0000 mgr.gibba009.xiladd (mgr.34457) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:10.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:09 gibba004 bash[31878]: cluster 2021-03-10T21:10:08.629707+0000 mgr.gibba009.xiladd (mgr.34457) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:10.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:09 gibba009 bash[26136]: cluster 2021-03-10T21:10:08.629707+0000 mgr.gibba009.xiladd (mgr.34457) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:11 gibba004 bash[30897]: cluster 2021-03-10T21:10:10.630603+0000 mgr.gibba009.xiladd (mgr.34457) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:11 gibba004 bash[31878]: cluster 2021-03-10T21:10:10.630603+0000 mgr.gibba009.xiladd (mgr.34457) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:11 gibba009 bash[26136]: cluster 2021-03-10T21:10:10.630603+0000 mgr.gibba009.xiladd (mgr.34457) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:12.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:12 gibba004 bash[30897]: cephadm 2021-03-10T21:10:11.381619+0000 mgr.gibba009.xiladd (mgr.34457) 3185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:12.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:12 gibba004 bash[31878]: cephadm 2021-03-10T21:10:11.381619+0000 mgr.gibba009.xiladd (mgr.34457) 3185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:12.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:12 gibba009 bash[26136]: cephadm 2021-03-10T21:10:11.381619+0000 mgr.gibba009.xiladd (mgr.34457) 3185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:13.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:13 gibba004 bash[30897]: cluster 2021-03-10T21:10:12.632122+0000 mgr.gibba009.xiladd (mgr.34457) 3186 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:13.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:13 gibba004 bash[31878]: cluster 2021-03-10T21:10:12.632122+0000 mgr.gibba009.xiladd (mgr.34457) 3186 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:13 gibba009 bash[26136]: cluster 2021-03-10T21:10:12.632122+0000 mgr.gibba009.xiladd (mgr.34457) 3186 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:16.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:16 gibba004 bash[30897]: cluster 2021-03-10T21:10:14.633780+0000 mgr.gibba009.xiladd (mgr.34457) 3187 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:16.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:16 gibba004 bash[31878]: cluster 2021-03-10T21:10:14.633780+0000 mgr.gibba009.xiladd (mgr.34457) 3187 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:16.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:16 gibba009 bash[26136]: cluster 2021-03-10T21:10:14.633780+0000 mgr.gibba009.xiladd (mgr.34457) 3187 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:17 gibba004 bash[30897]: cluster 2021-03-10T21:10:16.635121+0000 mgr.gibba009.xiladd (mgr.34457) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:17 gibba004 bash[31878]: cluster 2021-03-10T21:10:16.635121+0000 mgr.gibba009.xiladd (mgr.34457) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:17 gibba009 bash[26136]: cluster 2021-03-10T21:10:16.635121+0000 mgr.gibba009.xiladd (mgr.34457) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:19.144 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:10:19.374 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:10:19.375 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (59m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:10:19.375 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:10:19.375 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:10:19.376 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:10:19.376 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:10:19.376 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:10:19.376 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:10:19.376 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:10:19.377 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:10:19.377 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:10:19.377 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:10:19.377 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:10:19.378 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:10:19.378 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:10:19.378 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:10:19.378 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:10:19.379 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:10:19.379 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:10:19.379 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (64m) 3m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:10:19.379 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 4m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:19.379 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:19.622 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:10:19.622 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:10:19.622 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:19.623 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:19.623 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:10:19.623 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:19.623 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:19.624 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:10:19.624 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:10:19.624 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:19.624 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:10:19.624 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:10:19.625 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:10:19.625 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:10:19.625 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:10:20.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[30897]: cluster 2021-03-10T21:10:18.636791+0000 mgr.gibba009.xiladd (mgr.34457) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[30897]: audit 2021-03-10T21:10:19.131172+0000 mgr.gibba009.xiladd (mgr.34457) 3190 : audit [DBG] from='client.56179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[30897]: audit 2021-03-10T21:10:19.617980+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.104:0/3223678285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:20.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[31878]: cluster 2021-03-10T21:10:18.636791+0000 mgr.gibba009.xiladd (mgr.34457) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:20.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[31878]: audit 2021-03-10T21:10:19.131172+0000 mgr.gibba009.xiladd (mgr.34457) 3190 : audit [DBG] from='client.56179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:20.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:19 gibba004 bash[31878]: audit 2021-03-10T21:10:19.617980+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.104:0/3223678285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:20.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:19 gibba009 bash[26136]: cluster 2021-03-10T21:10:18.636791+0000 mgr.gibba009.xiladd (mgr.34457) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:20.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:19 gibba009 bash[26136]: audit 2021-03-10T21:10:19.131172+0000 mgr.gibba009.xiladd (mgr.34457) 3190 : audit [DBG] from='client.56179 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:20.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:19 gibba009 bash[26136]: audit 2021-03-10T21:10:19.617980+0000 mon.c (mon.1) 934 : audit [DBG] from='client.? 172.21.2.104:0/3223678285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:21.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:20 gibba004 bash[30897]: audit 2021-03-10T21:10:19.357342+0000 mgr.gibba009.xiladd (mgr.34457) 3191 : audit [DBG] from='client.46206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:21.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:20 gibba004 bash[31878]: audit 2021-03-10T21:10:19.357342+0000 mgr.gibba009.xiladd (mgr.34457) 3191 : audit [DBG] from='client.46206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:21.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:20 gibba009 bash[26136]: audit 2021-03-10T21:10:19.357342+0000 mgr.gibba009.xiladd (mgr.34457) 3191 : audit [DBG] from='client.46206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:22.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:21 gibba004 bash[30897]: cluster 2021-03-10T21:10:20.638391+0000 mgr.gibba009.xiladd (mgr.34457) 3192 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:22.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:21 gibba004 bash[31878]: cluster 2021-03-10T21:10:20.638391+0000 mgr.gibba009.xiladd (mgr.34457) 3192 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:22.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:21 gibba009 bash[26136]: cluster 2021-03-10T21:10:20.638391+0000 mgr.gibba009.xiladd (mgr.34457) 3192 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:24.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:23 gibba004 bash[30897]: cluster 2021-03-10T21:10:22.639469+0000 mgr.gibba009.xiladd (mgr.34457) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:24.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:23 gibba004 bash[31878]: cluster 2021-03-10T21:10:22.639469+0000 mgr.gibba009.xiladd (mgr.34457) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:24.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:23 gibba009 bash[26136]: cluster 2021-03-10T21:10:22.639469+0000 mgr.gibba009.xiladd (mgr.34457) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:26.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:25 gibba004 bash[30897]: cluster 2021-03-10T21:10:24.640852+0000 mgr.gibba009.xiladd (mgr.34457) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:26.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:25 gibba004 bash[31878]: cluster 2021-03-10T21:10:24.640852+0000 mgr.gibba009.xiladd (mgr.34457) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:26.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:25 gibba009 bash[26136]: cluster 2021-03-10T21:10:24.640852+0000 mgr.gibba009.xiladd (mgr.34457) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:27 gibba004 bash[30897]: cephadm 2021-03-10T21:10:26.397577+0000 mgr.gibba009.xiladd (mgr.34457) 3195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:27 gibba004 bash[30897]: cluster 2021-03-10T21:10:26.642298+0000 mgr.gibba009.xiladd (mgr.34457) 3196 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:27 gibba004 bash[31878]: cephadm 2021-03-10T21:10:26.397577+0000 mgr.gibba009.xiladd (mgr.34457) 3195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:27 gibba004 bash[31878]: cluster 2021-03-10T21:10:26.642298+0000 mgr.gibba009.xiladd (mgr.34457) 3196 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:27 gibba009 bash[26136]: cephadm 2021-03-10T21:10:26.397577+0000 mgr.gibba009.xiladd (mgr.34457) 3195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:27 gibba009 bash[26136]: cluster 2021-03-10T21:10:26.642298+0000 mgr.gibba009.xiladd (mgr.34457) 3196 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:30.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:29 gibba004 bash[30897]: cluster 2021-03-10T21:10:28.643430+0000 mgr.gibba009.xiladd (mgr.34457) 3197 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:30.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:29 gibba004 bash[31878]: cluster 2021-03-10T21:10:28.643430+0000 mgr.gibba009.xiladd (mgr.34457) 3197 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:29 gibba009 bash[26136]: cluster 2021-03-10T21:10:28.643430+0000 mgr.gibba009.xiladd (mgr.34457) 3197 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:31 gibba004 bash[30897]: cluster 2021-03-10T21:10:30.645265+0000 mgr.gibba009.xiladd (mgr.34457) 3198 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:31 gibba004 bash[31878]: cluster 2021-03-10T21:10:30.645265+0000 mgr.gibba009.xiladd (mgr.34457) 3198 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:31 gibba009 bash[26136]: cluster 2021-03-10T21:10:30.645265+0000 mgr.gibba009.xiladd (mgr.34457) 3198 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:33 gibba004 bash[30897]: cluster 2021-03-10T21:10:32.647085+0000 mgr.gibba009.xiladd (mgr.34457) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:34.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:33 gibba004 bash[31878]: cluster 2021-03-10T21:10:32.647085+0000 mgr.gibba009.xiladd (mgr.34457) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:34.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:33 gibba009 bash[26136]: cluster 2021-03-10T21:10:32.647085+0000 mgr.gibba009.xiladd (mgr.34457) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:36.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:35 gibba004 bash[30897]: cluster 2021-03-10T21:10:34.648729+0000 mgr.gibba009.xiladd (mgr.34457) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:36.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:35 gibba004 bash[31878]: cluster 2021-03-10T21:10:34.648729+0000 mgr.gibba009.xiladd (mgr.34457) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:35 gibba009 bash[26136]: cluster 2021-03-10T21:10:34.648729+0000 mgr.gibba009.xiladd (mgr.34457) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:37 gibba004 bash[30897]: cluster 2021-03-10T21:10:36.650227+0000 mgr.gibba009.xiladd (mgr.34457) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:38.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:37 gibba004 bash[31878]: cluster 2021-03-10T21:10:36.650227+0000 mgr.gibba009.xiladd (mgr.34457) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:38.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:37 gibba009 bash[26136]: cluster 2021-03-10T21:10:36.650227+0000 mgr.gibba009.xiladd (mgr.34457) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:40.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:39 gibba004 bash[30897]: cluster 2021-03-10T21:10:38.651918+0000 mgr.gibba009.xiladd (mgr.34457) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:40.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:39 gibba004 bash[31878]: cluster 2021-03-10T21:10:38.651918+0000 mgr.gibba009.xiladd (mgr.34457) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:40.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:39 gibba009 bash[26136]: cluster 2021-03-10T21:10:38.651918+0000 mgr.gibba009.xiladd (mgr.34457) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:41.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.949816+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.950680+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.950926+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.952192+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.965574+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.966439+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.966715+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.967388+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.968075+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.068 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.968544+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.969075+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.069 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[30897]: audit 2021-03-10T21:10:39.970073+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.069 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.949816+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.950680+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.950926+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.070 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.952192+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.965574+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.966439+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.966715+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.071 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.967388+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.968075+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.968544+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.969075+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.072 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:40 gibba004 bash[31878]: audit 2021-03-10T21:10:39.970073+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.949816+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.950680+0000 mon.c (mon.1) 936 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.950926+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.952192+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.965574+0000 mon.c (mon.1) 937 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.966439+0000 mon.c (mon.1) 938 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.966715+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T21:10:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.967388+0000 mon.c (mon.1) 939 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.968075+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:10:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.968544+0000 mon.c (mon.1) 940 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.969075+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:10:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:40 gibba009 bash[26136]: audit 2021-03-10T21:10:39.970073+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:10:42.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:41 gibba004 bash[31878]: cluster 2021-03-10T21:10:40.653426+0000 mgr.gibba009.xiladd (mgr.34457) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:42.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:41 gibba004 bash[30897]: cluster 2021-03-10T21:10:40.653426+0000 mgr.gibba009.xiladd (mgr.34457) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:42.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:41 gibba009 bash[26136]: cluster 2021-03-10T21:10:40.653426+0000 mgr.gibba009.xiladd (mgr.34457) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:43.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:42 gibba004 bash[30897]: cephadm 2021-03-10T21:10:41.413655+0000 mgr.gibba009.xiladd (mgr.34457) 3204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:43.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:42 gibba004 bash[31878]: cephadm 2021-03-10T21:10:41.413655+0000 mgr.gibba009.xiladd (mgr.34457) 3204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:43.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:42 gibba009 bash[26136]: cephadm 2021-03-10T21:10:41.413655+0000 mgr.gibba009.xiladd (mgr.34457) 3204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:43 gibba004 bash[30897]: cluster 2021-03-10T21:10:42.655053+0000 mgr.gibba009.xiladd (mgr.34457) 3205 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:44.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:43 gibba004 bash[31878]: cluster 2021-03-10T21:10:42.655053+0000 mgr.gibba009.xiladd (mgr.34457) 3205 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:44.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:43 gibba009 bash[26136]: cluster 2021-03-10T21:10:42.655053+0000 mgr.gibba009.xiladd (mgr.34457) 3205 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:46.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:45 gibba004 bash[30897]: cluster 2021-03-10T21:10:44.656720+0000 mgr.gibba009.xiladd (mgr.34457) 3206 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:46.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:45 gibba004 bash[31878]: cluster 2021-03-10T21:10:44.656720+0000 mgr.gibba009.xiladd (mgr.34457) 3206 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:46.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:45 gibba009 bash[26136]: cluster 2021-03-10T21:10:44.656720+0000 mgr.gibba009.xiladd (mgr.34457) 3206 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:48.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:47 gibba004 bash[31878]: cluster 2021-03-10T21:10:46.657897+0000 mgr.gibba009.xiladd (mgr.34457) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:48.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:47 gibba004 bash[30897]: cluster 2021-03-10T21:10:46.657897+0000 mgr.gibba009.xiladd (mgr.34457) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:48.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:47 gibba009 bash[26136]: cluster 2021-03-10T21:10:46.657897+0000 mgr.gibba009.xiladd (mgr.34457) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:49.864 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:10:50.065 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:49 gibba004 bash[30897]: cluster 2021-03-10T21:10:48.659571+0000 mgr.gibba009.xiladd (mgr.34457) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:50.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:49 gibba004 bash[31878]: cluster 2021-03-10T21:10:48.659571+0000 mgr.gibba009.xiladd (mgr.34457) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:50.084 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:10:50.085 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (59m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:10:50.085 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:10:50.085 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:10:50.085 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:10:50.086 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:10:50.086 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:10:50.086 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:10:50.086 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:10:50.087 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:10:50.087 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (65m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:10:50.087 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:10:50.087 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:10:50.087 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:10:50.088 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:10:50.088 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:10:50.088 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:10:50.088 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:10:50.089 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:10:50.089 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:10:50.089 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:50.089 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 3m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:50.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:49 gibba009 bash[26136]: cluster 2021-03-10T21:10:48.659571+0000 mgr.gibba009.xiladd (mgr.34457) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:50.336 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:10:50.336 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:10:50.337 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:50.337 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:50.337 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:10:50.337 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:50.337 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:50.338 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:10:50.338 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:10:50.338 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:10:50.338 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:10:50.339 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:10:50.339 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:10:50.339 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:10:50.339 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:10:51.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[31878]: audit 2021-03-10T21:10:49.852213+0000 mgr.gibba009.xiladd (mgr.34457) 3209 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.174 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[31878]: audit 2021-03-10T21:10:50.071430+0000 mgr.gibba009.xiladd (mgr.34457) 3210 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.175 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[31878]: audit 2021-03-10T21:10:50.332574+0000 mon.a (mon.0) 1056 : audit [DBG] from='client.? 172.21.2.104:0/1229495168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:51.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[30897]: audit 2021-03-10T21:10:49.852213+0000 mgr.gibba009.xiladd (mgr.34457) 3209 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[30897]: audit 2021-03-10T21:10:50.071430+0000 mgr.gibba009.xiladd (mgr.34457) 3210 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.175 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:50 gibba004 bash[30897]: audit 2021-03-10T21:10:50.332574+0000 mon.a (mon.0) 1056 : audit [DBG] from='client.? 172.21.2.104:0/1229495168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:51.176 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:50 gibba009 bash[26136]: audit 2021-03-10T21:10:49.852213+0000 mgr.gibba009.xiladd (mgr.34457) 3209 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.179 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:50 gibba009 bash[26136]: audit 2021-03-10T21:10:50.071430+0000 mgr.gibba009.xiladd (mgr.34457) 3210 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:51.179 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:50 gibba009 bash[26136]: audit 2021-03-10T21:10:50.332574+0000 mon.a (mon.0) 1056 : audit [DBG] from='client.? 172.21.2.104:0/1229495168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:52.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:51 gibba004 bash[30897]: cluster 2021-03-10T21:10:50.661217+0000 mgr.gibba009.xiladd (mgr.34457) 3211 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:52.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:51 gibba004 bash[31878]: cluster 2021-03-10T21:10:50.661217+0000 mgr.gibba009.xiladd (mgr.34457) 3211 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:52.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:51 gibba009 bash[26136]: cluster 2021-03-10T21:10:50.661217+0000 mgr.gibba009.xiladd (mgr.34457) 3211 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:53 gibba004 bash[30897]: cluster 2021-03-10T21:10:52.662364+0000 mgr.gibba009.xiladd (mgr.34457) 3212 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:53 gibba004 bash[31878]: cluster 2021-03-10T21:10:52.662364+0000 mgr.gibba009.xiladd (mgr.34457) 3212 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:54.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:53 gibba009 bash[26136]: cluster 2021-03-10T21:10:52.662364+0000 mgr.gibba009.xiladd (mgr.34457) 3212 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:56.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:55 gibba004 bash[30897]: cluster 2021-03-10T21:10:54.663734+0000 mgr.gibba009.xiladd (mgr.34457) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:56.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:55 gibba004 bash[31878]: cluster 2021-03-10T21:10:54.663734+0000 mgr.gibba009.xiladd (mgr.34457) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:56.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:55 gibba009 bash[26136]: cluster 2021-03-10T21:10:54.663734+0000 mgr.gibba009.xiladd (mgr.34457) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:57.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.431009+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.660474+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:10:57.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.664404+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.665856+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.667181+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.668682+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.672147+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:56 gibba009 bash[26136]: audit 2021-03-10T21:10:56.673670+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.431009+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.660474+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:10:57.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.664404+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.665856+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.667181+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.668682+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.672147+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[30897]: audit 2021-03-10T21:10:56.673670+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.431009+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.660474+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:10:57.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.664404+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.665856+0000 mon.c (mon.1) 943 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.667181+0000 mon.c (mon.1) 944 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.668682+0000 mon.c (mon.1) 945 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.672147+0000 mon.c (mon.1) 946 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:57.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:56 gibba004 bash[31878]: audit 2021-03-10T21:10:56.673670+0000 mon.c (mon.1) 947 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.435689+0000 mgr.gibba009.xiladd (mgr.34457) 3214 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:10:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.437903+0000 mgr.gibba009.xiladd (mgr.34457) 3215 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:10:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.663197+0000 mgr.gibba009.xiladd (mgr.34457) 3216 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cluster 2021-03-10T21:10:56.664164+0000 mgr.gibba009.xiladd (mgr.34457) 3217 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:58.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.665029+0000 mgr.gibba009.xiladd (mgr.34457) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:58.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.666339+0000 mgr.gibba009.xiladd (mgr.34457) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:58.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.666377+0000 mgr.gibba009.xiladd (mgr.34457) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:58.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.667860+0000 mgr.gibba009.xiladd (mgr.34457) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:58.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.667896+0000 mgr.gibba009.xiladd (mgr.34457) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:58.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.669709+0000 mgr.gibba009.xiladd (mgr.34457) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:58.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.671244+0000 mgr.gibba009.xiladd (mgr.34457) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:58.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.671282+0000 mgr.gibba009.xiladd (mgr.34457) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:58.098 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.672592+0000 mgr.gibba009.xiladd (mgr.34457) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:58.099 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.672962+0000 mgr.gibba009.xiladd (mgr.34457) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:58.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.674287+0000 mgr.gibba009.xiladd (mgr.34457) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:58.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.674328+0000 mgr.gibba009.xiladd (mgr.34457) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:58.100 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:57 gibba009 bash[26136]: cephadm 2021-03-10T21:10:56.674459+0000 mgr.gibba009.xiladd (mgr.34457) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:58.316 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.435689+0000 mgr.gibba009.xiladd (mgr.34457) 3214 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:10:58.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.437903+0000 mgr.gibba009.xiladd (mgr.34457) 3215 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:10:58.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.663197+0000 mgr.gibba009.xiladd (mgr.34457) 3216 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:58.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cluster 2021-03-10T21:10:56.664164+0000 mgr.gibba009.xiladd (mgr.34457) 3217 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:58.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.665029+0000 mgr.gibba009.xiladd (mgr.34457) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:58.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.666339+0000 mgr.gibba009.xiladd (mgr.34457) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:58.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.666377+0000 mgr.gibba009.xiladd (mgr.34457) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:58.318 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.667860+0000 mgr.gibba009.xiladd (mgr.34457) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.667896+0000 mgr.gibba009.xiladd (mgr.34457) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.669709+0000 mgr.gibba009.xiladd (mgr.34457) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.671244+0000 mgr.gibba009.xiladd (mgr.34457) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.671282+0000 mgr.gibba009.xiladd (mgr.34457) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.672592+0000 mgr.gibba009.xiladd (mgr.34457) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.672962+0000 mgr.gibba009.xiladd (mgr.34457) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.674287+0000 mgr.gibba009.xiladd (mgr.34457) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.674328+0000 mgr.gibba009.xiladd (mgr.34457) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[31878]: cephadm 2021-03-10T21:10:56.674459+0000 mgr.gibba009.xiladd (mgr.34457) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:10:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.435689+0000 mgr.gibba009.xiladd (mgr.34457) 3214 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:10:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.437903+0000 mgr.gibba009.xiladd (mgr.34457) 3215 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:10:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.663197+0000 mgr.gibba009.xiladd (mgr.34457) 3216 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cluster 2021-03-10T21:10:56.664164+0000 mgr.gibba009.xiladd (mgr.34457) 3217 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.665029+0000 mgr.gibba009.xiladd (mgr.34457) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.666339+0000 mgr.gibba009.xiladd (mgr.34457) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.666377+0000 mgr.gibba009.xiladd (mgr.34457) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.667860+0000 mgr.gibba009.xiladd (mgr.34457) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:58.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.667896+0000 mgr.gibba009.xiladd (mgr.34457) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:58.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.669709+0000 mgr.gibba009.xiladd (mgr.34457) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:58.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.671244+0000 mgr.gibba009.xiladd (mgr.34457) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:58.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.671282+0000 mgr.gibba009.xiladd (mgr.34457) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:58.323 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.672592+0000 mgr.gibba009.xiladd (mgr.34457) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:58.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.672962+0000 mgr.gibba009.xiladd (mgr.34457) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:58.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.674287+0000 mgr.gibba009.xiladd (mgr.34457) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:58.324 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.674328+0000 mgr.gibba009.xiladd (mgr.34457) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:58.325 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:57 gibba004 bash[30897]: cephadm 2021-03-10T21:10:56.674459+0000 mgr.gibba009.xiladd (mgr.34457) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:00.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:10:59 gibba009 bash[26136]: cluster 2021-03-10T21:10:58.665201+0000 mgr.gibba009.xiladd (mgr.34457) 3231 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:10:59 gibba004 bash[30897]: cluster 2021-03-10T21:10:58.665201+0000 mgr.gibba009.xiladd (mgr.34457) 3231 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:00.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:10:59 gibba004 bash[31878]: cluster 2021-03-10T21:10:58.665201+0000 mgr.gibba009.xiladd (mgr.34457) 3231 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:01 gibba004 bash[30897]: cluster 2021-03-10T21:11:00.666614+0000 mgr.gibba009.xiladd (mgr.34457) 3232 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:01 gibba004 bash[31878]: cluster 2021-03-10T21:11:00.666614+0000 mgr.gibba009.xiladd (mgr.34457) 3232 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:01 gibba009 bash[26136]: cluster 2021-03-10T21:11:00.666614+0000 mgr.gibba009.xiladd (mgr.34457) 3232 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:04.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:03 gibba004 bash[30897]: cluster 2021-03-10T21:11:02.668340+0000 mgr.gibba009.xiladd (mgr.34457) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:04.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:03 gibba004 bash[31878]: cluster 2021-03-10T21:11:02.668340+0000 mgr.gibba009.xiladd (mgr.34457) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:04.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:03 gibba009 bash[26136]: cluster 2021-03-10T21:11:02.668340+0000 mgr.gibba009.xiladd (mgr.34457) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:06.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:05 gibba004 bash[30897]: cluster 2021-03-10T21:11:04.669885+0000 mgr.gibba009.xiladd (mgr.34457) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:06.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:05 gibba004 bash[31878]: cluster 2021-03-10T21:11:04.669885+0000 mgr.gibba009.xiladd (mgr.34457) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:06.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:05 gibba009 bash[26136]: cluster 2021-03-10T21:11:04.669885+0000 mgr.gibba009.xiladd (mgr.34457) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:08.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:07 gibba004 bash[30897]: cluster 2021-03-10T21:11:06.671350+0000 mgr.gibba009.xiladd (mgr.34457) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:08.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:07 gibba004 bash[31878]: cluster 2021-03-10T21:11:06.671350+0000 mgr.gibba009.xiladd (mgr.34457) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:08.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:07 gibba009 bash[26136]: cluster 2021-03-10T21:11:06.671350+0000 mgr.gibba009.xiladd (mgr.34457) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:10.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:09 gibba004 bash[30897]: cluster 2021-03-10T21:11:08.673070+0000 mgr.gibba009.xiladd (mgr.34457) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:10.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:09 gibba004 bash[31878]: cluster 2021-03-10T21:11:08.673070+0000 mgr.gibba009.xiladd (mgr.34457) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:10.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:09 gibba009 bash[26136]: cluster 2021-03-10T21:11:08.673070+0000 mgr.gibba009.xiladd (mgr.34457) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:11 gibba004 bash[30897]: cluster 2021-03-10T21:11:10.674736+0000 mgr.gibba009.xiladd (mgr.34457) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:11 gibba004 bash[31878]: cluster 2021-03-10T21:11:10.674736+0000 mgr.gibba009.xiladd (mgr.34457) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:11 gibba009 bash[26136]: cluster 2021-03-10T21:11:10.674736+0000 mgr.gibba009.xiladd (mgr.34457) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:12.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:12 gibba004 bash[30897]: cephadm 2021-03-10T21:11:11.690479+0000 mgr.gibba009.xiladd (mgr.34457) 3238 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:12.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:12 gibba004 bash[31878]: cephadm 2021-03-10T21:11:11.690479+0000 mgr.gibba009.xiladd (mgr.34457) 3238 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:12.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:12 gibba009 bash[26136]: cephadm 2021-03-10T21:11:11.690479+0000 mgr.gibba009.xiladd (mgr.34457) 3238 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:13.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:13 gibba004 bash[30897]: cluster 2021-03-10T21:11:12.676433+0000 mgr.gibba009.xiladd (mgr.34457) 3239 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:13 gibba004 bash[31878]: cluster 2021-03-10T21:11:12.676433+0000 mgr.gibba009.xiladd (mgr.34457) 3239 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:13 gibba009 bash[26136]: cluster 2021-03-10T21:11:12.676433+0000 mgr.gibba009.xiladd (mgr.34457) 3239 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:15 gibba004 bash[30897]: cluster 2021-03-10T21:11:14.678068+0000 mgr.gibba009.xiladd (mgr.34457) 3240 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:15 gibba004 bash[31878]: cluster 2021-03-10T21:11:14.678068+0000 mgr.gibba009.xiladd (mgr.34457) 3240 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:16.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:15 gibba009 bash[26136]: cluster 2021-03-10T21:11:14.678068+0000 mgr.gibba009.xiladd (mgr.34457) 3240 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:17 gibba004 bash[30897]: cluster 2021-03-10T21:11:16.679432+0000 mgr.gibba009.xiladd (mgr.34457) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:17 gibba004 bash[31878]: cluster 2021-03-10T21:11:16.679432+0000 mgr.gibba009.xiladd (mgr.34457) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:18.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:17 gibba009 bash[26136]: cluster 2021-03-10T21:11:16.679432+0000 mgr.gibba009.xiladd (mgr.34457) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:19 gibba004 bash[30897]: cluster 2021-03-10T21:11:18.681183+0000 mgr.gibba009.xiladd (mgr.34457) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:20.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:19 gibba004 bash[31878]: cluster 2021-03-10T21:11:18.681183+0000 mgr.gibba009.xiladd (mgr.34457) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:20.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:19 gibba009 bash[26136]: cluster 2021-03-10T21:11:18.681183+0000 mgr.gibba009.xiladd (mgr.34457) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:20.580 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:11:20.811 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:11:20.811 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (60m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:11:20.812 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:11:20.812 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:11:20.812 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:11:20.812 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:11:20.813 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:11:20.813 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:11:20.813 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:11:20.813 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:11:20.814 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:11:20.814 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:11:20.814 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:11:20.814 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:11:20.814 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:11:20.815 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:11:20.815 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:11:20.815 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:11:20.816 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:11:20.817 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (65m) 4m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:11:20.817 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 5m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:20.817 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 4m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:21.056 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:11:21.056 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:11:21.057 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:21.057 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:21.057 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:11:21.058 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:21.058 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:21.058 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:11:21.058 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:11:21.059 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:21.059 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:11:21.059 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:11:21.059 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:11:21.060 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:11:21.061 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:11:21.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[30897]: audit 2021-03-10T21:11:20.565186+0000 mgr.gibba009.xiladd (mgr.34457) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[30897]: cluster 2021-03-10T21:11:20.682870+0000 mgr.gibba009.xiladd (mgr.34457) 3244 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:21.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[30897]: audit 2021-03-10T21:11:20.793850+0000 mgr.gibba009.xiladd (mgr.34457) 3245 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.568 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[30897]: audit 2021-03-10T21:11:21.052480+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.104:0/4235887862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:21.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[31878]: audit 2021-03-10T21:11:20.565186+0000 mgr.gibba009.xiladd (mgr.34457) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[31878]: cluster 2021-03-10T21:11:20.682870+0000 mgr.gibba009.xiladd (mgr.34457) 3244 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:21.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[31878]: audit 2021-03-10T21:11:20.793850+0000 mgr.gibba009.xiladd (mgr.34457) 3245 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.569 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:21 gibba004 bash[31878]: audit 2021-03-10T21:11:21.052480+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.104:0/4235887862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:21.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:21 gibba009 bash[26136]: audit 2021-03-10T21:11:20.565186+0000 mgr.gibba009.xiladd (mgr.34457) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:21 gibba009 bash[26136]: cluster 2021-03-10T21:11:20.682870+0000 mgr.gibba009.xiladd (mgr.34457) 3244 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:21.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:21 gibba009 bash[26136]: audit 2021-03-10T21:11:20.793850+0000 mgr.gibba009.xiladd (mgr.34457) 3245 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:21.592 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:21 gibba009 bash[26136]: audit 2021-03-10T21:11:21.052480+0000 mon.a (mon.0) 1058 : audit [DBG] from='client.? 172.21.2.104:0/4235887862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:24.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:23 gibba004 bash[30897]: cluster 2021-03-10T21:11:22.684627+0000 mgr.gibba009.xiladd (mgr.34457) 3246 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:24.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:23 gibba004 bash[31878]: cluster 2021-03-10T21:11:22.684627+0000 mgr.gibba009.xiladd (mgr.34457) 3246 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:24.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:23 gibba009 bash[26136]: cluster 2021-03-10T21:11:22.684627+0000 mgr.gibba009.xiladd (mgr.34457) 3246 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:26.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:25 gibba004 bash[30897]: cluster 2021-03-10T21:11:24.686120+0000 mgr.gibba009.xiladd (mgr.34457) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:26.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:25 gibba004 bash[31878]: cluster 2021-03-10T21:11:24.686120+0000 mgr.gibba009.xiladd (mgr.34457) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:26.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:25 gibba009 bash[26136]: cluster 2021-03-10T21:11:24.686120+0000 mgr.gibba009.xiladd (mgr.34457) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:27 gibba004 bash[30897]: cluster 2021-03-10T21:11:26.687608+0000 mgr.gibba009.xiladd (mgr.34457) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:28.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:27 gibba004 bash[30897]: cephadm 2021-03-10T21:11:26.705412+0000 mgr.gibba009.xiladd (mgr.34457) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:27 gibba004 bash[31878]: cluster 2021-03-10T21:11:26.687608+0000 mgr.gibba009.xiladd (mgr.34457) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:28.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:27 gibba004 bash[31878]: cephadm 2021-03-10T21:11:26.705412+0000 mgr.gibba009.xiladd (mgr.34457) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:27 gibba009 bash[26136]: cluster 2021-03-10T21:11:26.687608+0000 mgr.gibba009.xiladd (mgr.34457) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:27 gibba009 bash[26136]: cephadm 2021-03-10T21:11:26.705412+0000 mgr.gibba009.xiladd (mgr.34457) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:30.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:29 gibba004 bash[30897]: cluster 2021-03-10T21:11:28.689271+0000 mgr.gibba009.xiladd (mgr.34457) 3250 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:30.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:29 gibba004 bash[31878]: cluster 2021-03-10T21:11:28.689271+0000 mgr.gibba009.xiladd (mgr.34457) 3250 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:29 gibba009 bash[26136]: cluster 2021-03-10T21:11:28.689271+0000 mgr.gibba009.xiladd (mgr.34457) 3250 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:31 gibba004 bash[30897]: cluster 2021-03-10T21:11:30.690798+0000 mgr.gibba009.xiladd (mgr.34457) 3251 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:31 gibba004 bash[31878]: cluster 2021-03-10T21:11:30.690798+0000 mgr.gibba009.xiladd (mgr.34457) 3251 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:31 gibba009 bash[26136]: cluster 2021-03-10T21:11:30.690798+0000 mgr.gibba009.xiladd (mgr.34457) 3251 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:33 gibba004 bash[30897]: cluster 2021-03-10T21:11:32.692146+0000 mgr.gibba009.xiladd (mgr.34457) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:34.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:33 gibba004 bash[31878]: cluster 2021-03-10T21:11:32.692146+0000 mgr.gibba009.xiladd (mgr.34457) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:34.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:33 gibba009 bash[26136]: cluster 2021-03-10T21:11:32.692146+0000 mgr.gibba009.xiladd (mgr.34457) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:36.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:35 gibba004 bash[30897]: cluster 2021-03-10T21:11:34.693740+0000 mgr.gibba009.xiladd (mgr.34457) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:36.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:35 gibba004 bash[31878]: cluster 2021-03-10T21:11:34.693740+0000 mgr.gibba009.xiladd (mgr.34457) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:35 gibba009 bash[26136]: cluster 2021-03-10T21:11:34.693740+0000 mgr.gibba009.xiladd (mgr.34457) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:38.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:37 gibba004 bash[30897]: cluster 2021-03-10T21:11:36.695082+0000 mgr.gibba009.xiladd (mgr.34457) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:38.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:37 gibba004 bash[31878]: cluster 2021-03-10T21:11:36.695082+0000 mgr.gibba009.xiladd (mgr.34457) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:38.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:37 gibba009 bash[26136]: cluster 2021-03-10T21:11:36.695082+0000 mgr.gibba009.xiladd (mgr.34457) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:40.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:39 gibba004 bash[30897]: cluster 2021-03-10T21:11:38.696688+0000 mgr.gibba009.xiladd (mgr.34457) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:40.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:39 gibba004 bash[31878]: cluster 2021-03-10T21:11:38.696688+0000 mgr.gibba009.xiladd (mgr.34457) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:40.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:39 gibba009 bash[26136]: cluster 2021-03-10T21:11:38.696688+0000 mgr.gibba009.xiladd (mgr.34457) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:41.070 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.966026+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.071 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.966700+0000 mon.c (mon.1) 949 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.072 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.967202+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.074 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.968371+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.076 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.981331+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.982164+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.077 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.982585+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.078 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.982873+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.983667+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:41.079 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.983769+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.080 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.984978+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.082 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[30897]: audit 2021-03-10T21:11:39.985764+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:41.083 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.966026+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.084 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.966700+0000 mon.c (mon.1) 949 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.085 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.967202+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.968371+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.086 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.981331+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.087 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.982164+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.088 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.982585+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.089 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.982873+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.983667+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:41.090 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.983769+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.984978+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.091 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:40 gibba004 bash[31878]: audit 2021-03-10T21:11:39.985764+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.966026+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.966700+0000 mon.c (mon.1) 949 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.967202+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:41.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.968371+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:41.095 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.981331+0000 mon.c (mon.1) 950 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.982164+0000 mon.c (mon.1) 951 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.982585+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:11:41.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.982873+0000 mon.c (mon.1) 952 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.983667+0000 mon.c (mon.1) 953 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:41.096 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.983769+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.984978+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:41.097 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:40 gibba009 bash[26136]: audit 2021-03-10T21:11:39.985764+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:11:42.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:41 gibba004 bash[30897]: cluster 2021-03-10T21:11:40.698151+0000 mgr.gibba009.xiladd (mgr.34457) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:42.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:41 gibba004 bash[31878]: cluster 2021-03-10T21:11:40.698151+0000 mgr.gibba009.xiladd (mgr.34457) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:42.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:41 gibba009 bash[26136]: cluster 2021-03-10T21:11:40.698151+0000 mgr.gibba009.xiladd (mgr.34457) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:43.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:42 gibba004 bash[30897]: cephadm 2021-03-10T21:11:41.713747+0000 mgr.gibba009.xiladd (mgr.34457) 3257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:43.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:42 gibba004 bash[31878]: cephadm 2021-03-10T21:11:41.713747+0000 mgr.gibba009.xiladd (mgr.34457) 3257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:43.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:42 gibba009 bash[26136]: cephadm 2021-03-10T21:11:41.713747+0000 mgr.gibba009.xiladd (mgr.34457) 3257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:44.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:43 gibba004 bash[30897]: cluster 2021-03-10T21:11:42.699674+0000 mgr.gibba009.xiladd (mgr.34457) 3258 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:44.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:43 gibba004 bash[31878]: cluster 2021-03-10T21:11:42.699674+0000 mgr.gibba009.xiladd (mgr.34457) 3258 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:44.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:43 gibba009 bash[26136]: cluster 2021-03-10T21:11:42.699674+0000 mgr.gibba009.xiladd (mgr.34457) 3258 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:46.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:45 gibba009 bash[26136]: cluster 2021-03-10T21:11:44.701198+0000 mgr.gibba009.xiladd (mgr.34457) 3259 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:45 gibba004 bash[30897]: cluster 2021-03-10T21:11:44.701198+0000 mgr.gibba009.xiladd (mgr.34457) 3259 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:45 gibba004 bash[31878]: cluster 2021-03-10T21:11:44.701198+0000 mgr.gibba009.xiladd (mgr.34457) 3259 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:48.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:47 gibba009 bash[26136]: cluster 2021-03-10T21:11:46.702460+0000 mgr.gibba009.xiladd (mgr.34457) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:47 gibba004 bash[30897]: cluster 2021-03-10T21:11:46.702460+0000 mgr.gibba009.xiladd (mgr.34457) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:47 gibba004 bash[31878]: cluster 2021-03-10T21:11:46.702460+0000 mgr.gibba009.xiladd (mgr.34457) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:50.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:49 gibba009 bash[26136]: cluster 2021-03-10T21:11:48.704021+0000 mgr.gibba009.xiladd (mgr.34457) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:50.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:49 gibba004 bash[30897]: cluster 2021-03-10T21:11:48.704021+0000 mgr.gibba009.xiladd (mgr.34457) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:49 gibba004 bash[31878]: cluster 2021-03-10T21:11:48.704021+0000 mgr.gibba009.xiladd (mgr.34457) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:51.301 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:11:51.528 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:11:51.529 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (60m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:11:51.529 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (65m) 5m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:11:51.529 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (61m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:11:51.530 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (61m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:11:51.530 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:11:51.530 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:11:51.530 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:11:51.530 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:11:51.531 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:11:51.531 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:11:51.531 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:11:51.531 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:11:51.532 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:11:51.532 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:11:51.532 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:11:51.532 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:11:51.532 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:11:51.533 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (56m) 5m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:11:51.533 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (65m) 5m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:11:51.533 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:51.534 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:51.565 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:51 gibba004 bash[30897]: cluster 2021-03-10T21:11:50.705696+0000 mgr.gibba009.xiladd (mgr.34457) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:51.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:51 gibba004 bash[31878]: cluster 2021-03-10T21:11:50.705696+0000 mgr.gibba009.xiladd (mgr.34457) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:51.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:51 gibba009 bash[26136]: cluster 2021-03-10T21:11:50.705696+0000 mgr.gibba009.xiladd (mgr.34457) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:51.784 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:11:51.784 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:11:51.784 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:51.785 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:51.785 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:11:51.785 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:51.785 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:51.786 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:11:51.786 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:11:51.786 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:11:51.786 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:11:51.787 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:11:51.787 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:11:51.787 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:11:51.787 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:11:52.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[30897]: audit 2021-03-10T21:11:51.288212+0000 mgr.gibba009.xiladd (mgr.34457) 3263 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[30897]: audit 2021-03-10T21:11:51.511835+0000 mgr.gibba009.xiladd (mgr.34457) 3264 : audit [DBG] from='client.56239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[30897]: audit 2021-03-10T21:11:51.780468+0000 mon.c (mon.1) 954 : audit [DBG] from='client.? 172.21.2.104:0/558609388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:52.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[31878]: audit 2021-03-10T21:11:51.288212+0000 mgr.gibba009.xiladd (mgr.34457) 3263 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[31878]: audit 2021-03-10T21:11:51.511835+0000 mgr.gibba009.xiladd (mgr.34457) 3264 : audit [DBG] from='client.56239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:52 gibba004 bash[31878]: audit 2021-03-10T21:11:51.780468+0000 mon.c (mon.1) 954 : audit [DBG] from='client.? 172.21.2.104:0/558609388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:52.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:52 gibba009 bash[26136]: audit 2021-03-10T21:11:51.288212+0000 mgr.gibba009.xiladd (mgr.34457) 3263 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:52 gibba009 bash[26136]: audit 2021-03-10T21:11:51.511835+0000 mgr.gibba009.xiladd (mgr.34457) 3264 : audit [DBG] from='client.56239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:52.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:52 gibba009 bash[26136]: audit 2021-03-10T21:11:51.780468+0000 mon.c (mon.1) 954 : audit [DBG] from='client.? 172.21.2.104:0/558609388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:53.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:53 gibba004 bash[30897]: cluster 2021-03-10T21:11:52.707310+0000 mgr.gibba009.xiladd (mgr.34457) 3265 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:53.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:53 gibba004 bash[31878]: cluster 2021-03-10T21:11:52.707310+0000 mgr.gibba009.xiladd (mgr.34457) 3265 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:53.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:53 gibba009 bash[26136]: cluster 2021-03-10T21:11:52.707310+0000 mgr.gibba009.xiladd (mgr.34457) 3265 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:56.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:55 gibba004 bash[30897]: cluster 2021-03-10T21:11:54.708849+0000 mgr.gibba009.xiladd (mgr.34457) 3266 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:56.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:55 gibba004 bash[31878]: cluster 2021-03-10T21:11:54.708849+0000 mgr.gibba009.xiladd (mgr.34457) 3266 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:56.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:55 gibba009 bash[26136]: cluster 2021-03-10T21:11:54.708849+0000 mgr.gibba009.xiladd (mgr.34457) 3266 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:57.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:56 gibba004 bash[30897]: audit 2021-03-10T21:11:56.730403+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:57.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:56 gibba004 bash[31878]: audit 2021-03-10T21:11:56.730403+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:57.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:56 gibba009 bash[26136]: audit 2021-03-10T21:11:56.730403+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cluster 2021-03-10T21:11:56.710091+0000 mgr.gibba009.xiladd (mgr.34457) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.734430+0000 mgr.gibba009.xiladd (mgr.34457) 3268 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:11:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.736330+0000 mgr.gibba009.xiladd (mgr.34457) 3269 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:11:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.951667+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:11:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.954306+0000 mgr.gibba009.xiladd (mgr.34457) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.955470+0000 mon.c (mon.1) 956 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.956436+0000 mgr.gibba009.xiladd (mgr.34457) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.957436+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.958510+0000 mgr.gibba009.xiladd (mgr.34457) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.958547+0000 mgr.gibba009.xiladd (mgr.34457) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:58.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.959547+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.960279+0000 mgr.gibba009.xiladd (mgr.34457) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:58.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.960317+0000 mgr.gibba009.xiladd (mgr.34457) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.961279+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.962206+0000 mgr.gibba009.xiladd (mgr.34457) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.964611+0000 mgr.gibba009.xiladd (mgr.34457) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:58.321 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.964704+0000 mgr.gibba009.xiladd (mgr.34457) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.965630+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.966235+0000 mgr.gibba009.xiladd (mgr.34457) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:58.322 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.966561+0000 mgr.gibba009.xiladd (mgr.34457) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:58.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cluster 2021-03-10T21:11:56.710091+0000 mgr.gibba009.xiladd (mgr.34457) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:58.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.734430+0000 mgr.gibba009.xiladd (mgr.34457) 3268 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:11:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.736330+0000 mgr.gibba009.xiladd (mgr.34457) 3269 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:11:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.951667+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:11:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.954306+0000 mgr.gibba009.xiladd (mgr.34457) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.955470+0000 mon.c (mon.1) 956 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:58.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.956436+0000 mgr.gibba009.xiladd (mgr.34457) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:58.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.957436+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.958510+0000 mgr.gibba009.xiladd (mgr.34457) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:58.325 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.958547+0000 mgr.gibba009.xiladd (mgr.34457) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:58.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.959547+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.960279+0000 mgr.gibba009.xiladd (mgr.34457) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:58.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.960317+0000 mgr.gibba009.xiladd (mgr.34457) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:58.326 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.961279+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.962206+0000 mgr.gibba009.xiladd (mgr.34457) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:58.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.964611+0000 mgr.gibba009.xiladd (mgr.34457) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:58.327 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.964704+0000 mgr.gibba009.xiladd (mgr.34457) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:58.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.965630+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.966235+0000 mgr.gibba009.xiladd (mgr.34457) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:58.328 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.966561+0000 mgr.gibba009.xiladd (mgr.34457) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:58.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: audit 2021-03-10T21:11:56.967490+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.968159+0000 mgr.gibba009.xiladd (mgr.34457) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:58.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.968198+0000 mgr.gibba009.xiladd (mgr.34457) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:58.329 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[30897]: cephadm 2021-03-10T21:11:56.968323+0000 mgr.gibba009.xiladd (mgr.34457) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:58.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: audit 2021-03-10T21:11:56.967490+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.968159+0000 mgr.gibba009.xiladd (mgr.34457) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:58.330 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.968198+0000 mgr.gibba009.xiladd (mgr.34457) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:58.331 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:57 gibba004 bash[31878]: cephadm 2021-03-10T21:11:56.968323+0000 mgr.gibba009.xiladd (mgr.34457) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:11:58.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cluster 2021-03-10T21:11:56.710091+0000 mgr.gibba009.xiladd (mgr.34457) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:58.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.734430+0000 mgr.gibba009.xiladd (mgr.34457) 3268 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:11:58.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.736330+0000 mgr.gibba009.xiladd (mgr.34457) 3269 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:11:58.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.951667+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:11:58.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.954306+0000 mgr.gibba009.xiladd (mgr.34457) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:58.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.955470+0000 mon.c (mon.1) 956 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:58.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.956436+0000 mgr.gibba009.xiladd (mgr.34457) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:58.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.957436+0000 mon.c (mon.1) 957 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.958510+0000 mgr.gibba009.xiladd (mgr.34457) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:58.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.958547+0000 mgr.gibba009.xiladd (mgr.34457) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:58.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.959547+0000 mon.c (mon.1) 958 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.960279+0000 mgr.gibba009.xiladd (mgr.34457) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:58.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.960317+0000 mgr.gibba009.xiladd (mgr.34457) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:58.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.961279+0000 mon.c (mon.1) 959 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.962206+0000 mgr.gibba009.xiladd (mgr.34457) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:58.347 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.964611+0000 mgr.gibba009.xiladd (mgr.34457) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:58.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.964704+0000 mgr.gibba009.xiladd (mgr.34457) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:58.348 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.965630+0000 mon.c (mon.1) 960 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.966235+0000 mgr.gibba009.xiladd (mgr.34457) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:58.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.966561+0000 mgr.gibba009.xiladd (mgr.34457) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:58.349 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: audit 2021-03-10T21:11:56.967490+0000 mon.c (mon.1) 961 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:58.350 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.968159+0000 mgr.gibba009.xiladd (mgr.34457) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:58.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.968198+0000 mgr.gibba009.xiladd (mgr.34457) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:58.351 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:57 gibba009 bash[26136]: cephadm 2021-03-10T21:11:56.968323+0000 mgr.gibba009.xiladd (mgr.34457) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:11:59 gibba004 bash[30897]: cluster 2021-03-10T21:11:58.711504+0000 mgr.gibba009.xiladd (mgr.34457) 3284 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:00.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:11:59 gibba004 bash[31878]: cluster 2021-03-10T21:11:58.711504+0000 mgr.gibba009.xiladd (mgr.34457) 3284 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:11:59 gibba009 bash[26136]: cluster 2021-03-10T21:11:58.711504+0000 mgr.gibba009.xiladd (mgr.34457) 3284 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:01 gibba004 bash[30897]: cluster 2021-03-10T21:12:00.713090+0000 mgr.gibba009.xiladd (mgr.34457) 3285 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.566 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:01 gibba004 bash[31878]: cluster 2021-03-10T21:12:00.713090+0000 mgr.gibba009.xiladd (mgr.34457) 3285 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:01 gibba009 bash[26136]: cluster 2021-03-10T21:12:00.713090+0000 mgr.gibba009.xiladd (mgr.34457) 3285 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:04.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:03 gibba004 bash[30897]: cluster 2021-03-10T21:12:02.714421+0000 mgr.gibba009.xiladd (mgr.34457) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:04.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:03 gibba004 bash[31878]: cluster 2021-03-10T21:12:02.714421+0000 mgr.gibba009.xiladd (mgr.34457) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:04.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:03 gibba009 bash[26136]: cluster 2021-03-10T21:12:02.714421+0000 mgr.gibba009.xiladd (mgr.34457) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:06.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:05 gibba004 bash[30897]: cluster 2021-03-10T21:12:04.716256+0000 mgr.gibba009.xiladd (mgr.34457) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:06.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:05 gibba004 bash[31878]: cluster 2021-03-10T21:12:04.716256+0000 mgr.gibba009.xiladd (mgr.34457) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:06.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:05 gibba009 bash[26136]: cluster 2021-03-10T21:12:04.716256+0000 mgr.gibba009.xiladd (mgr.34457) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:08.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:07 gibba004 bash[30897]: cluster 2021-03-10T21:12:06.717787+0000 mgr.gibba009.xiladd (mgr.34457) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:08.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:07 gibba004 bash[31878]: cluster 2021-03-10T21:12:06.717787+0000 mgr.gibba009.xiladd (mgr.34457) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:08.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:07 gibba009 bash[26136]: cluster 2021-03-10T21:12:06.717787+0000 mgr.gibba009.xiladd (mgr.34457) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:10.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:09 gibba004 bash[30897]: cluster 2021-03-10T21:12:08.719316+0000 mgr.gibba009.xiladd (mgr.34457) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:10.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:09 gibba004 bash[31878]: cluster 2021-03-10T21:12:08.719316+0000 mgr.gibba009.xiladd (mgr.34457) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:10.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:09 gibba009 bash[26136]: cluster 2021-03-10T21:12:08.719316+0000 mgr.gibba009.xiladd (mgr.34457) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:11 gibba004 bash[30897]: cluster 2021-03-10T21:12:10.721173+0000 mgr.gibba009.xiladd (mgr.34457) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:11 gibba004 bash[31878]: cluster 2021-03-10T21:12:10.721173+0000 mgr.gibba009.xiladd (mgr.34457) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:11 gibba009 bash[26136]: cluster 2021-03-10T21:12:10.721173+0000 mgr.gibba009.xiladd (mgr.34457) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:12.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:12 gibba009 bash[26136]: cephadm 2021-03-10T21:12:11.984357+0000 mgr.gibba009.xiladd (mgr.34457) 3291 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:12.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:12 gibba004 bash[30897]: cephadm 2021-03-10T21:12:11.984357+0000 mgr.gibba009.xiladd (mgr.34457) 3291 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:12.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:12 gibba004 bash[31878]: cephadm 2021-03-10T21:12:11.984357+0000 mgr.gibba009.xiladd (mgr.34457) 3291 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:13.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:13 gibba004 bash[30897]: cluster 2021-03-10T21:12:12.722555+0000 mgr.gibba009.xiladd (mgr.34457) 3292 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:13.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:13 gibba004 bash[31878]: cluster 2021-03-10T21:12:12.722555+0000 mgr.gibba009.xiladd (mgr.34457) 3292 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:13.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:13 gibba009 bash[26136]: cluster 2021-03-10T21:12:12.722555+0000 mgr.gibba009.xiladd (mgr.34457) 3292 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:16.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:15 gibba004 bash[30897]: cluster 2021-03-10T21:12:14.724072+0000 mgr.gibba009.xiladd (mgr.34457) 3293 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:16.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:15 gibba004 bash[31878]: cluster 2021-03-10T21:12:14.724072+0000 mgr.gibba009.xiladd (mgr.34457) 3293 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:16.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:15 gibba009 bash[26136]: cluster 2021-03-10T21:12:14.724072+0000 mgr.gibba009.xiladd (mgr.34457) 3293 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:18.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:17 gibba004 bash[30897]: cluster 2021-03-10T21:12:16.725599+0000 mgr.gibba009.xiladd (mgr.34457) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:18.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:17 gibba004 bash[31878]: cluster 2021-03-10T21:12:16.725599+0000 mgr.gibba009.xiladd (mgr.34457) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:18.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:17 gibba009 bash[26136]: cluster 2021-03-10T21:12:16.725599+0000 mgr.gibba009.xiladd (mgr.34457) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:20.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:19 gibba004 bash[30897]: cluster 2021-03-10T21:12:18.727333+0000 mgr.gibba009.xiladd (mgr.34457) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:20.066 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:19 gibba004 bash[31878]: cluster 2021-03-10T21:12:18.727333+0000 mgr.gibba009.xiladd (mgr.34457) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:20.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:19 gibba009 bash[26136]: cluster 2021-03-10T21:12:18.727333+0000 mgr.gibba009.xiladd (mgr.34457) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:21.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:21 gibba004 bash[30897]: cluster 2021-03-10T21:12:20.728887+0000 mgr.gibba009.xiladd (mgr.34457) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:21.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:21 gibba004 bash[31878]: cluster 2021-03-10T21:12:20.728887+0000 mgr.gibba009.xiladd (mgr.34457) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:21.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:21 gibba009 bash[26136]: cluster 2021-03-10T21:12:20.728887+0000 mgr.gibba009.xiladd (mgr.34457) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:22.029 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:12:22.251 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:12:22.252 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (61m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:12:22.252 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:12:22.252 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (61m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:12:22.252 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:12:22.253 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:12:22.253 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:12:22.253 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:12:22.253 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:12:22.253 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:12:22.254 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:12:22.254 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:12:22.254 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:12:22.254 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:12:22.255 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:12:22.255 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:12:22.255 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:12:22.255 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:12:22.256 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:12:22.256 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (66m) 5m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:12:22.256 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 6m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:22.256 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:22.498 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:12:22.498 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:12:22.499 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:22.499 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:22.499 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:12:22.499 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:22.500 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:22.500 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:12:22.500 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:12:22.500 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:22.500 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:12:22.501 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:12:22.501 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:12:22.501 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:12:22.501 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:12:22.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:22 gibba004 bash[30897]: audit 2021-03-10T21:12:22.015846+0000 mgr.gibba009.xiladd (mgr.34457) 3297 : audit [DBG] from='client.46272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:22.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:22 gibba004 bash[31878]: audit 2021-03-10T21:12:22.015846+0000 mgr.gibba009.xiladd (mgr.34457) 3297 : audit [DBG] from='client.46272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:22.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:22 gibba009 bash[26136]: audit 2021-03-10T21:12:22.015846+0000 mgr.gibba009.xiladd (mgr.34457) 3297 : audit [DBG] from='client.46272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:23.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[30897]: audit 2021-03-10T21:12:22.238793+0000 mgr.gibba009.xiladd (mgr.34457) 3298 : audit [DBG] from='client.46278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:23.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[30897]: audit 2021-03-10T21:12:22.494532+0000 mon.a (mon.0) 1066 : audit [DBG] from='client.? 172.21.2.104:0/626592225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:23.567 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[30897]: cluster 2021-03-10T21:12:22.730203+0000 mgr.gibba009.xiladd (mgr.34457) 3299 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:23.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[31878]: audit 2021-03-10T21:12:22.238793+0000 mgr.gibba009.xiladd (mgr.34457) 3298 : audit [DBG] from='client.46278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:23.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[31878]: audit 2021-03-10T21:12:22.494532+0000 mon.a (mon.0) 1066 : audit [DBG] from='client.? 172.21.2.104:0/626592225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:23.568 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:23 gibba004 bash[31878]: cluster 2021-03-10T21:12:22.730203+0000 mgr.gibba009.xiladd (mgr.34457) 3299 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:23.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:23 gibba009 bash[26136]: audit 2021-03-10T21:12:22.238793+0000 mgr.gibba009.xiladd (mgr.34457) 3298 : audit [DBG] from='client.46278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:23.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:23 gibba009 bash[26136]: audit 2021-03-10T21:12:22.494532+0000 mon.a (mon.0) 1066 : audit [DBG] from='client.? 172.21.2.104:0/626592225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:23.591 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:23 gibba009 bash[26136]: cluster 2021-03-10T21:12:22.730203+0000 mgr.gibba009.xiladd (mgr.34457) 3299 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:26.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:25 gibba004 bash[30897]: cluster 2021-03-10T21:12:24.732017+0000 mgr.gibba009.xiladd (mgr.34457) 3300 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:26.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:25 gibba004 bash[31878]: cluster 2021-03-10T21:12:24.732017+0000 mgr.gibba009.xiladd (mgr.34457) 3300 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:26.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:25 gibba009 bash[26136]: cluster 2021-03-10T21:12:24.732017+0000 mgr.gibba009.xiladd (mgr.34457) 3300 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:27 gibba004 bash[30897]: cluster 2021-03-10T21:12:26.733423+0000 mgr.gibba009.xiladd (mgr.34457) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:28.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:27 gibba004 bash[30897]: cephadm 2021-03-10T21:12:27.000326+0000 mgr.gibba009.xiladd (mgr.34457) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:27 gibba004 bash[31878]: cluster 2021-03-10T21:12:26.733423+0000 mgr.gibba009.xiladd (mgr.34457) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:28.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:27 gibba004 bash[31878]: cephadm 2021-03-10T21:12:27.000326+0000 mgr.gibba009.xiladd (mgr.34457) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:27 gibba009 bash[26136]: cluster 2021-03-10T21:12:26.733423+0000 mgr.gibba009.xiladd (mgr.34457) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:28.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:27 gibba009 bash[26136]: cephadm 2021-03-10T21:12:27.000326+0000 mgr.gibba009.xiladd (mgr.34457) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:30.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:29 gibba009 bash[26136]: cluster 2021-03-10T21:12:28.735106+0000 mgr.gibba009.xiladd (mgr.34457) 3303 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:30.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:29 gibba004 bash[30897]: cluster 2021-03-10T21:12:28.735106+0000 mgr.gibba009.xiladd (mgr.34457) 3303 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:30.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:29 gibba004 bash[31878]: cluster 2021-03-10T21:12:28.735106+0000 mgr.gibba009.xiladd (mgr.34457) 3303 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:31 gibba004 bash[30897]: cluster 2021-03-10T21:12:30.736592+0000 mgr.gibba009.xiladd (mgr.34457) 3304 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:31 gibba004 bash[31878]: cluster 2021-03-10T21:12:30.736592+0000 mgr.gibba009.xiladd (mgr.34457) 3304 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:31 gibba009 bash[26136]: cluster 2021-03-10T21:12:30.736592+0000 mgr.gibba009.xiladd (mgr.34457) 3304 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:34.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:33 gibba004 bash[30897]: cluster 2021-03-10T21:12:32.738101+0000 mgr.gibba009.xiladd (mgr.34457) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:34.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:33 gibba004 bash[31878]: cluster 2021-03-10T21:12:32.738101+0000 mgr.gibba009.xiladd (mgr.34457) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:34.090 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:33 gibba009 bash[26136]: cluster 2021-03-10T21:12:32.738101+0000 mgr.gibba009.xiladd (mgr.34457) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:36.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:35 gibba004 bash[30897]: cluster 2021-03-10T21:12:34.739731+0000 mgr.gibba009.xiladd (mgr.34457) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:36.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:35 gibba004 bash[31878]: cluster 2021-03-10T21:12:34.739731+0000 mgr.gibba009.xiladd (mgr.34457) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:36.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:35 gibba009 bash[26136]: cluster 2021-03-10T21:12:34.739731+0000 mgr.gibba009.xiladd (mgr.34457) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:38.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:37 gibba009 bash[26136]: cluster 2021-03-10T21:12:36.741041+0000 mgr.gibba009.xiladd (mgr.34457) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:38.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:37 gibba004 bash[30897]: cluster 2021-03-10T21:12:36.741041+0000 mgr.gibba009.xiladd (mgr.34457) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:38.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:37 gibba004 bash[31878]: cluster 2021-03-10T21:12:36.741041+0000 mgr.gibba009.xiladd (mgr.34457) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:40.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:39 gibba009 bash[26136]: cluster 2021-03-10T21:12:38.742487+0000 mgr.gibba009.xiladd (mgr.34457) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:40.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:39 gibba004 bash[30897]: cluster 2021-03-10T21:12:38.742487+0000 mgr.gibba009.xiladd (mgr.34457) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:40.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:39 gibba004 bash[31878]: cluster 2021-03-10T21:12:38.742487+0000 mgr.gibba009.xiladd (mgr.34457) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:41.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.972900+0000 mon.c (mon.1) 962 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.974028+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.975344+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.976280+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.987436+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.988155+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.988618+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.989097+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.990407+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.990531+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.991865+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.094 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:40 gibba009 bash[26136]: audit 2021-03-10T21:12:39.993005+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.972900+0000 mon.c (mon.1) 962 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.974028+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.975344+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.976280+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.987436+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.988155+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.988618+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.989097+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.990407+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.990531+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.991865+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[30897]: audit 2021-03-10T21:12:39.993005+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.972900+0000 mon.c (mon.1) 962 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.974028+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.975344+0000 mon.c (mon.1) 963 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.976280+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba009.xiladd/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:41.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.987436+0000 mon.c (mon.1) 964 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.988155+0000 mon.c (mon.1) 965 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.988618+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:12:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.989097+0000 mon.c (mon.1) 966 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.990407+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.990531+0000 mon.c (mon.1) 967 : audit [INF] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:41.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.991865+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T21:12:41.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:40 gibba004 bash[31878]: audit 2021-03-10T21:12:39.993005+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:12:42.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:41 gibba004 bash[30897]: cluster 2021-03-10T21:12:40.744289+0000 mgr.gibba009.xiladd (mgr.34457) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:42.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:41 gibba004 bash[31878]: cluster 2021-03-10T21:12:40.744289+0000 mgr.gibba009.xiladd (mgr.34457) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:42.346 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:41 gibba009 bash[26136]: cluster 2021-03-10T21:12:40.744289+0000 mgr.gibba009.xiladd (mgr.34457) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:43.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:42 gibba004 bash[30897]: cephadm 2021-03-10T21:12:42.016390+0000 mgr.gibba009.xiladd (mgr.34457) 3310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:43.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:42 gibba004 bash[31878]: cephadm 2021-03-10T21:12:42.016390+0000 mgr.gibba009.xiladd (mgr.34457) 3310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:43.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:42 gibba009 bash[26136]: cephadm 2021-03-10T21:12:42.016390+0000 mgr.gibba009.xiladd (mgr.34457) 3310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:44.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:43 gibba004 bash[30897]: cluster 2021-03-10T21:12:42.745973+0000 mgr.gibba009.xiladd (mgr.34457) 3311 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:44.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:43 gibba004 bash[31878]: cluster 2021-03-10T21:12:42.745973+0000 mgr.gibba009.xiladd (mgr.34457) 3311 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:44.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:43 gibba009 bash[26136]: cluster 2021-03-10T21:12:42.745973+0000 mgr.gibba009.xiladd (mgr.34457) 3311 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:46.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:45 gibba004 bash[30897]: cluster 2021-03-10T21:12:44.747392+0000 mgr.gibba009.xiladd (mgr.34457) 3312 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:46.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:45 gibba004 bash[31878]: cluster 2021-03-10T21:12:44.747392+0000 mgr.gibba009.xiladd (mgr.34457) 3312 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:46.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:45 gibba009 bash[26136]: cluster 2021-03-10T21:12:44.747392+0000 mgr.gibba009.xiladd (mgr.34457) 3312 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:48.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:47 gibba004 bash[30897]: cluster 2021-03-10T21:12:46.748622+0000 mgr.gibba009.xiladd (mgr.34457) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:48.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:47 gibba004 bash[31878]: cluster 2021-03-10T21:12:46.748622+0000 mgr.gibba009.xiladd (mgr.34457) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:48.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:47 gibba009 bash[26136]: cluster 2021-03-10T21:12:46.748622+0000 mgr.gibba009.xiladd (mgr.34457) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:50.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:49 gibba004 bash[30897]: cluster 2021-03-10T21:12:48.750075+0000 mgr.gibba009.xiladd (mgr.34457) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:50.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:49 gibba004 bash[31878]: cluster 2021-03-10T21:12:48.750075+0000 mgr.gibba009.xiladd (mgr.34457) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:50.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:49 gibba009 bash[26136]: cluster 2021-03-10T21:12:48.750075+0000 mgr.gibba009.xiladd (mgr.34457) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:51.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:51 gibba004 bash[30897]: cluster 2021-03-10T21:12:50.751735+0000 mgr.gibba009.xiladd (mgr.34457) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:51.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:51 gibba004 bash[31878]: cluster 2021-03-10T21:12:50.751735+0000 mgr.gibba009.xiladd (mgr.34457) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:51.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:51 gibba009 bash[26136]: cluster 2021-03-10T21:12:50.751735+0000 mgr.gibba009.xiladd (mgr.34457) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:52.738 INFO:teuthology.orchestra.run.gibba004.stdout:true 2021-03-10T21:12:52.967 INFO:teuthology.orchestra.run.gibba004.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:12:52.967 INFO:teuthology.orchestra.run.gibba004.stdout:alertmanager.a gibba004 running (61m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b 9cc27c92b598 2021-03-10T21:12:52.967 INFO:teuthology.orchestra.run.gibba004.stdout:grafana.a gibba009 running (66m) 6m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 1c5fbb372128 2021-03-10T21:12:52.967 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.gibba009.xiladd gibba009 running (62m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d88808aee843 2021-03-10T21:12:52.968 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.x gibba009 running (62m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 2c85c7c1673e 2021-03-10T21:12:52.968 INFO:teuthology.orchestra.run.gibba004.stdout:mgr.y gibba004 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7e272ae0ba45 2021-03-10T21:12:52.968 INFO:teuthology.orchestra.run.gibba004.stdout:mon.a gibba004 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1e467460127d 2021-03-10T21:12:52.968 INFO:teuthology.orchestra.run.gibba004.stdout:mon.b gibba009 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2b8247910149 2021-03-10T21:12:52.969 INFO:teuthology.orchestra.run.gibba004.stdout:mon.c gibba004 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da eee0353850d9 2021-03-10T21:12:52.969 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.a gibba004 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 c4d7618d1b8a 2021-03-10T21:12:52.969 INFO:teuthology.orchestra.run.gibba004.stdout:node-exporter.b gibba009 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 15d9b915a317 2021-03-10T21:12:52.969 INFO:teuthology.orchestra.run.gibba004.stdout:osd.0 gibba004 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 52e71ed45f0e 2021-03-10T21:12:52.969 INFO:teuthology.orchestra.run.gibba004.stdout:osd.1 gibba004 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 47061588e327 2021-03-10T21:12:52.970 INFO:teuthology.orchestra.run.gibba004.stdout:osd.2 gibba004 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da bd5e0f920965 2021-03-10T21:12:52.970 INFO:teuthology.orchestra.run.gibba004.stdout:osd.3 gibba004 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 9710057111fa 2021-03-10T21:12:52.970 INFO:teuthology.orchestra.run.gibba004.stdout:osd.4 gibba009 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da adf865bce7c0 2021-03-10T21:12:52.970 INFO:teuthology.orchestra.run.gibba004.stdout:osd.5 gibba009 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 30ac06ed17d7 2021-03-10T21:12:52.970 INFO:teuthology.orchestra.run.gibba004.stdout:osd.6 gibba009 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da af61f8f4108a 2021-03-10T21:12:52.971 INFO:teuthology.orchestra.run.gibba004.stdout:osd.7 gibba009 running (57m) 6m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da cf88edb474b0 2021-03-10T21:12:52.971 INFO:teuthology.orchestra.run.gibba004.stdout:prometheus.a gibba009 running (66m) 6m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 dd1b71522d82 2021-03-10T21:12:52.971 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba004.fosjgj gibba004 error 7m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:52.971 INFO:teuthology.orchestra.run.gibba004.stdout:rgw.r.z.gibba009.xbhxrc gibba009 error 6m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:53.218 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-03-10T21:12:53.219 INFO:teuthology.orchestra.run.gibba004.stdout: "mon": { 2021-03-10T21:12:53.219 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:53.219 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:53.220 INFO:teuthology.orchestra.run.gibba004.stdout: "mgr": { 2021-03-10T21:12:53.220 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:53.220 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:53.220 INFO:teuthology.orchestra.run.gibba004.stdout: "osd": { 2021-03-10T21:12:53.220 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:12:53.221 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-03-10T21:12:53.221 INFO:teuthology.orchestra.run.gibba004.stdout: "mds": {}, 2021-03-10T21:12:53.221 INFO:teuthology.orchestra.run.gibba004.stdout: "overall": { 2021-03-10T21:12:53.221 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:12:53.222 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-03-10T21:12:53.222 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-03-10T21:12:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[30897]: audit 2021-03-10T21:12:52.725375+0000 mgr.gibba009.xiladd (mgr.34457) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.066 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[30897]: cluster 2021-03-10T21:12:52.753047+0000 mgr.gibba009.xiladd (mgr.34457) 3317 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:54.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[30897]: audit 2021-03-10T21:12:52.949906+0000 mgr.gibba009.xiladd (mgr.34457) 3318 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.067 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[30897]: audit 2021-03-10T21:12:53.214891+0000 mon.a (mon.0) 1073 : audit [DBG] from='client.? 172.21.2.104:0/139638319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:54.067 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[31878]: audit 2021-03-10T21:12:52.725375+0000 mgr.gibba009.xiladd (mgr.34457) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[31878]: cluster 2021-03-10T21:12:52.753047+0000 mgr.gibba009.xiladd (mgr.34457) 3317 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[31878]: audit 2021-03-10T21:12:52.949906+0000 mgr.gibba009.xiladd (mgr.34457) 3318 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.068 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:53 gibba004 bash[31878]: audit 2021-03-10T21:12:53.214891+0000 mon.a (mon.0) 1073 : audit [DBG] from='client.? 172.21.2.104:0/139638319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:54.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:53 gibba009 bash[26136]: audit 2021-03-10T21:12:52.725375+0000 mgr.gibba009.xiladd (mgr.34457) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:53 gibba009 bash[26136]: cluster 2021-03-10T21:12:52.753047+0000 mgr.gibba009.xiladd (mgr.34457) 3317 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:54.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:53 gibba009 bash[26136]: audit 2021-03-10T21:12:52.949906+0000 mgr.gibba009.xiladd (mgr.34457) 3318 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:54.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:53 gibba009 bash[26136]: audit 2021-03-10T21:12:53.214891+0000 mon.a (mon.0) 1073 : audit [DBG] from='client.? 172.21.2.104:0/139638319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:56.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:55 gibba009 bash[26136]: cluster 2021-03-10T21:12:54.754579+0000 mgr.gibba009.xiladd (mgr.34457) 3319 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:56.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:55 gibba004 bash[30897]: cluster 2021-03-10T21:12:54.754579+0000 mgr.gibba009.xiladd (mgr.34457) 3319 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:56.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:55 gibba004 bash[31878]: cluster 2021-03-10T21:12:54.754579+0000 mgr.gibba009.xiladd (mgr.34457) 3319 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:58.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: cluster 2021-03-10T21:12:56.755946+0000 mgr.gibba009.xiladd (mgr.34457) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:58.091 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.033343+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.238269+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.258892+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.448976+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.452612+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.092 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.453907+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.455365+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.456709+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.459909+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.093 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:57 gibba009 bash[26136]: audit 2021-03-10T21:12:57.461434+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: cluster 2021-03-10T21:12:56.755946+0000 mgr.gibba009.xiladd (mgr.34457) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.033343+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.238269+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.258892+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.448976+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.452612+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.453907+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.455365+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.456709+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.459909+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[30897]: audit 2021-03-10T21:12:57.461434+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.319 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: cluster 2021-03-10T21:12:56.755946+0000 mgr.gibba009.xiladd (mgr.34457) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.033343+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.238269+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.258892+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.320 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.448976+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34457 ' entity='mgr.gibba009.xiladd' 2021-03-10T21:12:58.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.452612+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:58.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.453907+0000 mon.c (mon.1) 970 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.455365+0000 mon.c (mon.1) 971 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.456709+0000 mon.c (mon.1) 972 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.459909+0000 mon.c (mon.1) 973 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:58.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:57 gibba004 bash[31878]: audit 2021-03-10T21:12:57.461434+0000 mon.c (mon.1) 974 : audit [DBG] from='mgr.34457 172.21.2.109:0/107994795' entity='mgr.gibba009.xiladd' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:59.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.239418+0000 mgr.gibba009.xiladd (mgr.34457) 3321 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:12:59.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.259620+0000 mgr.gibba009.xiladd (mgr.34457) 3322 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:12:59.317 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.451638+0000 mgr.gibba009.xiladd (mgr.34457) 3323 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:59.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.453119+0000 mgr.gibba009.xiladd (mgr.34457) 3324 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:59.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.454391+0000 mgr.gibba009.xiladd (mgr.34457) 3325 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:59.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.454431+0000 mgr.gibba009.xiladd (mgr.34457) 3326 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:59.318 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.455918+0000 mgr.gibba009.xiladd (mgr.34457) 3327 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:59.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.455954+0000 mgr.gibba009.xiladd (mgr.34457) 3328 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:59.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.457046+0000 mgr.gibba009.xiladd (mgr.34457) 3329 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:59.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.458961+0000 mgr.gibba009.xiladd (mgr.34457) 3330 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:59.319 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.458999+0000 mgr.gibba009.xiladd (mgr.34457) 3331 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:59.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.460359+0000 mgr.gibba009.xiladd (mgr.34457) 3332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:59.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.460715+0000 mgr.gibba009.xiladd (mgr.34457) 3333 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:59.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.462061+0000 mgr.gibba009.xiladd (mgr.34457) 3334 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:59.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.462100+0000 mgr.gibba009.xiladd (mgr.34457) 3335 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:59.320 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[30897]: cephadm 2021-03-10T21:12:57.462227+0000 mgr.gibba009.xiladd (mgr.34457) 3336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:59.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.239418+0000 mgr.gibba009.xiladd (mgr.34457) 3321 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:12:59.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.259620+0000 mgr.gibba009.xiladd (mgr.34457) 3322 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:12:59.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.451638+0000 mgr.gibba009.xiladd (mgr.34457) 3323 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:59.321 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.453119+0000 mgr.gibba009.xiladd (mgr.34457) 3324 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:59.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.454391+0000 mgr.gibba009.xiladd (mgr.34457) 3325 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:59.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.454431+0000 mgr.gibba009.xiladd (mgr.34457) 3326 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:59.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.455918+0000 mgr.gibba009.xiladd (mgr.34457) 3327 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:59.322 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.455954+0000 mgr.gibba009.xiladd (mgr.34457) 3328 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:59.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.457046+0000 mgr.gibba009.xiladd (mgr.34457) 3329 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:59.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.458961+0000 mgr.gibba009.xiladd (mgr.34457) 3330 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:59.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.458999+0000 mgr.gibba009.xiladd (mgr.34457) 3331 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:59.323 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.460359+0000 mgr.gibba009.xiladd (mgr.34457) 3332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:59.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.460715+0000 mgr.gibba009.xiladd (mgr.34457) 3333 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:59.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.462061+0000 mgr.gibba009.xiladd (mgr.34457) 3334 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:59.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.462100+0000 mgr.gibba009.xiladd (mgr.34457) 3335 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:59.324 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:58 gibba004 bash[31878]: cephadm 2021-03-10T21:12:57.462227+0000 mgr.gibba009.xiladd (mgr.34457) 3336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:12:59.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.239418+0000 mgr.gibba009.xiladd (mgr.34457) 3321 : cephadm [INF] Refreshing gibba009 facts 2021-03-10T21:12:59.341 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.259620+0000 mgr.gibba009.xiladd (mgr.34457) 3322 : cephadm [INF] Refreshing gibba004 facts 2021-03-10T21:12:59.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.451638+0000 mgr.gibba009.xiladd (mgr.34457) 3323 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:59.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.453119+0000 mgr.gibba009.xiladd (mgr.34457) 3324 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:59.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.454391+0000 mgr.gibba009.xiladd (mgr.34457) 3325 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:59.342 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.454431+0000 mgr.gibba009.xiladd (mgr.34457) 3326 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:59.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.455918+0000 mgr.gibba009.xiladd (mgr.34457) 3327 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:59.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.455954+0000 mgr.gibba009.xiladd (mgr.34457) 3328 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:59.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.457046+0000 mgr.gibba009.xiladd (mgr.34457) 3329 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:59.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.458961+0000 mgr.gibba009.xiladd (mgr.34457) 3330 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:59.343 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.458999+0000 mgr.gibba009.xiladd (mgr.34457) 3331 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:59.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.460359+0000 mgr.gibba009.xiladd (mgr.34457) 3332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:59.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.460715+0000 mgr.gibba009.xiladd (mgr.34457) 3333 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:59.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.462061+0000 mgr.gibba009.xiladd (mgr.34457) 3334 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:59.344 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.462100+0000 mgr.gibba009.xiladd (mgr.34457) 3335 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:59.345 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:58 gibba009 bash[26136]: cephadm 2021-03-10T21:12:57.462227+0000 mgr.gibba009.xiladd (mgr.34457) 3336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba004.fosjgj'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba004.fosjgj']. 2021-03-10T21:13:00.316 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:12:59 gibba004 bash[30897]: cluster 2021-03-10T21:12:58.757510+0000 mgr.gibba009.xiladd (mgr.34457) 3337 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:00.317 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:12:59 gibba004 bash[31878]: cluster 2021-03-10T21:12:58.757510+0000 mgr.gibba009.xiladd (mgr.34457) 3337 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:00.340 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:12:59 gibba009 bash[26136]: cluster 2021-03-10T21:12:58.757510+0000 mgr.gibba009.xiladd (mgr.34457) 3337 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.566 INFO:journalctl@ceph.mon.a.gibba004.stdout:Mar 10 21:13:01 gibba004 bash[30897]: cluster 2021-03-10T21:13:00.759267+0000 mgr.gibba009.xiladd (mgr.34457) 3338 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.567 INFO:journalctl@ceph.mon.c.gibba004.stdout:Mar 10 21:13:01 gibba004 bash[31878]: cluster 2021-03-10T21:13:00.759267+0000 mgr.gibba009.xiladd (mgr.34457) 3338 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.590 INFO:journalctl@ceph.mon.b.gibba009.stdout:Mar 10 21:13:01 gibba009 bash[26136]: cluster 2021-03-10T21:13:00.759267+0000 mgr.gibba009.xiladd (mgr.34457) 3338 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:02.981 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-10T21:13:02.984 DEBUG:teuthology.task.console_log:Killing console logger for gibba004 2021-03-10T21:13:02.985 DEBUG:teuthology.task.console_log:Killing console logger for gibba009 2021-03-10T21:13:02.986 DEBUG:teuthology.exit:Finished running handlers